-- Logs begin at Thu 2022-07-14 08:56:28 UTC, end at Thu 2022-07-14 10:34:16 UTC. -- Jul 14 09:23:13.978602 dv-cinder-825492-26-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Jul 14 09:23:13.985926 dv-cinder-825492-26-iscsi devstack@keystone.service[80186]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 14 09:23:13.990022 dv-cinder-825492-26-iscsi devstack@keystone.service[80186]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jul 14 09:23:13 2022] *** Jul 14 09:23:13.990022 dv-cinder-825492-26-iscsi devstack@keystone.service[80186]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 14 09:23:13.990022 dv-cinder-825492-26-iscsi devstack@keystone.service[80186]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 14 09:23:13.990022 dv-cinder-825492-26-iscsi devstack@keystone.service[80186]: nodename: dv-cinder-825492-26-iscsi Jul 14 09:23:13.990022 dv-cinder-825492-26-iscsi devstack@keystone.service[80186]: machine: x86_64 Jul 14 09:23:13.990022 dv-cinder-825492-26-iscsi devstack@keystone.service[80186]: clock source: unix Jul 14 09:23:13.990022 dv-cinder-825492-26-iscsi devstack@keystone.service[80186]: pcre jit disabled Jul 14 09:23:13.990022 dv-cinder-825492-26-iscsi devstack@keystone.service[80186]: detected number of CPU cores: 4 Jul 14 09:23:13.990022 dv-cinder-825492-26-iscsi devstack@keystone.service[80186]: current working directory: / Jul 14 09:23:13.990022 dv-cinder-825492-26-iscsi devstack@keystone.service[80186]: detected binary path: /usr/bin/uwsgi-core Jul 14 09:23:13.990022 dv-cinder-825492-26-iscsi devstack@keystone.service[80186]: your processes number limit is 47680 Jul 14 09:23:13.990022 dv-cinder-825492-26-iscsi devstack@keystone.service[80186]: your memory page size is 4096 bytes Jul 14 09:23:13.990022 dv-cinder-825492-26-iscsi devstack@keystone.service[80186]: detected max file descriptor number: 2048 Jul 14 09:23:13.990022 dv-cinder-825492-26-iscsi devstack@keystone.service[80186]: lock engine: pthread robust mutexes Jul 14 09:23:13.990022 dv-cinder-825492-26-iscsi devstack@keystone.service[80186]: thunder lock: enabled Jul 14 09:23:13.990022 dv-cinder-825492-26-iscsi devstack@keystone.service[80186]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 14 09:23:13.990022 dv-cinder-825492-26-iscsi devstack@keystone.service[80186]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 14 09:23:14.034130 dv-cinder-825492-26-iscsi devstack@keystone.service[80186]: Python main interpreter initialized at 0x55fe203249c0 Jul 14 09:23:14.034130 dv-cinder-825492-26-iscsi devstack@keystone.service[80186]: python threads support enabled Jul 14 09:23:14.034130 dv-cinder-825492-26-iscsi devstack@keystone.service[80186]: your server socket listen backlog is limited to 100 connections Jul 14 09:23:14.034130 dv-cinder-825492-26-iscsi devstack@keystone.service[80186]: your mercy for graceful operations on workers is 90 seconds Jul 14 09:23:14.034552 dv-cinder-825492-26-iscsi devstack@keystone.service[80186]: mapped 403077 bytes (393 KB) for 2 cores Jul 14 09:23:14.034627 dv-cinder-825492-26-iscsi devstack@keystone.service[80186]: *** Operational MODE: preforking *** Jul 14 09:23:14.034868 dv-cinder-825492-26-iscsi devstack@keystone.service[80186]: *** uWSGI is running in multiple interpreter mode *** Jul 14 09:23:14.034868 dv-cinder-825492-26-iscsi devstack@keystone.service[80186]: spawned uWSGI master process (pid: 80186) Jul 14 09:23:14.035306 dv-cinder-825492-26-iscsi systemd[1]: Started Devstack devstack@keystone.service. Jul 14 09:23:14.036263 dv-cinder-825492-26-iscsi devstack@keystone.service[80186]: spawned uWSGI worker 1 (pid: 80197, cores: 1) Jul 14 09:23:14.036263 dv-cinder-825492-26-iscsi devstack@keystone.service[80186]: spawned uWSGI worker 2 (pid: 80198, cores: 1) Jul 14 09:23:14.036263 dv-cinder-825492-26-iscsi devstack@keystone.service[80186]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 14 09:23:19.542116 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 09:23:19.542116 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: from cryptography.utils import int_from_bytes Jul 14 09:23:19.543450 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 09:23:19.543450 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: from cryptography.utils import int_from_bytes Jul 14 09:23:19.543581 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 09:23:19.543581 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: from cryptography.utils import int_from_bytes Jul 14 09:23:19.543581 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 09:23:19.543581 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: from cryptography.utils import int_from_bytes Jul 14 09:23:19.591956 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 14 09:23:19.592158 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 14 09:23:19.592248 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 14 09:23:19.592337 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 14 09:23:19.592415 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] command line args: [] {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 14 09:23:19.592494 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] command line args: [] {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 14 09:23:19.592595 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 14 09:23:19.592673 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 14 09:23:19.592777 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] ================================================================================ {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 14 09:23:19.592856 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] ================================================================================ {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 14 09:23:19.593040 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] admin_token = **** {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:23:19.593144 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] admin_token = **** {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:23:19.593282 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] config_dir = [] {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:23:19.593404 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] config_dir = [] {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:23:19.593482 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:23:19.593556 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:23:19.593631 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] config_source = [] {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:23:19.593712 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] config_source = [] {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:23:19.593786 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] debug = True {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:23:19.593856 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] debug = True {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:23:19.593990 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:23:19.594357 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:23:19.594357 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:23:19.594614 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:23:19.594717 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:23:19.594813 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:23:19.594925 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:23:19.595022 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:23:19.595304 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:23:19.595497 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:23:19.595681 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] list_limit = None {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:23:19.595885 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] list_limit = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:23:19.596057 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] log_config_append = None {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:23:19.596206 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] log_config_append = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:23:19.596313 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:23:19.596455 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:23:19.596535 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] log_dir = None {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:23:19.596687 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] log_dir = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:23:19.596779 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] log_file = None {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:23:19.596852 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] log_file = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:23:19.596999 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:23:19.597104 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:23:19.597228 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:23:19.597325 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:23:19.597404 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:23:19.597529 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:23:19.597604 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:23:19.597729 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:23:19.597835 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:23:19.597951 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:23:19.598034 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:23:19.598162 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:23:19.598295 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:23:19.598380 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:23:19.598504 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:23:19.598587 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:23:19.598710 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:23:19.598784 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:23:19.598896 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:23:19.598969 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:23:19.599080 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:23:19.599164 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:23:19.599288 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:23:19.599368 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:23:19.599484 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:23:19.599568 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:23:19.599683 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:23:19.599763 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:23:19.599883 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:23:19.599957 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:23:19.600072 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.40/identity {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:23:19.600146 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.40/identity {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:23:19.600221 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] publish_errors = False {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:23:19.600296 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] publish_errors = False {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:23:19.600296 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:23:19.600485 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:23:19.600562 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:23:19.600682 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:23:19.600760 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:23:19.600830 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:23:19.600902 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:23:19.600990 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:23:19.601067 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:23:19.601136 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:23:19.601203 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] standard_threads = False {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:23:19.601276 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] standard_threads = False {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:23:19.601394 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:23:19.601471 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:23:19.601624 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:23:19.601711 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:23:19.601814 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:23:19.601897 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:23:19.602024 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] use_journal = False {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:23:19.602099 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] use_journal = False {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:23:19.602168 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] use_json = False {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:23:19.602325 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] use_json = False {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:23:19.602402 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] use_stderr = False {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:23:19.602478 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] use_stderr = False {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:23:19.602593 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] use_syslog = False {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:23:19.602670 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] use_syslog = False {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:23:19.602739 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:23:19.602840 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:23:19.602940 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.603028 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.603176 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.603252 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.603433 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.603514 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.603670 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.603754 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.603917 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.603998 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.604154 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.604236 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.604399 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.604482 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.604634 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.604709 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.604880 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.604956 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.605663 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.605758 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.605916 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.605997 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.606149 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.606246 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.606424 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.606513 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.606661 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.606742 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.606906 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.606981 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.607151 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.607302 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.607376 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.607449 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.607630 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.607712 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.607880 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.607966 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.608124 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.608200 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.608358 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.608443 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.608609 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.608693 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.608866 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.608949 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.609119 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.609200 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.609367 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.609453 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.609598 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.609673 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.609831 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.609907 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.610062 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.610145 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.610322 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.610399 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.610569 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.610644 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.610816 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.610893 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.611045 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.611123 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.611275 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.611357 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.611519 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.611596 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.611766 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.611841 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.612202 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.612286 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.612365 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.612435 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.612502 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.612570 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.612676 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.612797 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.612980 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.613054 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.613129 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.613199 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.613347 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.613425 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.613575 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.613652 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.613803 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.613879 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.614037 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.614114 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.614300 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.614385 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.614533 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.614610 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.614771 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.614876 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.615003 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.615120 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.615239 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.615347 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.615472 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.615574 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.615717 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.615820 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.615946 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.616055 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.616181 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.616288 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.616416 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.616493 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.616651 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.616731 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.616885 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.616965 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.617122 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.617199 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.617349 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.617428 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.617595 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.617717 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.617863 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.617942 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.618051 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.618179 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.618317 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.618447 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.618556 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.618635 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.618774 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.618853 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.619003 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.619371 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.619492 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.619560 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.619728 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.619848 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.619998 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.620119 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.620237 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.620314 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.620485 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.620567 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.620780 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.621463 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.621564 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.621708 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.621786 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.621856 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.621975 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.622054 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.622372 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.622470 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.622619 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.622697 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.622861 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.622941 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.623105 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.623190 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.623346 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.623429 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.623583 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.623666 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.623820 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.623904 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.624054 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.624136 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.624290 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.624366 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.624553 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.624639 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.624796 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.624872 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.625037 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.625122 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.625277 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.625429 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.625510 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.625581 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.625748 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.625826 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.625985 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.626069 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.626244 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.626339 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.626482 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.626560 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.626713 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.626833 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.626944 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.627029 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.627180 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.627257 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.627410 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.627485 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.627651 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.627736 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.627885 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.627973 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.628132 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.628209 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.628369 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.628453 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.628623 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.628700 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.628880 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.628958 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.629120 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.629204 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.629352 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] auth.external = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.629429 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] auth.external = None {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.629586 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.629662 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.629878 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.629983 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.630110 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.630245 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.630366 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] auth.password = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.630443 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] auth.password = None {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.630597 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] auth.token = None {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.630674 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] auth.token = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.630836 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.630915 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.631073 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.631150 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.631322 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.631408 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.631552 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.631631 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.631798 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.631882 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.632046 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.632128 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.632278 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.632361 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.632514 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] credential.caching = True {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.632591 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] credential.caching = True {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.632758 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.632843 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.633006 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.633086 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.633251 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.633331 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.633485 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.633562 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.633727 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.633806 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.633962 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.634041 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.634237 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.634319 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.634493 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.634572 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.634728 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.634806 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.634981 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.635058 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.635263 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.635341 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.635510 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.635588 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.635772 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.635849 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.636022 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.636151 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.636277 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.636445 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.636529 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] federation.caching = True {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.636606 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] federation.caching = True {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.636770 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.636871 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.637010 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.637089 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.637256 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.637333 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.637486 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.637564 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.637730 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.637807 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.637963 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.638040 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.638232 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.638314 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.638496 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.638615 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.638742 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.638834 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.638963 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.639094 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.639209 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.639287 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.639447 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] identity.caching = True {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.639525 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] identity.caching = True {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.639717 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.639799 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.639925 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.640004 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.640160 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.640250 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.640392 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.640470 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.640637 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.640714 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.640865 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.640950 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.641099 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.641176 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.641349 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.641427 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.641598 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.641683 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.641827 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.641904 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.642055 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.642132 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.642309 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.642400 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.642555 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.642633 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.642802 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.642880 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.643049 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.643137 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.643304 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.643384 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.643551 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.643629 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.643820 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.643905 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.644062 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.644141 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.644358 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.644445 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.644565 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.644649 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.644758 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.644838 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.644989 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.645066 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.645225 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.645311 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.645465 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.645543 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.645701 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.645780 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.645949 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.646035 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.646179 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.646278 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.646447 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.646534 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.646690 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.646786 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.646924 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.647002 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.647168 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.647245 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.647412 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.647498 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.647641 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.647717 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.647877 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.647955 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.648104 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.648194 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.648342 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.648420 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.648580 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.648660 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.648820 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.648908 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.649059 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.649138 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.649298 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.649376 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.649547 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.649632 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.649792 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.649869 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.650024 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.650101 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.650276 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.650372 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.650526 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.650604 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.650770 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.650848 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.651006 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.651091 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.651240 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.651318 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.651478 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.651560 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.651706 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] ldap.user = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.651793 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] ldap.user = None {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.651964 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.652055 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.652224 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.652302 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.652455 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.652540 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.652697 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.652787 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.652944 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.653022 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.653187 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.653265 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.653419 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.653496 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.653647 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.653723 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.653881 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.653960 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.654113 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.654204 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.654370 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.654448 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.654601 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.654681 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.654846 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.654923 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.655088 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.655166 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.655331 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.655410 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.655572 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.655649 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.655816 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.655895 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.656047 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.656127 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.656293 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.656371 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.656529 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.656607 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.656762 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.656841 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.656996 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.657074 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.657227 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.657304 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.657471 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.657549 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.657713 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.657790 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.657948 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.658025 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.658251 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.658333 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.658452 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.658559 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.658689 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.658767 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.658926 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.659004 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.659185 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.659309 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.659495 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.659590 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.659661 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.659722 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.659857 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.659936 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.660087 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.660164 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.660324 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.660394 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.660569 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] resource.caching = True {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.660688 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] resource.caching = True {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.660799 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.660919 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.661049 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.661129 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.661288 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.661367 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.661537 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.661640 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.661790 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.661872 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.662026 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.662111 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.662295 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.662377 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.662525 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.662599 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.662760 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.662847 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.662996 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] role.caching = True {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.663104 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] role.caching = True {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.663239 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] role.driver = sql {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.663320 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] role.driver = sql {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.663467 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.663545 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.663713 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.663791 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.663959 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.664038 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.664206 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.664292 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.664449 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.664535 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.664693 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.664772 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.664936 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.665015 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.665179 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.665270 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.665426 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.665511 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.665654 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.665732 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.665899 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.665992 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.666144 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.666295 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.666414 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.666496 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.666663 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.666807 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.667072 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.667193 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.667300 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.667390 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.668040 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.668137 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.668323 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.668410 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.668571 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.668651 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.668818 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.668905 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.669057 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.669144 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.669306 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.669385 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.669556 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.669651 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.669792 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.669871 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.670023 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.670101 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.670278 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.670374 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.670515 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.670603 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.670762 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.670873 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.671011 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.671091 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.671258 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.671336 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.671494 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.671572 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.671730 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.671811 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.671962 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.672042 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.672199 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] token.caching = True {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.672278 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] token.caching = True {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.672437 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.672516 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.672682 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.672760 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.672918 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.672995 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.673171 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.673250 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.673418 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.673495 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.673653 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.673731 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.673897 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.673976 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.674138 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.674241 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.674410 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.674500 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.674647 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.674726 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.674882 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.674960 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.675117 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.675194 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.675359 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.675438 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.675604 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.675681 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.675831 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.675908 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.676073 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.676152 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.676367 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.676446 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.676626 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] database.connection = **** {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.676712 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] database.connection = **** {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.676868 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.676956 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.677114 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.677200 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.677349 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.677426 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.677587 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.677665 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.677819 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.677904 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.678055 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.678134 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.678314 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.678394 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.678552 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.678642 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.678794 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.678872 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.679032 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.679111 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.679274 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.679359 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.679507 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.679586 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.679751 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.679828 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.679983 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.680068 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.680226 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.680312 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.680453 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.680531 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.680692 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.680778 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.680925 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.681003 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:23:19.681095 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 14 09:23:19.681174 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 14 09:23:19.712363 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80197) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 09:23:19.712593 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 09:23:19.712683 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80197) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 09:23:19.712759 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 09:23:19.712823 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80197) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 09:23:19.712908 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 09:23:19.721571 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 09:23:19.731330 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80197) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 09:23:19.751895 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 09:23:19.752181 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 09:23:19.752705 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80197) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 09:23:19.752938 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80197) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 09:23:19.895485 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80197) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 09:23:19.895666 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 09:23:19.945312 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 09:23:19.945544 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 09:23:19.945668 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80197) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 09:23:19.945822 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80197) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 09:23:20.011516 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80197) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 09:23:20.011740 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80197) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 09:23:20.011864 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 09:23:20.011979 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80197) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 09:23:20.012106 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 09:23:20.012203 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80197) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 09:23:20.012332 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 09:23:20.012428 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80197) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 09:23:20.012554 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 09:23:20.012660 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80197) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 09:23:20.012769 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 09:23:20.013384 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 09:23:20.038203 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80197) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 09:23:20.038384 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 09:23:20.038484 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80197) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 09:23:20.038585 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 09:23:20.038670 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80197) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 09:23:20.038809 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 09:23:20.038917 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80197) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 09:23:20.039027 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 09:23:20.039111 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80197) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 09:23:20.039244 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 09:23:20.039368 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80197) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 09:23:20.039581 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 09:23:20.039673 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80197) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 09:23:20.039770 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 09:23:20.051325 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 09:23:20.051571 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80197) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 09:23:20.064322 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 09:23:20.064493 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80197) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 09:23:20.064594 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 09:23:20.064675 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80197) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 09:23:20.064750 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 09:23:20.064869 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80197) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 09:23:20.064981 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 09:23:20.065074 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80197) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 09:23:20.065197 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 09:23:20.065316 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80197) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 09:23:20.065396 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 09:23:20.065499 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80197) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 09:23:20.065591 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 09:23:20.065715 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80197) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 09:23:20.082647 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:23:20.082940 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 14 09:23:20.083122 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:23:20.083243 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 14 09:23:20.083376 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:23:20.083376 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 14 09:23:20.083580 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:23:20.083689 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 14 09:23:20.083883 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:23:20.084150 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:23:20.084287 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:23:20.084406 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:23:20.084526 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:23:20.084644 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:23:20.084759 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:23:20.084931 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:23:20.095990 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:23:20.096272 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:23:20.096376 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:23:20.096543 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:23:20.096643 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:23:20.096826 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:23:20.096917 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:23:20.097107 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:23:20.105007 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80198) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 09:23:20.105720 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80197) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 09:23:20.108840 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80198) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 09:23:20.109120 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:23:20.109208 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80197) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 09:23:20.109438 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:23:20.109533 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:23:20.109680 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:23:20.109764 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:23:20.109959 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:23:20.110040 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:23:20.110247 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:23:20.110345 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:23:20.110507 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:23:20.110589 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:23:20.110790 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:23:20.110883 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:23:20.111044 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:23:20.111136 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:23:20.111309 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:23:20.111390 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:23:20.111596 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:23:20.111687 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:23:20.111915 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:23:20.138203 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:23:20.138647 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:23:20.139822 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80198) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 09:23:20.140103 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:23:20.140286 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80197) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 09:23:20.140569 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:23:20.145331 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80198) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 09:23:20.145660 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:23:20.145803 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80197) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 09:23:20.145898 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:23:20.146086 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:23:20.146387 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:23:20.153816 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80198) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 09:23:20.154097 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:23:20.154404 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80197) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 09:23:20.154692 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:23:20.158572 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80198) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 09:23:20.158862 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:23:20.159145 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:23:20.159237 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80197) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 09:23:20.159431 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:23:20.159518 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:23:20.159712 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:23:20.159799 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:23:20.160048 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:23:20.160159 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:23:20.160237 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:23:20.160308 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:23:20.160515 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:23:20.160611 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:23:20.160783 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:23:20.161057 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:23:20.179707 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:23:20.179996 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:23:20.180303 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:23:20.180597 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:23:20.184651 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80198) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 09:23:20.185232 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80197) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 09:23:20.188316 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:23:20.188614 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:23:20.188873 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:23:20.189170 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:23:20.193727 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80198) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 09:23:20.194285 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80197) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 09:23:20.197326 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80198) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 09:23:20.197865 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80197) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 09:23:20.201030 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:23:20.201329 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:23:20.201528 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:23:20.201689 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:23:20.201826 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:23:20.201909 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:23:20.202109 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:23:20.202210 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:23:20.202448 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:23:20.202540 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:23:20.202716 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:23:20.203006 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:23:20.221823 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80198) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 09:23:20.222111 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:23:20.222403 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:23:20.222499 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80197) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 09:23:20.222673 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:23:20.222819 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:23:20.223006 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:23:20.223271 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:23:20.231173 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:23:20.231751 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:23:20.232886 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:23:20.233188 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:23:20.233468 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:23:20.233750 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:23:20.236405 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80198) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 09:23:20.236686 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:23:20.236873 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80197) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 09:23:20.237003 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:23:20.237124 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:23:20.237250 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:23:20.237534 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:23:20.237667 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:23:20.237818 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:23:20.238100 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:23:20.251039 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80198) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 09:23:20.251318 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:23:20.251571 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80197) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 09:23:20.251704 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:23:20.251855 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:23:20.251946 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:23:20.252136 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:23:20.252240 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:23:20.252418 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:23:20.252507 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:23:20.252694 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:23:20.252826 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:23:20.252982 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:23:20.253257 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:23:20.272536 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80198) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 09:23:20.273034 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80197) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 09:23:20.275825 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80198) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 09:23:20.276343 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80197) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 09:23:20.279704 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:23:20.280205 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:23:20.281291 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:23:20.281795 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:23:20.283082 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80198) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 09:23:20.283361 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:23:20.283578 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80197) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 09:23:20.283662 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:23:20.283863 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:23:20.284158 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:23:20.290902 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:23:20.291476 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:23:20.292503 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80198) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 09:23:20.293110 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80197) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 09:23:20.295766 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:23:20.296059 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:23:20.296332 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:23:20.296468 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:23:20.296639 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:23:20.296731 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:23:20.296895 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:23:20.297172 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:23:20.305842 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80198) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 09:23:20.306130 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:23:20.306381 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80197) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 09:23:20.306485 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:23:20.306675 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:23:20.306958 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:23:20.314232 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80198) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 09:23:20.314519 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:23:20.314801 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:23:20.314885 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80197) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 09:23:20.315076 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:23:20.315159 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:23:20.315346 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:23:20.315430 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:23:20.315615 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:23:20.315697 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:23:20.315887 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:23:20.315968 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:23:20.316155 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:23:20.316244 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:23:20.316446 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:23:20.316527 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:23:20.316724 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:23:20.316862 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:23:20.317003 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:23:20.317085 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:23:20.317334 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:23:20.317414 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:23:20.317604 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:23:20.317687 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:23:20.317869 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:23:20.317950 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:23:20.318152 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:23:20.318438 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 09:23:20.356992 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55fe203249c0 pid: 80197 (default app) Jul 14 09:23:20.357622 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55fe203249c0 pid: 80198 (default app) Jul 14 09:23:20.360569 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9714d31-19af-4583-bcda-336039aca454 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:23:20.360847 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9714d31-19af-4583-bcda-336039aca454 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:23:20.361126 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9714d31-19af-4583-bcda-336039aca454 None None] PATH_INFO: `/v3` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:23:20.365346 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1/1] 10.222.0.40 () {50 vars in 791 bytes} [Thu Jul 14 09:23:20 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:23:28.183424 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e59aef1-f76d-49bb-846c-e3d408f62fe8 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:23:28.184034 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e59aef1-f76d-49bb-846c-e3d408f62fe8 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:23:28.184034 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e59aef1-f76d-49bb-846c-e3d408f62fe8 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:23:28.188324 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1/2] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:23:28 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 09:23:28.193710 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a810dbb6-ebe3-4e54-9df3-6c84f3f2789b None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:23:28.194138 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a810dbb6-ebe3-4e54-9df3-6c84f3f2789b None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:23:28.194307 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a810dbb6-ebe3-4e54-9df3-6c84f3f2789b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:23:28.263356 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: INFO dbcounter [None req-a810dbb6-ebe3-4e54-9df3-6c84f3f2789b None None] Registered counter for database keystone Jul 14 09:23:28.285310 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG oslo_db.sqlalchemy.engines [None req-a810dbb6-ebe3-4e54-9df3-6c84f3f2789b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80197) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 09:23:28.291665 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writer thread running {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 09:23:28.508300 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG passlib.handlers.bcrypt [None req-a810dbb6-ebe3-4e54-9df3-6c84f3f2789b None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80197) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 14 09:23:28.508874 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG passlib.handlers.bcrypt [None req-a810dbb6-ebe3-4e54-9df3-6c84f3f2789b None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80197) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 14 09:23:28.567495 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-a810dbb6-ebe3-4e54-9df3-6c84f3f2789b None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:23:28.569121 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-a810dbb6-ebe3-4e54-9df3-6c84f3f2789b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:23:28.695927 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 2/3] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:23:28 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 503 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 14 09:23:28.925546 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e59aef1-f76d-49bb-846c-e3d408f62fe8 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:23:28.996506 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: INFO dbcounter [None req-5e59aef1-f76d-49bb-846c-e3d408f62fe8 None None] Registered counter for database keystone Jul 14 09:23:29.016904 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG oslo_db.sqlalchemy.engines [None req-5e59aef1-f76d-49bb-846c-e3d408f62fe8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80198) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 09:23:29.024015 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writer thread running {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 09:23:29.142096 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e59aef1-f76d-49bb-846c-e3d408f62fe8 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:23:29.146375 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d6ee2e-6656-4176-9dd7-3e56698c14e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:23:29.147038 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d6ee2e-6656-4176-9dd7-3e56698c14e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:23:29.147323 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d6ee2e-6656-4176-9dd7-3e56698c14e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:23:29.147598 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d6ee2e-6656-4176-9dd7-3e56698c14e8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:23:29.156097 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d6ee2e-6656-4176-9dd7-3e56698c14e8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:23:29.208948 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: WARNING keystone.common.rbac_enforcer.enforcer [None req-43d6ee2e-6656-4176-9dd7-3e56698c14e8 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 14 09:23:29.209652 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d6ee2e-6656-4176-9dd7-3e56698c14e8 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:23:29.219760 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 2/4] 10.222.0.40 () {58 vars in 1324 bytes} [Thu Jul 14 09:23:28 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 09:23:29.225790 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a810dbb6-ebe3-4e54-9df3-6c84f3f2789b None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:23:29.241047 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a810dbb6-ebe3-4e54-9df3-6c84f3f2789b None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:23:29.246624 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebaef05-7267-4834-bf54-2fdc2be713bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:23:29.247781 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebaef05-7267-4834-bf54-2fdc2be713bc admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:23:29.248109 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebaef05-7267-4834-bf54-2fdc2be713bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:23:29.248354 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebaef05-7267-4834-bf54-2fdc2be713bc admin admin] PATH_INFO: `/v3/projects/fc045bacae334916a4c6d8daadbcb707` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:23:29.252565 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebaef05-7267-4834-bf54-2fdc2be713bc admin admin] RBAC: Authorizing `identity:get_project(project_id=fc045bacae334916a4c6d8daadbcb707)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:23:29.303501 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: WARNING keystone.common.rbac_enforcer.enforcer [None req-cebaef05-7267-4834-bf54-2fdc2be713bc admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 14 09:23:29.303851 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebaef05-7267-4834-bf54-2fdc2be713bc admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:23:29.309219 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 3/5] 10.222.0.40 () {56 vars in 1207 bytes} [Thu Jul 14 09:23:29 2022] GET /identity/v3/projects/fc045bacae334916a4c6d8daadbcb707 => generated 344 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:23:31.344615 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c27ea5f-cab3-49a5-bfbc-3882eaea22cc None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:23:31.345167 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c27ea5f-cab3-49a5-bfbc-3882eaea22cc None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:23:31.345167 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c27ea5f-cab3-49a5-bfbc-3882eaea22cc None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:23:31.349333 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 3/6] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:23:31 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:23:31.355562 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a6789e-df25-457a-84d0-5745ad36c76f None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:23:31.356077 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a6789e-df25-457a-84d0-5745ad36c76f None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:23:31.356172 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a6789e-df25-457a-84d0-5745ad36c76f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:23:31.375245 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-d8a6789e-df25-457a-84d0-5745ad36c76f None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:23:31.376782 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-d8a6789e-df25-457a-84d0-5745ad36c76f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:23:31.384883 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 4/7] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:23:31 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jul 14 09:23:31.407815 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c27ea5f-cab3-49a5-bfbc-3882eaea22cc None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:23:31.420707 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c27ea5f-cab3-49a5-bfbc-3882eaea22cc None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:23:31.424915 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19be9c04-188c-49cc-a667-35457be3254a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:23:31.425571 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19be9c04-188c-49cc-a667-35457be3254a admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:23:31.425859 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19be9c04-188c-49cc-a667-35457be3254a admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:23:31.426138 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19be9c04-188c-49cc-a667-35457be3254a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:23:31.435297 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19be9c04-188c-49cc-a667-35457be3254a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:23:31.437102 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19be9c04-188c-49cc-a667-35457be3254a admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:23:31.446504 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 4/8] 10.222.0.40 () {58 vars in 1324 bytes} [Thu Jul 14 09:23:31 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 09:23:31.452409 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a6789e-df25-457a-84d0-5745ad36c76f None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:23:31.461868 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a6789e-df25-457a-84d0-5745ad36c76f None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:23:31.466955 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99d1bd8-6cae-49a9-9b01-ba6633e19f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:23:31.467843 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99d1bd8-6cae-49a9-9b01-ba6633e19f79 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:23:31.468128 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99d1bd8-6cae-49a9-9b01-ba6633e19f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:23:31.468408 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99d1bd8-6cae-49a9-9b01-ba6633e19f79 admin admin] PATH_INFO: `/v3/users/d3cc085bb5914250a5e384092f9f12f8` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:23:31.469816 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99d1bd8-6cae-49a9-9b01-ba6633e19f79 admin admin] RBAC: Authorizing `identity:get_user(user_id=d3cc085bb5914250a5e384092f9f12f8)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:23:31.471692 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99d1bd8-6cae-49a9-9b01-ba6633e19f79 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:23:31.473303 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 5/9] 10.222.0.40 () {56 vars in 1198 bytes} [Thu Jul 14 09:23:31 2022] GET /identity/v3/users/d3cc085bb5914250a5e384092f9f12f8 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:23:33.602799 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000ff083-7750-4d98-95ef-8f56f4a44e7b None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:23:33.603331 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000ff083-7750-4d98-95ef-8f56f4a44e7b None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:23:33.603421 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000ff083-7750-4d98-95ef-8f56f4a44e7b None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:23:33.605355 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 5/10] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:23:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:23:33.610956 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdb34b9-efb7-4431-b4c5-222ca60e8bc9 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:23:33.611681 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdb34b9-efb7-4431-b4c5-222ca60e8bc9 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:23:33.611892 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdb34b9-efb7-4431-b4c5-222ca60e8bc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:23:33.629714 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da69363-4e70-4d9c-86bd-4766c7bc66a4 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:23:33.630003 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da69363-4e70-4d9c-86bd-4766c7bc66a4 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:23:33.630344 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da69363-4e70-4d9c-86bd-4766c7bc66a4 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:23:33.631926 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-cfdb34b9-efb7-4431-b4c5-222ca60e8bc9 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:23:33.632053 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 6/11] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:23:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 09:23:33.632625 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-cfdb34b9-efb7-4431-b4c5-222ca60e8bc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:23:33.638390 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c5bc25-2a07-4611-a1cd-feeb5100f755 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:23:33.638714 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c5bc25-2a07-4611-a1cd-feeb5100f755 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:23:33.639025 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c5bc25-2a07-4611-a1cd-feeb5100f755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:23:33.680011 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG passlib.handlers.bcrypt [None req-67c5bc25-2a07-4611-a1cd-feeb5100f755 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80198) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 14 09:23:33.680425 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG passlib.handlers.bcrypt [None req-67c5bc25-2a07-4611-a1cd-feeb5100f755 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80198) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 14 09:23:33.726037 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-67c5bc25-2a07-4611-a1cd-feeb5100f755 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:23:33.726772 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 6/12] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:23:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 09:23:33.727712 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-67c5bc25-2a07-4611-a1cd-feeb5100f755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:23:33.750382 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdb34b9-efb7-4431-b4c5-222ca60e8bc9 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:23:33.775279 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:23:33.840021 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 7/13] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:23:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 09:23:33.863086 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdb34b9-efb7-4431-b4c5-222ca60e8bc9 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:23:33.864807 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c5bc25-2a07-4611-a1cd-feeb5100f755 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:23:33.903882 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390ab8e8-bf9e-4d8f-aaec-0fca5e1d5f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:23:33.904494 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390ab8e8-bf9e-4d8f-aaec-0fca5e1d5f27 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:23:33.904773 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390ab8e8-bf9e-4d8f-aaec-0fca5e1d5f27 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:23:33.905051 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390ab8e8-bf9e-4d8f-aaec-0fca5e1d5f27 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:23:33.918803 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390ab8e8-bf9e-4d8f-aaec-0fca5e1d5f27 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:23:33.931812 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-390ab8e8-bf9e-4d8f-aaec-0fca5e1d5f27 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 09:23:33.931812 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:23:33.931812 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:23:33.931812 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:23:33.931812 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:23:33.931812 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:23:33.931812 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:23:33.931812 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:23:33.931812 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:23:33.931812 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:23:33.931812 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:23:33.931812 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:23:33.931812 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:23:33.931812 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:23:33.931812 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:23:33.931812 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:23:33.933654 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:23:33.933654 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:23:33.933654 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:23:33.933654 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:23:33.933654 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:23:33.933654 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:23:33.933654 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:23:33.933654 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:23:33.933654 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:23:33.933654 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:23:33.933654 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:23:33.933654 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( Jul 14 09:23:33.933654 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:23:33.933654 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:23:33.933654 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:23:33.933654 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:23:33.934717 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:23:33.934717 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:23:33.934717 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:23:33.934717 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:23:33.934717 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:23:33.934717 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:23:33.934717 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:23:33.934717 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:23:33.934717 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:23:33.934717 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:23:33.934717 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 09:23:33.934717 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:23:33.934717 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 7/14] 10.222.0.40 () {56 vars in 1096 bytes} [Thu Jul 14 09:23:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 09:23:33.938120 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390ab8e8-bf9e-4d8f-aaec-0fca5e1d5f27 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:23:33.984728 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c5bc25-2a07-4611-a1cd-feeb5100f755 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:23:33.987196 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:23:34.027529 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b05ef0-a00b-4e56-8140-cb4284355ccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:23:34.028448 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b05ef0-a00b-4e56-8140-cb4284355ccd None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:23:34.028731 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b05ef0-a00b-4e56-8140-cb4284355ccd None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:23:34.029011 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b05ef0-a00b-4e56-8140-cb4284355ccd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:23:34.034713 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:23:34.059198 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390ab8e8-bf9e-4d8f-aaec-0fca5e1d5f27 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:23:34.092622 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d298d06-5bf0-46b3-828b-d0d1cd427808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:23:34.093208 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d298d06-5bf0-46b3-828b-d0d1cd427808 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:23:34.093493 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d298d06-5bf0-46b3-828b-d0d1cd427808 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:23:34.093769 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d298d06-5bf0-46b3-828b-d0d1cd427808 None admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:23:34.094569 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d298d06-5bf0-46b3-828b-d0d1cd427808 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:23:34.094882 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d298d06-5bf0-46b3-828b-d0d1cd427808 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:23:34.096290 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d298d06-5bf0-46b3-828b-d0d1cd427808 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:23:34.101410 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b05ef0-a00b-4e56-8140-cb4284355ccd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:23:34.102977 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b05ef0-a00b-4e56-8140-cb4284355ccd None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:23:34.109866 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 8/15] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 14 09:23:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:23:34.115458 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d298d06-5bf0-46b3-828b-d0d1cd427808 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:23:34.211159 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 8/16] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 14 09:23:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 14 09:23:34.217275 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b05ef0-a00b-4e56-8140-cb4284355ccd None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:23:34.220366 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:23:34.223309 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d298d06-5bf0-46b3-828b-d0d1cd427808 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:23:34.262837 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c188b83-6dfa-4dcc-84e1-1868325b02f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:23:34.263715 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c188b83-6dfa-4dcc-84e1-1868325b02f3 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:23:34.268309 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c188b83-6dfa-4dcc-84e1-1868325b02f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:23:34.268309 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c188b83-6dfa-4dcc-84e1-1868325b02f3 None admin] PATH_INFO: `/v3/users/d3cc085bb5914250a5e384092f9f12f8` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:23:34.268309 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c188b83-6dfa-4dcc-84e1-1868325b02f3 None admin] RBAC: Authorizing `identity:get_user(user_id=d3cc085bb5914250a5e384092f9f12f8)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:23:34.268309 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c188b83-6dfa-4dcc-84e1-1868325b02f3 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:23:34.268657 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 9/17] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jul 14 09:23:34 2022] GET /identity/v3/users/d3cc085bb5914250a5e384092f9f12f8 => generated 247 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:23:34.277981 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c188b83-6dfa-4dcc-84e1-1868325b02f3 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:23:34.290579 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:23:34.327462 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b05ef0-a00b-4e56-8140-cb4284355ccd None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:23:34.366423 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d84d9be-335a-42c5-9abc-14197fd87be2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:23:34.367154 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d84d9be-335a-42c5-9abc-14197fd87be2 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:23:34.367437 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d84d9be-335a-42c5-9abc-14197fd87be2 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:23:34.367715 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d84d9be-335a-42c5-9abc-14197fd87be2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:23:34.384395 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c188b83-6dfa-4dcc-84e1-1868325b02f3 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:23:34.387067 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d84d9be-335a-42c5-9abc-14197fd87be2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:23:34.388561 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d84d9be-335a-42c5-9abc-14197fd87be2 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:23:34.411867 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-0d84d9be-335a-42c5-9abc-14197fd87be2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:23:34.411867 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:23:34.411867 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:23:34.411867 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:23:34.411867 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:23:34.411867 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:23:34.411867 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:23:34.411867 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:23:34.411867 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:23:34.411867 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:23:34.411867 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:23:34.411867 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:23:34.411867 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 09:23:34.411867 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 09:23:34.411867 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 09:23:34.412785 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 09:23:34.412785 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:23:34.412785 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:23:34.412785 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:23:34.412785 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:23:34.412785 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:23:34.412785 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:23:34.412785 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:23:34.412785 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( Jul 14 09:23:34.412785 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:23:34.412785 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:23:34.412785 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:23:34.412785 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:23:34.412785 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:23:34.412785 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:23:34.412785 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:23:34.412785 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:23:34.413802 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 09:23:34.413802 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 09:23:34.413802 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:23:34.413802 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Jul 14 09:23:34.413802 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 9/18] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 09:23:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 09:23:34.419857 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d84d9be-335a-42c5-9abc-14197fd87be2 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:23:34.424329 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a8a2ea-8ddd-4407-a25d-850afa8777ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:23:34.425154 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a8a2ea-8ddd-4407-a25d-850afa8777ef None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:23:34.425446 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a8a2ea-8ddd-4407-a25d-850afa8777ef None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:23:34.425728 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a8a2ea-8ddd-4407-a25d-850afa8777ef None admin] PATH_INFO: `/v3/domains/default` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:23:34.427003 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a8a2ea-8ddd-4407-a25d-850afa8777ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:23:34.428492 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a8a2ea-8ddd-4407-a25d-850afa8777ef None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:23:34.430143 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 10/19] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 09:23:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:23:34.435952 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a8a2ea-8ddd-4407-a25d-850afa8777ef None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:23:34.482508 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:23:34.528440 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:23:34.537860 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d84d9be-335a-42c5-9abc-14197fd87be2 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:23:34.550810 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a8a2ea-8ddd-4407-a25d-850afa8777ef None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:23:34.574761 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf3c18a-46bb-4431-bc0c-54c8133119b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:23:34.575434 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf3c18a-46bb-4431-bc0c-54c8133119b1 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:23:34.575721 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf3c18a-46bb-4431-bc0c-54c8133119b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:23:34.575996 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf3c18a-46bb-4431-bc0c-54c8133119b1 None admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:23:34.576735 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf3c18a-46bb-4431-bc0c-54c8133119b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:23:34.577040 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf3c18a-46bb-4431-bc0c-54c8133119b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:23:34.578463 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf3c18a-46bb-4431-bc0c-54c8133119b1 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:23:34.590540 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6a8a16-4001-4280-b944-ed2067362ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:23:34.591216 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6a8a16-4001-4280-b944-ed2067362ee5 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:23:34.591501 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6a8a16-4001-4280-b944-ed2067362ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:23:34.591777 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6a8a16-4001-4280-b944-ed2067362ee5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:23:34.592660 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6a8a16-4001-4280-b944-ed2067362ee5 None admin] RBAC: Adding query filter params (role.id=e3965bd0d5f1427a86a313c0c90bfef3, scope.domain.id=default, user.id=d3cc085bb5914250a5e384092f9f12f8) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:23:34.593065 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6a8a16-4001-4280-b944-ed2067362ee5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:23:34.594493 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6a8a16-4001-4280-b944-ed2067362ee5 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:23:34.600553 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 10/20] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 14 09:23:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:23:34.601857 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 11/21] 10.222.0.40 () {56 vars in 1322 bytes} [Thu Jul 14 09:23:34 2022] GET /identity/v3/role_assignments?user.id=d3cc085bb5914250a5e384092f9f12f8&scope.domain.id=default&role.id=e3965bd0d5f1427a86a313c0c90bfef3 => generated 233 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:23:36.784051 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89eab82-90b4-460f-8b67-3bbb7d9febfc None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:23:36.784553 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89eab82-90b4-460f-8b67-3bbb7d9febfc None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:23:36.785071 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89eab82-90b4-460f-8b67-3bbb7d9febfc None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:23:36.788013 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 11/22] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:23:36 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:23:36.793571 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b7b506-2240-4cf2-9e3e-a81236b1ad2d None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:23:36.794485 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b7b506-2240-4cf2-9e3e-a81236b1ad2d None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:23:36.794975 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b7b506-2240-4cf2-9e3e-a81236b1ad2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:23:36.819632 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-b3b7b506-2240-4cf2-9e3e-a81236b1ad2d None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:23:36.821165 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-b3b7b506-2240-4cf2-9e3e-a81236b1ad2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:23:36.923337 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 12/23] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:23:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 09:23:36.959598 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89eab82-90b4-460f-8b67-3bbb7d9febfc None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:23:37.101979 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89eab82-90b4-460f-8b67-3bbb7d9febfc None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:23:37.126844 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:23:37.152893 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616518ee-b4d7-4a19-98ce-4d065117b5a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:23:37.153730 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616518ee-b4d7-4a19-98ce-4d065117b5a6 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:23:37.154024 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616518ee-b4d7-4a19-98ce-4d065117b5a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:23:37.154340 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616518ee-b4d7-4a19-98ce-4d065117b5a6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:23:37.170769 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616518ee-b4d7-4a19-98ce-4d065117b5a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:23:37.184021 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-616518ee-b4d7-4a19-98ce-4d065117b5a6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 09:23:37.184021 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:23:37.184021 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:23:37.184021 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:23:37.184021 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:23:37.184021 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:23:37.184021 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:23:37.184021 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:23:37.184021 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:23:37.184021 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:23:37.184021 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:23:37.184021 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:23:37.184021 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:23:37.184021 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:23:37.184021 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:23:37.184021 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:23:37.184888 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:23:37.184888 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:23:37.184888 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:23:37.184888 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:23:37.184888 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:23:37.184888 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:23:37.184888 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:23:37.184888 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:23:37.184888 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:23:37.184888 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:23:37.184888 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:23:37.184888 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( Jul 14 09:23:37.184888 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:23:37.184888 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:23:37.184888 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:23:37.184888 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:23:37.185638 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:23:37.185638 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:23:37.185638 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:23:37.185638 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:23:37.185638 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:23:37.185638 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:23:37.185638 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:23:37.185638 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:23:37.185638 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:23:37.185638 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:23:37.185638 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 09:23:37.185638 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Jul 14 09:23:37.186212 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 12/24] 10.222.0.40 () {56 vars in 1096 bytes} [Thu Jul 14 09:23:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:23:37.192858 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b7b506-2240-4cf2-9e3e-a81236b1ad2d None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:23:37.302976 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:23:37.334914 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b7b506-2240-4cf2-9e3e-a81236b1ad2d None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:23:37.381456 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e400bf7-0957-4c5b-b917-a901641f6599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:23:37.382058 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e400bf7-0957-4c5b-b917-a901641f6599 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:23:37.382374 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e400bf7-0957-4c5b-b917-a901641f6599 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:23:37.382660 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e400bf7-0957-4c5b-b917-a901641f6599 None admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:23:37.383428 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e400bf7-0957-4c5b-b917-a901641f6599 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:23:37.383742 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e400bf7-0957-4c5b-b917-a901641f6599 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:23:37.385149 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e400bf7-0957-4c5b-b917-a901641f6599 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:23:37.397715 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 13/25] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 14 09:23:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:23:37.403774 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616518ee-b4d7-4a19-98ce-4d065117b5a6 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:23:37.573187 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616518ee-b4d7-4a19-98ce-4d065117b5a6 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:23:37.630079 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e89534-9ce5-46a1-aae2-4e1ee636e2ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:23:37.631019 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e89534-9ce5-46a1-aae2-4e1ee636e2ad None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:23:37.631312 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e89534-9ce5-46a1-aae2-4e1ee636e2ad None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:23:37.631651 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e89534-9ce5-46a1-aae2-4e1ee636e2ad None admin] PATH_INFO: `/v3/users/d3cc085bb5914250a5e384092f9f12f8` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:23:37.633207 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e89534-9ce5-46a1-aae2-4e1ee636e2ad None admin] RBAC: Authorizing `identity:get_user(user_id=d3cc085bb5914250a5e384092f9f12f8)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:23:37.634734 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e89534-9ce5-46a1-aae2-4e1ee636e2ad None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:23:37.637460 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 13/26] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jul 14 09:23:37 2022] GET /identity/v3/users/d3cc085bb5914250a5e384092f9f12f8 => generated 247 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:23:37.644902 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e400bf7-0957-4c5b-b917-a901641f6599 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:23:37.692177 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a08456a-4bc8-481e-8ad7-31589e8478a2 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:23:37.692480 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a08456a-4bc8-481e-8ad7-31589e8478a2 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:23:37.692753 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a08456a-4bc8-481e-8ad7-31589e8478a2 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:23:37.694133 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 14/27] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:23:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 09:23:37.701288 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baef69f5-639c-474b-8319-8ba114d6d288 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:23:37.701575 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baef69f5-639c-474b-8319-8ba114d6d288 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:23:37.701859 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baef69f5-639c-474b-8319-8ba114d6d288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:23:37.727374 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-baef69f5-639c-474b-8319-8ba114d6d288 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:23:37.728612 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-baef69f5-639c-474b-8319-8ba114d6d288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:23:37.796209 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:23:37.863032 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 15/28] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:23:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 09:23:37.864434 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f76a1b-2601-49ef-b91d-8edd7430ffc7 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:23:37.864731 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f76a1b-2601-49ef-b91d-8edd7430ffc7 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:23:37.865012 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f76a1b-2601-49ef-b91d-8edd7430ffc7 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:23:37.866534 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 16/29] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:23:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:23:37.880831 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a139c3d-0584-4f56-8792-0fc1c516a8d0 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:23:37.881309 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a139c3d-0584-4f56-8792-0fc1c516a8d0 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:23:37.881833 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a139c3d-0584-4f56-8792-0fc1c516a8d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:23:37.889646 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e400bf7-0957-4c5b-b917-a901641f6599 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:23:37.927598 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-1a139c3d-0584-4f56-8792-0fc1c516a8d0 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:23:37.928817 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-1a139c3d-0584-4f56-8792-0fc1c516a8d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:23:37.940408 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010efac7-a5f6-4865-b2ef-6b6599a82e2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:23:37.941222 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010efac7-a5f6-4865-b2ef-6b6599a82e2e None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:23:37.941508 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010efac7-a5f6-4865-b2ef-6b6599a82e2e None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:23:37.941783 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010efac7-a5f6-4865-b2ef-6b6599a82e2e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:23:37.943147 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010efac7-a5f6-4865-b2ef-6b6599a82e2e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:23:37.944782 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010efac7-a5f6-4865-b2ef-6b6599a82e2e None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:23:37.946962 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 14/30] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 09:23:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:23:37.947767 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010efac7-a5f6-4865-b2ef-6b6599a82e2e None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:23:37.959972 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:23:38.061163 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 17/31] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:23:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 09:23:38.062622 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a139c3d-0584-4f56-8792-0fc1c516a8d0 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:23:38.135844 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010efac7-a5f6-4865-b2ef-6b6599a82e2e None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:23:38.180802 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35844e10-276e-4e02-a171-a3443a566602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:23:38.181624 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35844e10-276e-4e02-a171-a3443a566602 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:23:38.181911 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35844e10-276e-4e02-a171-a3443a566602 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:23:38.182209 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35844e10-276e-4e02-a171-a3443a566602 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:23:38.193982 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35844e10-276e-4e02-a171-a3443a566602 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:23:38.195630 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35844e10-276e-4e02-a171-a3443a566602 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:23:38.216951 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a139c3d-0584-4f56-8792-0fc1c516a8d0 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:23:38.220335 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:23:38.222986 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-35844e10-276e-4e02-a171-a3443a566602 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:23:38.222986 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:23:38.222986 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:23:38.222986 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:23:38.222986 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:23:38.222986 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:23:38.222986 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:23:38.222986 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:23:38.222986 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:23:38.222986 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:23:38.222986 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:23:38.222986 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:23:38.222986 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 09:23:38.222986 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 09:23:38.222986 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 09:23:38.223819 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 09:23:38.223819 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:23:38.223819 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:23:38.223819 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:23:38.223819 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:23:38.223819 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:23:38.223819 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:23:38.223819 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:23:38.223819 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( Jul 14 09:23:38.223819 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:23:38.223819 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:23:38.223819 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:23:38.223819 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:23:38.223819 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:23:38.223819 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:23:38.223819 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:23:38.223819 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:23:38.224627 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 09:23:38.224627 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 09:23:38.224627 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:23:38.224627 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:23:38.227321 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 15/32] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 09:23:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:23:38.228335 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35844e10-276e-4e02-a171-a3443a566602 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:23:38.267340 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68fa9ae-8da8-47c0-a87d-dc27a016111e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:23:38.267340 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68fa9ae-8da8-47c0-a87d-dc27a016111e None admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:23:38.267340 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68fa9ae-8da8-47c0-a87d-dc27a016111e None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:23:38.267340 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68fa9ae-8da8-47c0-a87d-dc27a016111e None admin] PATH_INFO: `/v3/domains/default/users/d3cc085bb5914250a5e384092f9f12f8/roles/e3965bd0d5f1427a86a313c0c90bfef3` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:23:38.269553 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68fa9ae-8da8-47c0-a87d-dc27a016111e None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=d3cc085bb5914250a5e384092f9f12f8, role_id=e3965bd0d5f1427a86a313c0c90bfef3)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:23:38.269553 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68fa9ae-8da8-47c0-a87d-dc27a016111e None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:23:38.336454 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:23:38.399943 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35844e10-276e-4e02-a171-a3443a566602 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:23:38.437435 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 18/33] 10.222.0.40 () {58 vars in 1361 bytes} [Thu Jul 14 09:23:38 2022] PUT /identity/v3/domains/default/users/d3cc085bb5914250a5e384092f9f12f8/roles/e3965bd0d5f1427a86a313c0c90bfef3 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:23:38.439818 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46d3c3c-672e-4dc5-95f9-4e2f5df1479a None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:23:38.440351 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46d3c3c-672e-4dc5-95f9-4e2f5df1479a None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:23:38.440847 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46d3c3c-672e-4dc5-95f9-4e2f5df1479a None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:23:38.446468 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 19/34] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:23:38 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:23:38.447703 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46d3c3c-672e-4dc5-95f9-4e2f5df1479a None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:23:38.457732 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcc940d-a023-4c79-9d79-f56a1817f23f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:23:38.458882 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcc940d-a023-4c79-9d79-f56a1817f23f None admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:23:38.459713 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcc940d-a023-4c79-9d79-f56a1817f23f None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:23:38.459713 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcc940d-a023-4c79-9d79-f56a1817f23f None admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:23:38.460264 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcc940d-a023-4c79-9d79-f56a1817f23f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:23:38.461687 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcc940d-a023-4c79-9d79-f56a1817f23f None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:23:38.603415 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46d3c3c-672e-4dc5-95f9-4e2f5df1479a None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:23:38.645967 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d51f54-cd0a-4f78-b745-dc889f8fe53f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:23:38.647309 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d51f54-cd0a-4f78-b745-dc889f8fe53f None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:23:38.647728 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d51f54-cd0a-4f78-b745-dc889f8fe53f None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:23:38.648132 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d51f54-cd0a-4f78-b745-dc889f8fe53f None admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:23:38.649251 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d51f54-cd0a-4f78-b745-dc889f8fe53f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:23:38.649710 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d51f54-cd0a-4f78-b745-dc889f8fe53f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:23:38.652708 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d51f54-cd0a-4f78-b745-dc889f8fe53f None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:23:38.672113 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 20/35] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 14 09:23:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:23:38.674410 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9890879f-3333-45a8-bf21-93c97fe50c4d None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:23:38.674926 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9890879f-3333-45a8-bf21-93c97fe50c4d None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:23:38.675413 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9890879f-3333-45a8-bf21-93c97fe50c4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:23:38.699553 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-9890879f-3333-45a8-bf21-93c97fe50c4d None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:23:38.699733 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 16/36] 10.222.0.40 () {60 vars in 1131 bytes} [Thu Jul 14 09:23:38 2022] POST /identity/v3/roles => generated 219 bytes in 471 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:23:38.700664 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcc940d-a023-4c79-9d79-f56a1817f23f None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:23:38.701980 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-9890879f-3333-45a8-bf21-93c97fe50c4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:23:38.727619 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:23:38.805346 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 21/37] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:23:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 09:23:38.848186 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9890879f-3333-45a8-bf21-93c97fe50c4d None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:23:38.849962 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcc940d-a023-4c79-9d79-f56a1817f23f None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:23:38.902849 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:23:38.912443 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c1c2c0-c936-44b5-b2ec-ce8ec182bfbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:23:38.913233 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c1c2c0-c936-44b5-b2ec-ce8ec182bfbd None admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:23:38.913595 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c1c2c0-c936-44b5-b2ec-ce8ec182bfbd None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:23:38.913886 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c1c2c0-c936-44b5-b2ec-ce8ec182bfbd None admin] PATH_INFO: `/v3/projects` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:23:38.914788 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c1c2c0-c936-44b5-b2ec-ce8ec182bfbd None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:23:38.916507 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c1c2c0-c936-44b5-b2ec-ce8ec182bfbd None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:23:38.981797 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 17/38] 10.222.0.40 () {60 vars in 1141 bytes} [Thu Jul 14 09:23:38 2022] POST /identity/v3/projects => generated 301 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:23:38.986009 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0685fed-e934-4883-8007-22d3018cf4b7 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:23:38.986341 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0685fed-e934-4883-8007-22d3018cf4b7 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:23:38.989562 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0685fed-e934-4883-8007-22d3018cf4b7 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:23:38.991447 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 18/39] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:23:38 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:23:38.998538 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67305fa-4f31-493f-b59a-50d3914045f9 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:23:38.999091 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67305fa-4f31-493f-b59a-50d3914045f9 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:23:38.999579 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67305fa-4f31-493f-b59a-50d3914045f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:23:39.040707 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-e67305fa-4f31-493f-b59a-50d3914045f9 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:23:39.042560 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-e67305fa-4f31-493f-b59a-50d3914045f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:23:39.070006 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9890879f-3333-45a8-bf21-93c97fe50c4d None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:23:39.119531 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e3b124-05d6-43cf-9d5e-88bdd9808c66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:23:39.120271 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e3b124-05d6-43cf-9d5e-88bdd9808c66 None admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:23:39.120564 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e3b124-05d6-43cf-9d5e-88bdd9808c66 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:23:39.120848 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e3b124-05d6-43cf-9d5e-88bdd9808c66 None admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:23:39.121624 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e3b124-05d6-43cf-9d5e-88bdd9808c66 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:23:39.123103 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e3b124-05d6-43cf-9d5e-88bdd9808c66 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:23:39.154298 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 19/40] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:23:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 09:23:39.157043 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 22/41] 10.222.0.40 () {60 vars in 1131 bytes} [Thu Jul 14 09:23:38 2022] POST /identity/v3/roles => generated 225 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:23:39.163847 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab19e08-ac07-49b9-b952-519efa64940c None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:23:39.164159 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab19e08-ac07-49b9-b952-519efa64940c None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:23:39.164423 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab19e08-ac07-49b9-b952-519efa64940c None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:23:39.166244 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 20/42] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:23:39 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:23:39.172082 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3ad3e2-64ec-4fcb-8e2d-667afcab1a5f None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:23:39.172387 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3ad3e2-64ec-4fcb-8e2d-667afcab1a5f None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:23:39.172663 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3ad3e2-64ec-4fcb-8e2d-667afcab1a5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:23:39.194131 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab19e08-ac07-49b9-b952-519efa64940c None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:23:39.197472 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-9f3ad3e2-64ec-4fcb-8e2d-667afcab1a5f None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:23:39.199754 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-9f3ad3e2-64ec-4fcb-8e2d-667afcab1a5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:23:39.216565 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:23:39.320223 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 23/43] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:23:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 09:23:39.348594 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3ad3e2-64ec-4fcb-8e2d-667afcab1a5f None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:23:39.371360 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:23:39.379974 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab19e08-ac07-49b9-b952-519efa64940c None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:23:39.445365 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca278c7-e56c-40b7-a8a9-e062f7495d2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:23:39.445365 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca278c7-e56c-40b7-a8a9-e062f7495d2c None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:23:39.445365 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca278c7-e56c-40b7-a8a9-e062f7495d2c None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:23:39.445365 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca278c7-e56c-40b7-a8a9-e062f7495d2c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:23:39.446031 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca278c7-e56c-40b7-a8a9-e062f7495d2c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:23:39.447629 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca278c7-e56c-40b7-a8a9-e062f7495d2c None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:23:39.450119 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 21/44] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 09:23:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:23:39.456974 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca278c7-e56c-40b7-a8a9-e062f7495d2c None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:23:39.505483 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3ad3e2-64ec-4fcb-8e2d-667afcab1a5f None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:23:39.558918 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f818a7-e833-4c44-b13d-0730398827d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:23:39.559626 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f818a7-e833-4c44-b13d-0730398827d5 None admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:23:39.559912 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f818a7-e833-4c44-b13d-0730398827d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:23:39.560192 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f818a7-e833-4c44-b13d-0730398827d5 None admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:23:39.560970 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f818a7-e833-4c44-b13d-0730398827d5 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:23:39.562499 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f818a7-e833-4c44-b13d-0730398827d5 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:23:39.590234 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 24/45] 10.222.0.40 () {60 vars in 1131 bytes} [Thu Jul 14 09:23:39 2022] POST /identity/v3/roles => generated 223 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:23:39.701435 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca278c7-e56c-40b7-a8a9-e062f7495d2c None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:23:39.746354 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13270c2-47cc-4162-94bb-6f27b1ade9e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:23:39.747038 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13270c2-47cc-4162-94bb-6f27b1ade9e2 None admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:23:39.747326 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13270c2-47cc-4162-94bb-6f27b1ade9e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:23:39.747609 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13270c2-47cc-4162-94bb-6f27b1ade9e2 None admin] PATH_INFO: `/v3/projects` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:23:39.748342 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13270c2-47cc-4162-94bb-6f27b1ade9e2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:23:39.749795 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13270c2-47cc-4162-94bb-6f27b1ade9e2 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:23:39.778402 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 22/46] 10.222.0.40 () {60 vars in 1141 bytes} [Thu Jul 14 09:23:39 2022] POST /identity/v3/projects => generated 312 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 09:23:40.798305 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df159f72-da0f-42fd-8f2f-9b85f7621ab0 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:23:40.798814 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df159f72-da0f-42fd-8f2f-9b85f7621ab0 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:23:40.798895 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df159f72-da0f-42fd-8f2f-9b85f7621ab0 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:23:40.800225 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 25/47] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:23:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:23:40.806020 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b4b147-39a6-4ca6-becc-ce26d52743a6 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:23:40.806598 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b4b147-39a6-4ca6-becc-ce26d52743a6 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:23:40.806735 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b4b147-39a6-4ca6-becc-ce26d52743a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:23:40.824215 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-c7b4b147-39a6-4ca6-becc-ce26d52743a6 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:23:40.825357 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-c7b4b147-39a6-4ca6-becc-ce26d52743a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:23:40.842781 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:23:40.915648 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 23/48] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:23:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 09:23:40.939191 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df159f72-da0f-42fd-8f2f-9b85f7621ab0 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:23:40.943231 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:23:41.049341 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df159f72-da0f-42fd-8f2f-9b85f7621ab0 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:23:41.090495 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c548c1-30a9-41ff-b7dc-852e65bb0aa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:23:41.091231 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c548c1-30a9-41ff-b7dc-852e65bb0aa0 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:23:41.091521 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c548c1-30a9-41ff-b7dc-852e65bb0aa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:23:41.091803 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c548c1-30a9-41ff-b7dc-852e65bb0aa0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:23:41.107167 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c548c1-30a9-41ff-b7dc-852e65bb0aa0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:23:41.115146 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-51c548c1-30a9-41ff-b7dc-852e65bb0aa0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 09:23:41.115146 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:23:41.115146 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:23:41.115146 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:23:41.115146 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:23:41.115146 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:23:41.115146 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:23:41.115146 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:23:41.115146 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:23:41.115146 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:23:41.115146 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:23:41.115146 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:23:41.115146 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:23:41.115146 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:23:41.115146 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:23:41.115146 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:23:41.116169 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:23:41.116169 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:23:41.116169 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:23:41.116169 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:23:41.116169 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:23:41.116169 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:23:41.116169 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:23:41.116169 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:23:41.116169 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:23:41.116169 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:23:41.116169 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:23:41.116169 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( Jul 14 09:23:41.116169 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:23:41.116169 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:23:41.116169 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:23:41.116169 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:23:41.117106 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:23:41.117106 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:23:41.117106 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:23:41.117106 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:23:41.117106 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:23:41.117106 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:23:41.117106 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:23:41.117106 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:23:41.117106 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:23:41.117106 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:23:41.117106 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 09:23:41.117106 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Jul 14 09:23:41.117106 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 26/49] 10.222.0.40 () {56 vars in 1096 bytes} [Thu Jul 14 09:23:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 09:23:41.124629 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b4b147-39a6-4ca6-becc-ce26d52743a6 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:23:41.229825 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b4b147-39a6-4ca6-becc-ce26d52743a6 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:23:41.264737 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e2fea2-b352-4c4c-bba9-7be32ae075f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:23:41.265408 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e2fea2-b352-4c4c-bba9-7be32ae075f9 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:23:41.265690 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e2fea2-b352-4c4c-bba9-7be32ae075f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:23:41.265972 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e2fea2-b352-4c4c-bba9-7be32ae075f9 None admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:23:41.266773 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e2fea2-b352-4c4c-bba9-7be32ae075f9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:23:41.267076 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e2fea2-b352-4c4c-bba9-7be32ae075f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:23:41.268558 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e2fea2-b352-4c4c-bba9-7be32ae075f9 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:23:41.277441 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 24/50] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 14 09:23:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:23:41.283016 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c548c1-30a9-41ff-b7dc-852e65bb0aa0 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:23:41.454846 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:23:41.496068 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c548c1-30a9-41ff-b7dc-852e65bb0aa0 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:23:41.531524 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9516305b-51c0-4669-b718-b9681f11dee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:23:41.532424 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9516305b-51c0-4669-b718-b9681f11dee7 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:23:41.532709 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9516305b-51c0-4669-b718-b9681f11dee7 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:23:41.532988 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9516305b-51c0-4669-b718-b9681f11dee7 None admin] PATH_INFO: `/v3/users/d3cc085bb5914250a5e384092f9f12f8` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:23:41.534268 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9516305b-51c0-4669-b718-b9681f11dee7 None admin] RBAC: Authorizing `identity:get_user(user_id=d3cc085bb5914250a5e384092f9f12f8)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:23:41.535755 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9516305b-51c0-4669-b718-b9681f11dee7 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:23:41.537397 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 27/51] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jul 14 09:23:41 2022] GET /identity/v3/users/d3cc085bb5914250a5e384092f9f12f8 => generated 247 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:23:41.543706 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e2fea2-b352-4c4c-bba9-7be32ae075f9 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:23:41.558104 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:23:41.651908 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e2fea2-b352-4c4c-bba9-7be32ae075f9 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:23:41.695535 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6778fb87-93a5-4a42-b0fc-1137fb6b8e15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:23:41.696341 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6778fb87-93a5-4a42-b0fc-1137fb6b8e15 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:23:41.696634 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6778fb87-93a5-4a42-b0fc-1137fb6b8e15 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:23:41.696918 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6778fb87-93a5-4a42-b0fc-1137fb6b8e15 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:23:41.698212 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6778fb87-93a5-4a42-b0fc-1137fb6b8e15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:23:41.699779 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6778fb87-93a5-4a42-b0fc-1137fb6b8e15 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:23:41.701485 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 25/52] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 09:23:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:23:41.707414 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9516305b-51c0-4669-b718-b9681f11dee7 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:23:41.812033 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9516305b-51c0-4669-b718-b9681f11dee7 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:23:41.843228 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:23:41.852445 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a06ab6-d4e1-43b5-a732-c7b4cebcfe13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:23:41.853126 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a06ab6-d4e1-43b5-a732-c7b4cebcfe13 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:23:41.853413 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a06ab6-d4e1-43b5-a732-c7b4cebcfe13 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:23:41.853694 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a06ab6-d4e1-43b5-a732-c7b4cebcfe13 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:23:41.855148 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a06ab6-d4e1-43b5-a732-c7b4cebcfe13 None admin] RBAC: Adding query filter params (role.id=e3965bd0d5f1427a86a313c0c90bfef3, scope.domain.id=default, user.id=d3cc085bb5914250a5e384092f9f12f8) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:23:41.855468 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a06ab6-d4e1-43b5-a732-c7b4cebcfe13 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:23:41.856958 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a06ab6-d4e1-43b5-a732-c7b4cebcfe13 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:23:41.860592 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba506dd-4071-4404-b137-692b04195756 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:23:41.861047 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba506dd-4071-4404-b137-692b04195756 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:23:41.861293 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba506dd-4071-4404-b137-692b04195756 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:23:41.862809 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 26/53] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:23:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 09:23:41.865894 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 28/54] 10.222.0.40 () {56 vars in 1322 bytes} [Thu Jul 14 09:23:41 2022] GET /identity/v3/role_assignments?user.id=d3cc085bb5914250a5e384092f9f12f8&scope.domain.id=default&role.id=e3965bd0d5f1427a86a313c0c90bfef3 => generated 530 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:23:41.876188 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6521755f-7c63-4b4f-8be8-fe3609669551 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:23:41.876477 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6521755f-7c63-4b4f-8be8-fe3609669551 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:23:41.876768 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6521755f-7c63-4b4f-8be8-fe3609669551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:23:41.895033 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-6521755f-7c63-4b4f-8be8-fe3609669551 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:23:41.896263 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-6521755f-7c63-4b4f-8be8-fe3609669551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:23:41.974166 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 27/55] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:23:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 09:23:41.998377 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a06ab6-d4e1-43b5-a732-c7b4cebcfe13 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:23:42.110856 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a06ab6-d4e1-43b5-a732-c7b4cebcfe13 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:23:42.146992 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487eb921-1125-4fb6-ab61-6c1ecc781566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:23:42.147801 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487eb921-1125-4fb6-ab61-6c1ecc781566 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:23:42.148091 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487eb921-1125-4fb6-ab61-6c1ecc781566 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:23:42.148371 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487eb921-1125-4fb6-ab61-6c1ecc781566 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:23:42.149559 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487eb921-1125-4fb6-ab61-6c1ecc781566 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:23:42.151705 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487eb921-1125-4fb6-ab61-6c1ecc781566 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:23:42.153344 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 29/56] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 09:23:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:23:42.159591 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6521755f-7c63-4b4f-8be8-fe3609669551 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:23:42.170808 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:23:42.269804 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6521755f-7c63-4b4f-8be8-fe3609669551 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:23:42.304869 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cb3da1-d6f9-471e-a9b0-312ccc9ecec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:23:42.305544 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cb3da1-d6f9-471e-a9b0-312ccc9ecec5 None admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:23:42.305835 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cb3da1-d6f9-471e-a9b0-312ccc9ecec5 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:23:42.306115 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cb3da1-d6f9-471e-a9b0-312ccc9ecec5 None admin] PATH_INFO: `/v3/projects` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:23:42.306869 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cb3da1-d6f9-471e-a9b0-312ccc9ecec5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:23:42.308388 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cb3da1-d6f9-471e-a9b0-312ccc9ecec5 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:23:42.333655 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 28/57] 10.222.0.40 () {60 vars in 1140 bytes} [Thu Jul 14 09:23:42 2022] POST /identity/v3/projects => generated 298 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:23:44.420188 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d87bb03-91f7-47c0-8625-b51a5d7cc22e None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:23:44.420777 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d87bb03-91f7-47c0-8625-b51a5d7cc22e None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:23:44.420777 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d87bb03-91f7-47c0-8625-b51a5d7cc22e None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:23:44.422136 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 30/58] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:23:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:23:44.429175 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf8bbc9-4bdd-4aab-ad44-54c008ebc37d None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:23:44.429626 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf8bbc9-4bdd-4aab-ad44-54c008ebc37d None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:23:44.429745 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf8bbc9-4bdd-4aab-ad44-54c008ebc37d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:23:44.447162 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-ddf8bbc9-4bdd-4aab-ad44-54c008ebc37d None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:23:44.448435 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-ddf8bbc9-4bdd-4aab-ad44-54c008ebc37d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:23:44.505472 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:23:44.524084 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 29/59] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:23:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 09:23:44.550624 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d87bb03-91f7-47c0-8625-b51a5d7cc22e None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:23:44.618152 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:23:44.658450 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d87bb03-91f7-47c0-8625-b51a5d7cc22e None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:23:44.693056 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a72f331-ce1b-4e82-8f66-a5b121f6514d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:23:44.693868 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a72f331-ce1b-4e82-8f66-a5b121f6514d None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:23:44.694160 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a72f331-ce1b-4e82-8f66-a5b121f6514d None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:23:44.694473 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a72f331-ce1b-4e82-8f66-a5b121f6514d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:23:44.695668 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a72f331-ce1b-4e82-8f66-a5b121f6514d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:23:44.697148 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a72f331-ce1b-4e82-8f66-a5b121f6514d None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:23:44.698815 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 31/60] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 09:23:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:23:44.704325 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf8bbc9-4bdd-4aab-ad44-54c008ebc37d None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:23:44.807154 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf8bbc9-4bdd-4aab-ad44-54c008ebc37d None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:23:44.842020 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31b9989-e6aa-495a-a2bd-c1d2c96d5016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:23:44.842875 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31b9989-e6aa-495a-a2bd-c1d2c96d5016 None admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:23:44.843169 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31b9989-e6aa-495a-a2bd-c1d2c96d5016 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:23:44.843455 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31b9989-e6aa-495a-a2bd-c1d2c96d5016 None admin] PATH_INFO: `/v3/users` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:23:44.844214 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31b9989-e6aa-495a-a2bd-c1d2c96d5016 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:23:44.845701 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31b9989-e6aa-495a-a2bd-c1d2c96d5016 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:23:44.872235 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 30/61] 10.222.0.40 () {60 vars in 1132 bytes} [Thu Jul 14 09:23:44 2022] POST /identity/v3/users => generated 275 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:23:48.045291 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525c3754-2759-4b88-8d51-f98ca2d4ee14 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:23:48.046926 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525c3754-2759-4b88-8d51-f98ca2d4ee14 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:23:48.047731 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525c3754-2759-4b88-8d51-f98ca2d4ee14 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:23:48.050655 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 32/62] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:23:48 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:23:48.056140 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d58a315-8201-4308-a9ba-6b0224323695 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:23:48.057066 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d58a315-8201-4308-a9ba-6b0224323695 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:23:48.057575 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d58a315-8201-4308-a9ba-6b0224323695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:23:48.069551 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb58249-942a-4d56-a315-24f7886b0856 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:23:48.070218 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb58249-942a-4d56-a315-24f7886b0856 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:23:48.070762 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb58249-942a-4d56-a315-24f7886b0856 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:23:48.072346 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 33/63] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:23:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 09:23:48.078115 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-3d58a315-8201-4308-a9ba-6b0224323695 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:23:48.078497 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2032a544-2afc-4093-8567-1e8cf27ae690 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:23:48.078988 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2032a544-2afc-4093-8567-1e8cf27ae690 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:23:48.079381 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-3d58a315-8201-4308-a9ba-6b0224323695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:23:48.079586 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2032a544-2afc-4093-8567-1e8cf27ae690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:23:48.099448 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-2032a544-2afc-4093-8567-1e8cf27ae690 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:23:48.100915 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-2032a544-2afc-4093-8567-1e8cf27ae690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:23:48.182085 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:23:48.191694 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 34/64] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:23:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 09:23:48.215722 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2032a544-2afc-4093-8567-1e8cf27ae690 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:23:48.261476 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 31/65] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:23:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 09:23:48.303467 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d58a315-8201-4308-a9ba-6b0224323695 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:23:48.354105 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:23:48.427616 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2032a544-2afc-4093-8567-1e8cf27ae690 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:23:48.448448 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d58a315-8201-4308-a9ba-6b0224323695 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:23:48.487746 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44038c2-c8b8-4f05-a984-4da02458676e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:23:48.488999 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44038c2-c8b8-4f05-a984-4da02458676e None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:23:48.489929 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44038c2-c8b8-4f05-a984-4da02458676e None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:23:48.490737 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44038c2-c8b8-4f05-a984-4da02458676e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:23:48.497543 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568c8fe9-d85b-42a5-b08e-2bdbb7b4c6db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:23:48.498620 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568c8fe9-d85b-42a5-b08e-2bdbb7b4c6db None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:23:48.499054 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568c8fe9-d85b-42a5-b08e-2bdbb7b4c6db None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:23:48.501775 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568c8fe9-d85b-42a5-b08e-2bdbb7b4c6db None admin] PATH_INFO: `/v3/roles/member` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:23:48.514763 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44038c2-c8b8-4f05-a984-4da02458676e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:23:48.523060 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-f44038c2-c8b8-4f05-a984-4da02458676e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 09:23:48.523060 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:23:48.523060 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:23:48.523060 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:23:48.523060 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:23:48.523060 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:23:48.523060 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:23:48.523060 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:23:48.523060 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:23:48.523060 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:23:48.523060 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:23:48.523060 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:23:48.523060 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:23:48.523060 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:23:48.523060 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:23:48.523060 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:23:48.524153 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:23:48.524153 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:23:48.524153 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:23:48.524153 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:23:48.524153 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:23:48.524153 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:23:48.524153 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:23:48.524153 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:23:48.524153 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:23:48.524153 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:23:48.524153 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:23:48.524153 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( Jul 14 09:23:48.524153 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:23:48.524153 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:23:48.524153 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:23:48.524153 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:23:48.525025 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:23:48.525025 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:23:48.525025 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:23:48.525025 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:23:48.525025 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:23:48.525025 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:23:48.525025 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:23:48.525025 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:23:48.525025 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:23:48.525025 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:23:48.525025 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 09:23:48.525025 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:23:48.528579 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 32/66] 10.222.0.40 () {56 vars in 1096 bytes} [Thu Jul 14 09:23:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 09:23:48.535919 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44038c2-c8b8-4f05-a984-4da02458676e None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:23:48.549994 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568c8fe9-d85b-42a5-b08e-2bdbb7b4c6db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:23:48.564636 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-568c8fe9-d85b-42a5-b08e-2bdbb7b4c6db None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 09:23:48.564636 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:23:48.564636 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:23:48.564636 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:23:48.564636 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:23:48.564636 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:23:48.564636 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:23:48.564636 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:23:48.564636 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:23:48.564636 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:23:48.564636 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:23:48.564636 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:23:48.564636 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:23:48.564636 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:23:48.564636 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:23:48.564636 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:23:48.565503 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:23:48.565503 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:23:48.565503 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:23:48.565503 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:23:48.565503 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:23:48.565503 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:23:48.565503 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:23:48.565503 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:23:48.565503 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:23:48.565503 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:23:48.565503 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:23:48.565503 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( Jul 14 09:23:48.565503 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:23:48.565503 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:23:48.565503 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:23:48.565503 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:23:48.566290 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:23:48.566290 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:23:48.566290 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:23:48.566290 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:23:48.566290 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:23:48.566290 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:23:48.566290 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:23:48.566290 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:23:48.566290 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:23:48.566290 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:23:48.566290 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 09:23:48.566290 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Jul 14 09:23:48.568727 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 35/67] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 14 09:23:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 354 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 09:23:48.579393 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568c8fe9-d85b-42a5-b08e-2bdbb7b4c6db None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:23:48.600791 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:23:48.743643 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44038c2-c8b8-4f05-a984-4da02458676e None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:23:48.760126 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568c8fe9-d85b-42a5-b08e-2bdbb7b4c6db None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:23:48.784474 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f3c7ae-d7e4-4b56-9b81-c5d0024b0e56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:23:48.785431 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f3c7ae-d7e4-4b56-9b81-c5d0024b0e56 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:23:48.785861 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f3c7ae-d7e4-4b56-9b81-c5d0024b0e56 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:23:48.785970 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:23:48.786406 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f3c7ae-d7e4-4b56-9b81-c5d0024b0e56 None admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:23:48.787318 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f3c7ae-d7e4-4b56-9b81-c5d0024b0e56 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:23:48.787627 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f3c7ae-d7e4-4b56-9b81-c5d0024b0e56 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:23:48.789571 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f3c7ae-d7e4-4b56-9b81-c5d0024b0e56 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:23:48.800209 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 33/68] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 14 09:23:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:23:48.801549 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547b77c4-a481-42b4-bdbc-abe1ab460d6f None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:23:48.801849 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547b77c4-a481-42b4-bdbc-abe1ab460d6f None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:23:48.802133 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547b77c4-a481-42b4-bdbc-abe1ab460d6f None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:23:48.803401 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 34/69] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:23:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:23:48.804748 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c45189c-cf3f-4dee-8b81-cf1929b59cb0 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:23:48.805247 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c45189c-cf3f-4dee-8b81-cf1929b59cb0 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:23:48.805725 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c45189c-cf3f-4dee-8b81-cf1929b59cb0 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:23:48.808079 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 35/70] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:23:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:23:48.809412 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c45189c-cf3f-4dee-8b81-cf1929b59cb0 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:23:48.811077 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3166fae5-f553-475f-a6d1-2851aef4195c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:23:48.811893 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3166fae5-f553-475f-a6d1-2851aef4195c None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:23:48.812191 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3166fae5-f553-475f-a6d1-2851aef4195c None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:23:48.812476 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3166fae5-f553-475f-a6d1-2851aef4195c None admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:23:48.813388 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3166fae5-f553-475f-a6d1-2851aef4195c None admin] RBAC: Adding query filter params (name=member) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:23:48.813707 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3166fae5-f553-475f-a6d1-2851aef4195c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:23:48.815266 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3166fae5-f553-475f-a6d1-2851aef4195c None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:23:48.828816 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 36/71] 10.222.0.40 () {56 vars in 1101 bytes} [Thu Jul 14 09:23:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:23:48.830099 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151dd23b-0f82-4d78-a207-e26a18b9211b None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:23:48.830499 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151dd23b-0f82-4d78-a207-e26a18b9211b None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:23:48.830791 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151dd23b-0f82-4d78-a207-e26a18b9211b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:23:48.849374 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-151dd23b-0f82-4d78-a207-e26a18b9211b None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:23:48.850605 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-151dd23b-0f82-4d78-a207-e26a18b9211b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:23:48.928872 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:23:48.936737 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c45189c-cf3f-4dee-8b81-cf1929b59cb0 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:23:48.950213 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 37/72] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:23:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 09:23:48.950213 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5488c4-faac-49fb-b557-1baa40a3055f None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:23:48.950213 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5488c4-faac-49fb-b557-1baa40a3055f None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:23:48.950213 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5488c4-faac-49fb-b557-1baa40a3055f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:23:48.964348 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-4f5488c4-faac-49fb-b557-1baa40a3055f None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:23:48.965790 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-4f5488c4-faac-49fb-b557-1baa40a3055f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:23:48.995482 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae64ebb-a131-4fba-b664-c2b9438b3df9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:23:48.996395 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae64ebb-a131-4fba-b664-c2b9438b3df9 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:23:48.996689 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae64ebb-a131-4fba-b664-c2b9438b3df9 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:23:48.996975 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae64ebb-a131-4fba-b664-c2b9438b3df9 None admin] PATH_INFO: `/v3/users/d3cc085bb5914250a5e384092f9f12f8` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:23:48.998294 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae64ebb-a131-4fba-b664-c2b9438b3df9 None admin] RBAC: Authorizing `identity:get_user(user_id=d3cc085bb5914250a5e384092f9f12f8)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:23:48.999783 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae64ebb-a131-4fba-b664-c2b9438b3df9 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:23:49.001453 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 36/73] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jul 14 09:23:48 2022] GET /identity/v3/users/d3cc085bb5914250a5e384092f9f12f8 => generated 247 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:23:49.002257 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae64ebb-a131-4fba-b664-c2b9438b3df9 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:23:49.050353 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 38/74] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:23:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 09:23:49.051650 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5488c4-faac-49fb-b557-1baa40a3055f None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:23:49.101462 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:23:49.118155 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae64ebb-a131-4fba-b664-c2b9438b3df9 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:23:49.156835 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dde35d-4c57-4b56-a9c3-d63d922878d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:23:49.157727 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dde35d-4c57-4b56-a9c3-d63d922878d7 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:23:49.158018 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dde35d-4c57-4b56-a9c3-d63d922878d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:23:49.158337 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dde35d-4c57-4b56-a9c3-d63d922878d7 None admin] PATH_INFO: `/v3/users/9c6423457ccf46e1b9988735408785f3` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:23:49.159902 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5488c4-faac-49fb-b557-1baa40a3055f None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:23:49.179534 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dde35d-4c57-4b56-a9c3-d63d922878d7 None admin] RBAC: Authorizing `identity:get_user(user_id=9c6423457ccf46e1b9988735408785f3)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:23:49.181024 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dde35d-4c57-4b56-a9c3-d63d922878d7 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:23:49.182831 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 37/75] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jul 14 09:23:49 2022] GET /identity/v3/users/9c6423457ccf46e1b9988735408785f3 => generated 275 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:23:49.183613 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dde35d-4c57-4b56-a9c3-d63d922878d7 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:23:49.200084 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf89a7d-8b95-456d-8f58-6b388e322288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:23:49.200891 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf89a7d-8b95-456d-8f58-6b388e322288 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:23:49.201182 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf89a7d-8b95-456d-8f58-6b388e322288 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:23:49.201467 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf89a7d-8b95-456d-8f58-6b388e322288 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:23:49.202695 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf89a7d-8b95-456d-8f58-6b388e322288 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:23:49.204167 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf89a7d-8b95-456d-8f58-6b388e322288 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:23:49.205907 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 39/76] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 09:23:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:23:49.209490 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:23:49.211785 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990051f3-2452-490e-b925-a59ba8420116 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:23:49.212117 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990051f3-2452-490e-b925-a59ba8420116 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:23:49.212506 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990051f3-2452-490e-b925-a59ba8420116 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:23:49.214770 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 40/77] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:23:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:23:49.215295 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990051f3-2452-490e-b925-a59ba8420116 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:23:49.304179 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dde35d-4c57-4b56-a9c3-d63d922878d7 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:23:49.334474 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990051f3-2452-490e-b925-a59ba8420116 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:23:49.343510 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8488d33-d7f2-4c45-857f-a85b89a1b7e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:23:49.344174 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8488d33-d7f2-4c45-857f-a85b89a1b7e6 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:23:49.344467 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8488d33-d7f2-4c45-857f-a85b89a1b7e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:23:49.344749 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8488d33-d7f2-4c45-857f-a85b89a1b7e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:23:49.350435 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:23:49.373458 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36097df0-1109-433d-b2a0-6b17e0b29f1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:23:49.374364 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36097df0-1109-433d-b2a0-6b17e0b29f1e None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:23:49.374731 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36097df0-1109-433d-b2a0-6b17e0b29f1e None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:23:49.375089 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36097df0-1109-433d-b2a0-6b17e0b29f1e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:23:49.389872 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36097df0-1109-433d-b2a0-6b17e0b29f1e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:23:49.398996 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-36097df0-1109-433d-b2a0-6b17e0b29f1e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 09:23:49.398996 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:23:49.398996 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:23:49.398996 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:23:49.398996 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:23:49.398996 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:23:49.398996 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:23:49.398996 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:23:49.398996 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:23:49.398996 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:23:49.398996 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:23:49.398996 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:23:49.398996 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:23:49.398996 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:23:49.398996 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:23:49.398996 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:23:49.399917 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:23:49.399917 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:23:49.399917 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:23:49.399917 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:23:49.399917 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:23:49.399917 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:23:49.399917 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:23:49.399917 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:23:49.399917 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:23:49.399917 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:23:49.399917 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:23:49.399917 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( Jul 14 09:23:49.399917 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:23:49.399917 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:23:49.399917 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:23:49.399917 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:23:49.401204 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:23:49.401204 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:23:49.401204 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:23:49.401204 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:23:49.401204 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:23:49.401204 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:23:49.401204 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:23:49.401204 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:23:49.401204 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:23:49.401204 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:23:49.401204 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 09:23:49.401204 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Jul 14 09:23:49.401204 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 41/78] 10.222.0.40 () {56 vars in 1114 bytes} [Thu Jul 14 09:23:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:23:49.401860 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36097df0-1109-433d-b2a0-6b17e0b29f1e None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:23:49.439426 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8488d33-d7f2-4c45-857f-a85b89a1b7e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:23:49.440936 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8488d33-d7f2-4c45-857f-a85b89a1b7e6 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:23:49.474103 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:23:49.520191 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36097df0-1109-433d-b2a0-6b17e0b29f1e None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:23:49.573051 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 38/79] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 14 09:23:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 09:23:49.575327 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8488d33-d7f2-4c45-857f-a85b89a1b7e6 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:23:49.577021 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cae5eff-676e-4fa8-96fb-79d6aa13a992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:23:49.577854 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cae5eff-676e-4fa8-96fb-79d6aa13a992 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:23:49.578222 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cae5eff-676e-4fa8-96fb-79d6aa13a992 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:23:49.578514 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cae5eff-676e-4fa8-96fb-79d6aa13a992 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:23:49.624397 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:23:49.654598 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cae5eff-676e-4fa8-96fb-79d6aa13a992 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:23:49.656349 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cae5eff-676e-4fa8-96fb-79d6aa13a992 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:23:49.697132 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8488d33-d7f2-4c45-857f-a85b89a1b7e6 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:23:49.731561 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:23:49.743099 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200e4238-ab5e-48af-88e5-a1d602973b59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:23:49.744105 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200e4238-ab5e-48af-88e5-a1d602973b59 None admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:23:49.744405 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200e4238-ab5e-48af-88e5-a1d602973b59 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:23:49.744757 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200e4238-ab5e-48af-88e5-a1d602973b59 None admin] PATH_INFO: `/v3/users` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:23:49.745499 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200e4238-ab5e-48af-88e5-a1d602973b59 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:23:49.747011 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200e4238-ab5e-48af-88e5-a1d602973b59 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:23:49.759131 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 42/80] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 14 09:23:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 09:23:49.764806 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70275c40-cc27-4c4c-84b8-7f3f09f9faf5 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:23:49.764806 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70275c40-cc27-4c4c-84b8-7f3f09f9faf5 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:23:49.764806 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70275c40-cc27-4c4c-84b8-7f3f09f9faf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:23:49.771954 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 39/81] 10.222.0.40 () {60 vars in 1132 bytes} [Thu Jul 14 09:23:49 2022] POST /identity/v3/users => generated 289 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:23:49.772790 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200e4238-ab5e-48af-88e5-a1d602973b59 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:23:49.791544 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-70275c40-cc27-4c4c-84b8-7f3f09f9faf5 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:23:49.792822 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-70275c40-cc27-4c4c-84b8-7f3f09f9faf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:23:49.887094 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 43/82] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:23:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 09:23:49.887914 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70275c40-cc27-4c4c-84b8-7f3f09f9faf5 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:23:49.890738 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:23:49.920222 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200e4238-ab5e-48af-88e5-a1d602973b59 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:23:49.963479 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ec0a50-44d3-4af9-b4ce-f31adcc60ad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:23:49.964175 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ec0a50-44d3-4af9-b4ce-f31adcc60ad5 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:23:49.964464 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ec0a50-44d3-4af9-b4ce-f31adcc60ad5 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:23:49.964746 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ec0a50-44d3-4af9-b4ce-f31adcc60ad5 None admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:23:49.965543 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ec0a50-44d3-4af9-b4ce-f31adcc60ad5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:23:49.965853 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ec0a50-44d3-4af9-b4ce-f31adcc60ad5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:23:49.968067 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ec0a50-44d3-4af9-b4ce-f31adcc60ad5 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:23:49.979434 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 40/83] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jul 14 09:23:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:23:49.979434 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ec0a50-44d3-4af9-b4ce-f31adcc60ad5 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:23:50.018156 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70275c40-cc27-4c4c-84b8-7f3f09f9faf5 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:23:50.029688 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:23:50.062920 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab698d2d-b4ff-412f-a740-755b2492d619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:23:50.063828 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab698d2d-b4ff-412f-a740-755b2492d619 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:23:50.064122 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab698d2d-b4ff-412f-a740-755b2492d619 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:23:50.064408 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab698d2d-b4ff-412f-a740-755b2492d619 None admin] PATH_INFO: `/v3/projects/86c6d2afd7954c56860744ef0c7dc36d` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:23:50.066858 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab698d2d-b4ff-412f-a740-755b2492d619 None admin] RBAC: Authorizing `identity:get_project(project_id=86c6d2afd7954c56860744ef0c7dc36d)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:23:50.068969 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab698d2d-b4ff-412f-a740-755b2492d619 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:23:50.070041 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 44/84] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jul 14 09:23:49 2022] GET /identity/v3/projects/86c6d2afd7954c56860744ef0c7dc36d => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:23:50.071387 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab698d2d-b4ff-412f-a740-755b2492d619 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:23:50.129047 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ec0a50-44d3-4af9-b4ce-f31adcc60ad5 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:23:50.173900 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2468397-c3d2-4f2f-9f18-a903f933fbab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:23:50.174770 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2468397-c3d2-4f2f-9f18-a903f933fbab None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:23:50.175059 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2468397-c3d2-4f2f-9f18-a903f933fbab None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:23:50.175342 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2468397-c3d2-4f2f-9f18-a903f933fbab None admin] PATH_INFO: `/v3/projects/86c6d2afd7954c56860744ef0c7dc36d` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:23:50.176994 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2468397-c3d2-4f2f-9f18-a903f933fbab None admin] RBAC: Authorizing `identity:get_project(project_id=86c6d2afd7954c56860744ef0c7dc36d)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:23:50.178605 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:23:50.178875 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2468397-c3d2-4f2f-9f18-a903f933fbab None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:23:50.180942 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 41/85] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jul 14 09:23:49 2022] GET /identity/v3/projects/86c6d2afd7954c56860744ef0c7dc36d => generated 298 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:23:50.182477 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2468397-c3d2-4f2f-9f18-a903f933fbab None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:23:50.218457 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab698d2d-b4ff-412f-a740-755b2492d619 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:23:50.258427 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a71c22-cfe8-4b9f-815f-53c5475a1fbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:23:50.259366 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a71c22-cfe8-4b9f-815f-53c5475a1fbe None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:23:50.259727 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a71c22-cfe8-4b9f-815f-53c5475a1fbe None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:23:50.260069 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a71c22-cfe8-4b9f-815f-53c5475a1fbe None admin] PATH_INFO: `/v3/roles/member` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:23:50.273898 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a71c22-cfe8-4b9f-815f-53c5475a1fbe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:23:50.282488 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-48a71c22-cfe8-4b9f-815f-53c5475a1fbe None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 09:23:50.282488 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:23:50.282488 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:23:50.282488 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:23:50.282488 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:23:50.282488 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:23:50.282488 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:23:50.282488 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:23:50.282488 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:23:50.282488 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:23:50.282488 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:23:50.282488 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:23:50.282488 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:23:50.282488 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:23:50.282488 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:23:50.282488 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:23:50.283419 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:23:50.283419 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:23:50.283419 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:23:50.283419 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:23:50.283419 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:23:50.283419 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:23:50.283419 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:23:50.283419 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:23:50.283419 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:23:50.283419 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:23:50.283419 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:23:50.283419 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( Jul 14 09:23:50.283419 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:23:50.283419 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:23:50.283419 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:23:50.283419 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:23:50.284171 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:23:50.284171 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:23:50.284171 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:23:50.284171 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:23:50.284171 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:23:50.284171 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:23:50.284171 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:23:50.284171 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:23:50.284171 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:23:50.284171 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:23:50.284171 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 09:23:50.284171 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Jul 14 09:23:50.284171 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 45/86] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 14 09:23:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:23:50.284787 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a71c22-cfe8-4b9f-815f-53c5475a1fbe None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:23:50.307800 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2468397-c3d2-4f2f-9f18-a903f933fbab None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:23:50.319260 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:23:50.345264 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13adf0df-c2b2-4bd1-ad1f-4851c9234567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:23:50.346160 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13adf0df-c2b2-4bd1-ad1f-4851c9234567 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:23:50.346500 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13adf0df-c2b2-4bd1-ad1f-4851c9234567 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:23:50.346796 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13adf0df-c2b2-4bd1-ad1f-4851c9234567 None admin] PATH_INFO: `/v3/users/9c6423457ccf46e1b9988735408785f3` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:23:50.348149 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13adf0df-c2b2-4bd1-ad1f-4851c9234567 None admin] RBAC: Authorizing `identity:get_user(user_id=9c6423457ccf46e1b9988735408785f3)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:23:50.349621 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13adf0df-c2b2-4bd1-ad1f-4851c9234567 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:23:50.356249 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 42/87] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jul 14 09:23:50 2022] GET /identity/v3/users/9c6423457ccf46e1b9988735408785f3 => generated 275 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:23:50.356249 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13adf0df-c2b2-4bd1-ad1f-4851c9234567 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:23:50.426738 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a71c22-cfe8-4b9f-815f-53c5475a1fbe None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:23:50.462904 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13adf0df-c2b2-4bd1-ad1f-4851c9234567 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:23:50.471115 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:23:50.477579 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9cba0c-0a97-4bfc-aa02-e59acb026589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:23:50.479446 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9cba0c-0a97-4bfc-aa02-e59acb026589 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:23:50.480005 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9cba0c-0a97-4bfc-aa02-e59acb026589 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:23:50.480513 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9cba0c-0a97-4bfc-aa02-e59acb026589 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:23:50.481715 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9cba0c-0a97-4bfc-aa02-e59acb026589 None admin] RBAC: Adding query filter params (role.id=e3965bd0d5f1427a86a313c0c90bfef3, scope.project.id=86c6d2afd7954c56860744ef0c7dc36d, user.id=d3cc085bb5914250a5e384092f9f12f8) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:23:50.482279 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9cba0c-0a97-4bfc-aa02-e59acb026589 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:23:50.484312 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9cba0c-0a97-4bfc-aa02-e59acb026589 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:23:50.502221 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 46/88] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jul 14 09:23:50 2022] GET /identity/v3/role_assignments?user.id=d3cc085bb5914250a5e384092f9f12f8&scope.project.id=86c6d2afd7954c56860744ef0c7dc36d&role.id=e3965bd0d5f1427a86a313c0c90bfef3 => generated 259 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:23:50.502221 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9cba0c-0a97-4bfc-aa02-e59acb026589 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:23:50.523464 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd42851-811d-4d5e-b7ff-5fce5f57e899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:23:50.524217 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd42851-811d-4d5e-b7ff-5fce5f57e899 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:23:50.524507 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd42851-811d-4d5e-b7ff-5fce5f57e899 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:23:50.524793 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd42851-811d-4d5e-b7ff-5fce5f57e899 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:23:50.525712 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd42851-811d-4d5e-b7ff-5fce5f57e899 None admin] RBAC: Adding query filter params (role.id=17dfac38a2e540fea229af7de99911bb, scope.project.id=86c6d2afd7954c56860744ef0c7dc36d, user.id=9c6423457ccf46e1b9988735408785f3) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:23:50.526042 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd42851-811d-4d5e-b7ff-5fce5f57e899 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:23:50.528640 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd42851-811d-4d5e-b7ff-5fce5f57e899 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:23:50.538070 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 43/89] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jul 14 09:23:50 2022] GET /identity/v3/role_assignments?user.id=9c6423457ccf46e1b9988735408785f3&scope.project.id=86c6d2afd7954c56860744ef0c7dc36d&role.id=17dfac38a2e540fea229af7de99911bb => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:23:50.540772 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd42851-811d-4d5e-b7ff-5fce5f57e899 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:23:50.638232 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:23:50.712675 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9cba0c-0a97-4bfc-aa02-e59acb026589 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:23:50.773574 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd42851-811d-4d5e-b7ff-5fce5f57e899 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:23:50.808587 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4924438-dccd-4b8f-bb54-3be994737f1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:23:50.810408 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4924438-dccd-4b8f-bb54-3be994737f1e None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:23:50.811004 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4924438-dccd-4b8f-bb54-3be994737f1e None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:23:50.812660 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4924438-dccd-4b8f-bb54-3be994737f1e None admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:23:50.813597 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4924438-dccd-4b8f-bb54-3be994737f1e None admin] RBAC: Adding query filter params (name=member) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:23:50.814274 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4924438-dccd-4b8f-bb54-3be994737f1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:23:50.816736 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4924438-dccd-4b8f-bb54-3be994737f1e None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:23:50.834546 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 47/90] 10.222.0.40 () {56 vars in 1101 bytes} [Thu Jul 14 09:23:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:23:50.844606 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4924438-dccd-4b8f-bb54-3be994737f1e None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:23:50.868364 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8322341-36d1-490d-acf8-1e30f17ae802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:23:50.869585 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8322341-36d1-490d-acf8-1e30f17ae802 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:23:50.870040 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8322341-36d1-490d-acf8-1e30f17ae802 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:23:50.870491 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8322341-36d1-490d-acf8-1e30f17ae802 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:23:51.010938 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:23:51.014675 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8322341-36d1-490d-acf8-1e30f17ae802 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:23:51.016798 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8322341-36d1-490d-acf8-1e30f17ae802 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:23:51.079097 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:23:51.174226 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4924438-dccd-4b8f-bb54-3be994737f1e None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:23:51.206949 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 44/91] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 14 09:23:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 668 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 09:23:51.216879 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8322341-36d1-490d-acf8-1e30f17ae802 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:23:51.318300 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5384e9-f2b5-44bd-9f59-60670378c83c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:23:51.319365 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5384e9-f2b5-44bd-9f59-60670378c83c None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:23:51.319770 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5384e9-f2b5-44bd-9f59-60670378c83c None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:23:51.320163 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5384e9-f2b5-44bd-9f59-60670378c83c None admin] PATH_INFO: `/v3/users/9c6423457ccf46e1b9988735408785f3` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:23:51.321819 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5384e9-f2b5-44bd-9f59-60670378c83c None admin] RBAC: Authorizing `identity:get_user(user_id=9c6423457ccf46e1b9988735408785f3)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:23:51.323539 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5384e9-f2b5-44bd-9f59-60670378c83c None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:23:51.330803 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 48/92] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jul 14 09:23:50 2022] GET /identity/v3/users/9c6423457ccf46e1b9988735408785f3 => generated 275 bytes in 486 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:23:51.336196 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5384e9-f2b5-44bd-9f59-60670378c83c None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:23:51.392015 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8322341-36d1-490d-acf8-1e30f17ae802 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:23:51.447586 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa40133-48dd-428b-aebd-3c9f0e536210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:23:51.448483 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa40133-48dd-428b-aebd-3c9f0e536210 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:23:51.448771 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa40133-48dd-428b-aebd-3c9f0e536210 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:23:51.449050 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa40133-48dd-428b-aebd-3c9f0e536210 None admin] PATH_INFO: `/v3/projects/86c6d2afd7954c56860744ef0c7dc36d` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:23:51.450388 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa40133-48dd-428b-aebd-3c9f0e536210 None admin] RBAC: Authorizing `identity:get_project(project_id=86c6d2afd7954c56860744ef0c7dc36d)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:23:51.451876 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa40133-48dd-428b-aebd-3c9f0e536210 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:23:51.453799 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 45/93] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jul 14 09:23:51 2022] GET /identity/v3/projects/86c6d2afd7954c56860744ef0c7dc36d => generated 298 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:23:51.463813 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa40133-48dd-428b-aebd-3c9f0e536210 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:23:51.485405 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:23:51.545380 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5384e9-f2b5-44bd-9f59-60670378c83c None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:23:51.586664 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa40133-48dd-428b-aebd-3c9f0e536210 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:23:51.599054 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:23:51.633819 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab898986-4cbd-43f3-96ec-ba2bed3f4057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:23:51.634525 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab898986-4cbd-43f3-96ec-ba2bed3f4057 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:23:51.634824 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab898986-4cbd-43f3-96ec-ba2bed3f4057 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:23:51.635144 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab898986-4cbd-43f3-96ec-ba2bed3f4057 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:23:51.687874 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b71780-9ba7-4b33-aa50-9509ed8ac0ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:23:51.688562 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b71780-9ba7-4b33-aa50-9509ed8ac0ef None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:23:51.688853 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b71780-9ba7-4b33-aa50-9509ed8ac0ef None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:23:51.689135 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b71780-9ba7-4b33-aa50-9509ed8ac0ef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:23:51.689997 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b71780-9ba7-4b33-aa50-9509ed8ac0ef None admin] RBAC: Adding query filter params (role.id=f755c764373f47bababa1e942a53c2e1, scope.project.id=86c6d2afd7954c56860744ef0c7dc36d, user.id=9c6423457ccf46e1b9988735408785f3) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:23:51.690344 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b71780-9ba7-4b33-aa50-9509ed8ac0ef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:23:51.691820 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b71780-9ba7-4b33-aa50-9509ed8ac0ef None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:23:51.708604 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 46/94] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jul 14 09:23:51 2022] GET /identity/v3/role_assignments?user.id=9c6423457ccf46e1b9988735408785f3&scope.project.id=86c6d2afd7954c56860744ef0c7dc36d&role.id=f755c764373f47bababa1e942a53c2e1 => generated 259 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:23:51.780955 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab898986-4cbd-43f3-96ec-ba2bed3f4057 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:23:51.783387 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab898986-4cbd-43f3-96ec-ba2bed3f4057 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:23:51.949277 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 49/95] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 14 09:23:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 614 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 14 09:23:51.955238 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b71780-9ba7-4b33-aa50-9509ed8ac0ef None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:23:52.083018 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:23:52.121373 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b71780-9ba7-4b33-aa50-9509ed8ac0ef None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:23:52.167163 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca2420b-4dd3-4243-bee6-a67c62558ebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:23:52.168056 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca2420b-4dd3-4243-bee6-a67c62558ebf None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:23:52.168348 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca2420b-4dd3-4243-bee6-a67c62558ebf None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:23:52.168632 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca2420b-4dd3-4243-bee6-a67c62558ebf None admin] PATH_INFO: `/v3/projects/934d49a6ee1f43e6906f74cc5c8cd171` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:23:52.170067 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca2420b-4dd3-4243-bee6-a67c62558ebf None admin] RBAC: Authorizing `identity:get_project(project_id=934d49a6ee1f43e6906f74cc5c8cd171)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:23:52.171577 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca2420b-4dd3-4243-bee6-a67c62558ebf None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:23:52.173653 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 47/96] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jul 14 09:23:51 2022] GET /identity/v3/projects/934d49a6ee1f43e6906f74cc5c8cd171 => generated 312 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:23:52.180452 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab898986-4cbd-43f3-96ec-ba2bed3f4057 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:23:52.240054 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:23:52.376796 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab898986-4cbd-43f3-96ec-ba2bed3f4057 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:23:52.424376 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a10caeb-1e23-4eaa-bc0b-9392bc5cf53b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:23:52.425064 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a10caeb-1e23-4eaa-bc0b-9392bc5cf53b None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:23:52.425359 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a10caeb-1e23-4eaa-bc0b-9392bc5cf53b None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:23:52.425648 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a10caeb-1e23-4eaa-bc0b-9392bc5cf53b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:23:52.426547 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a10caeb-1e23-4eaa-bc0b-9392bc5cf53b None admin] RBAC: Adding query filter params (role.id=17dfac38a2e540fea229af7de99911bb, scope.project.id=934d49a6ee1f43e6906f74cc5c8cd171, user.id=9c6423457ccf46e1b9988735408785f3) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:23:52.426871 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a10caeb-1e23-4eaa-bc0b-9392bc5cf53b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:23:52.428490 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a10caeb-1e23-4eaa-bc0b-9392bc5cf53b None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:23:52.436135 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 50/97] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jul 14 09:23:52 2022] GET /identity/v3/role_assignments?user.id=9c6423457ccf46e1b9988735408785f3&scope.project.id=934d49a6ee1f43e6906f74cc5c8cd171&role.id=17dfac38a2e540fea229af7de99911bb => generated 259 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:23:52.850949 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f40d852-bbb6-4cf7-ac23-921ac9d2cd92 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:23:52.851525 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f40d852-bbb6-4cf7-ac23-921ac9d2cd92 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:23:52.851525 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f40d852-bbb6-4cf7-ac23-921ac9d2cd92 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:23:52.852801 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 48/98] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:23:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:23:52.861762 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944d10aa-e16f-4f8a-8dc9-3a5c5f497fdd None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:23:52.862356 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944d10aa-e16f-4f8a-8dc9-3a5c5f497fdd None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:23:52.862832 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944d10aa-e16f-4f8a-8dc9-3a5c5f497fdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:23:52.898591 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-944d10aa-e16f-4f8a-8dc9-3a5c5f497fdd None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:23:52.900169 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-944d10aa-e16f-4f8a-8dc9-3a5c5f497fdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:23:52.951818 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a948490-1cf4-4e70-9bfa-2ef28cf6ae23 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:23:52.952150 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a948490-1cf4-4e70-9bfa-2ef28cf6ae23 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:23:52.952765 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a948490-1cf4-4e70-9bfa-2ef28cf6ae23 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:23:52.954588 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 49/99] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:23:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:23:52.962430 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714d96eb-2474-4461-af0e-801c223b6fd6 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:23:52.963586 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714d96eb-2474-4461-af0e-801c223b6fd6 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:23:52.964939 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714d96eb-2474-4461-af0e-801c223b6fd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:23:52.991404 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-714d96eb-2474-4461-af0e-801c223b6fd6 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:23:52.992970 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-714d96eb-2474-4461-af0e-801c223b6fd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:23:53.060945 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 51/100] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:23:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 09:23:53.100331 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944d10aa-e16f-4f8a-8dc9-3a5c5f497fdd None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:23:53.135535 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:23:53.152882 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 50/101] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:23:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 09:23:53.183841 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714d96eb-2474-4461-af0e-801c223b6fd6 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:23:53.294969 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944d10aa-e16f-4f8a-8dc9-3a5c5f497fdd None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:23:53.350573 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:23:53.385483 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a639b29-44e6-416a-850e-0203719cc0ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:23:53.386370 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a639b29-44e6-416a-850e-0203719cc0ab None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:23:53.386605 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a639b29-44e6-416a-850e-0203719cc0ab None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:23:53.386942 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a639b29-44e6-416a-850e-0203719cc0ab None admin] PATH_INFO: `/v3/domains/default` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:23:53.391219 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a639b29-44e6-416a-850e-0203719cc0ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:23:53.392721 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a639b29-44e6-416a-850e-0203719cc0ab None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:23:53.394635 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 52/102] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 09:23:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:23:53.401141 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a639b29-44e6-416a-850e-0203719cc0ab None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:23:53.429114 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714d96eb-2474-4461-af0e-801c223b6fd6 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:23:53.504071 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba681e9a-4e60-47b3-9617-b790bdde23e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:23:53.505273 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba681e9a-4e60-47b3-9617-b790bdde23e6 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:23:53.505835 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba681e9a-4e60-47b3-9617-b790bdde23e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:23:53.506505 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba681e9a-4e60-47b3-9617-b790bdde23e6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:23:53.546269 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba681e9a-4e60-47b3-9617-b790bdde23e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:23:53.564146 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-ba681e9a-4e60-47b3-9617-b790bdde23e6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 09:23:53.564146 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:23:53.564146 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:23:53.564146 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:23:53.564146 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:23:53.564146 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:23:53.564146 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:23:53.564146 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:23:53.564146 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:23:53.564146 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:23:53.564146 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:23:53.564146 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:23:53.564146 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:23:53.564146 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:23:53.564146 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:23:53.564146 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:23:53.565071 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:23:53.565071 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:23:53.565071 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:23:53.565071 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:23:53.565071 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:23:53.565071 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:23:53.565071 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:23:53.565071 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:23:53.565071 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:23:53.565071 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:23:53.565071 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:23:53.565071 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( Jul 14 09:23:53.565071 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:23:53.565071 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:23:53.565071 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:23:53.565071 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:23:53.566305 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:23:53.566305 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:23:53.566305 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:23:53.566305 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:23:53.566305 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:23:53.566305 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:23:53.566305 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:23:53.566305 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:23:53.566305 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:23:53.566305 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:23:53.566305 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 09:23:53.566305 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:23:53.566305 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 51/103] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 14 09:23:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 382 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 09:23:53.571199 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba681e9a-4e60-47b3-9617-b790bdde23e6 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:23:53.581214 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:23:53.620356 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a639b29-44e6-416a-850e-0203719cc0ab None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:23:53.678916 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bac805-542d-4783-b421-ec3aebe7edc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:23:53.679987 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bac805-542d-4783-b421-ec3aebe7edc7 None admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:23:53.680479 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bac805-542d-4783-b421-ec3aebe7edc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:23:53.680967 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bac805-542d-4783-b421-ec3aebe7edc7 None admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:23:53.682518 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bac805-542d-4783-b421-ec3aebe7edc7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:23:53.684222 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bac805-542d-4783-b421-ec3aebe7edc7 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:23:53.732290 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 53/104] 10.222.0.40 () {60 vars in 1141 bytes} [Thu Jul 14 09:23:53 2022] POST /identity/v3/projects => generated 302 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:23:53.733971 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608a29ca-cf8b-4032-9d32-03f0f0c57b4b None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:23:53.734686 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608a29ca-cf8b-4032-9d32-03f0f0c57b4b None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:23:53.735198 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608a29ca-cf8b-4032-9d32-03f0f0c57b4b None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:23:53.736828 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 54/105] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:23:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:23:53.744144 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364f6e4e-3b5d-41b2-a2ea-deba40e9149a None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:23:53.745533 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364f6e4e-3b5d-41b2-a2ea-deba40e9149a None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:23:53.747762 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364f6e4e-3b5d-41b2-a2ea-deba40e9149a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:23:53.788060 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-364f6e4e-3b5d-41b2-a2ea-deba40e9149a None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:23:53.789403 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-364f6e4e-3b5d-41b2-a2ea-deba40e9149a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:23:53.804946 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba681e9a-4e60-47b3-9617-b790bdde23e6 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:23:53.879075 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:23:53.891120 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cd8585-9864-4933-86fe-b98695603b0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:23:53.892205 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cd8585-9864-4933-86fe-b98695603b0e None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:23:53.892739 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cd8585-9864-4933-86fe-b98695603b0e None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:23:53.893229 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cd8585-9864-4933-86fe-b98695603b0e None admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:23:53.894261 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cd8585-9864-4933-86fe-b98695603b0e None admin] RBAC: Adding query filter params (name=reader) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:23:53.894790 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cd8585-9864-4933-86fe-b98695603b0e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:23:53.896447 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cd8585-9864-4933-86fe-b98695603b0e None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:23:53.914293 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 52/106] 10.222.0.40 () {56 vars in 1101 bytes} [Thu Jul 14 09:23:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:23:53.926091 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cd8585-9864-4933-86fe-b98695603b0e None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:23:53.954914 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 55/107] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:23:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 09:23:53.956994 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26407114-f3a2-4305-87c0-becd4a33d585 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:23:53.957483 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26407114-f3a2-4305-87c0-becd4a33d585 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:23:53.957947 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26407114-f3a2-4305-87c0-becd4a33d585 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:23:53.960815 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 56/108] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:23:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:23:53.967964 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b39be2-b0fb-4452-90f9-66485a49fb88 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:23:53.968259 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b39be2-b0fb-4452-90f9-66485a49fb88 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:23:53.968548 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b39be2-b0fb-4452-90f9-66485a49fb88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:23:53.993971 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-c5b39be2-b0fb-4452-90f9-66485a49fb88 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:23:53.996276 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-c5b39be2-b0fb-4452-90f9-66485a49fb88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:23:54.090758 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cd8585-9864-4933-86fe-b98695603b0e None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:23:54.112899 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:23:54.122377 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 57/109] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:23:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 09:23:54.127198 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b39be2-b0fb-4452-90f9-66485a49fb88 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:23:54.152249 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fbda95-adfc-409e-93d1-dc3867292b2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:23:54.153570 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fbda95-adfc-409e-93d1-dc3867292b2b None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:23:54.154260 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fbda95-adfc-409e-93d1-dc3867292b2b None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:23:54.154848 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fbda95-adfc-409e-93d1-dc3867292b2b None admin] PATH_INFO: `/v3/users/d0b2cf068f454a6280326e85a5a7bef0` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:23:54.178097 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fbda95-adfc-409e-93d1-dc3867292b2b None admin] RBAC: Authorizing `identity:get_user(user_id=d0b2cf068f454a6280326e85a5a7bef0)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:23:54.180510 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fbda95-adfc-409e-93d1-dc3867292b2b None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:23:54.183607 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 53/110] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jul 14 09:23:53 2022] GET /identity/v3/users/d0b2cf068f454a6280326e85a5a7bef0 => generated 289 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:23:54.185659 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fbda95-adfc-409e-93d1-dc3867292b2b None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:23:54.266940 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b39be2-b0fb-4452-90f9-66485a49fb88 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:23:54.279766 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:23:54.310377 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d372e6-c286-4343-b1d0-3e5fabb0559c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:23:54.311424 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d372e6-c286-4343-b1d0-3e5fabb0559c None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:23:54.311862 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d372e6-c286-4343-b1d0-3e5fabb0559c None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:23:54.315330 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d372e6-c286-4343-b1d0-3e5fabb0559c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:23:54.327698 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d372e6-c286-4343-b1d0-3e5fabb0559c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:23:54.341232 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-d8d372e6-c286-4343-b1d0-3e5fabb0559c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 09:23:54.341232 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:23:54.341232 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:23:54.341232 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:23:54.341232 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:23:54.341232 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:23:54.341232 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:23:54.341232 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:23:54.341232 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:23:54.341232 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:23:54.341232 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:23:54.341232 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:23:54.341232 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:23:54.341232 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:23:54.341232 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:23:54.341232 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:23:54.342140 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:23:54.342140 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:23:54.342140 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:23:54.342140 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:23:54.342140 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:23:54.342140 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:23:54.342140 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:23:54.342140 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:23:54.342140 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:23:54.342140 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:23:54.342140 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:23:54.342140 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( Jul 14 09:23:54.342140 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:23:54.342140 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:23:54.342140 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:23:54.342140 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:23:54.342915 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:23:54.342915 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:23:54.342915 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:23:54.342915 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:23:54.342915 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:23:54.342915 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:23:54.342915 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:23:54.342915 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:23:54.342915 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:23:54.342915 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:23:54.342915 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 09:23:54.342915 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Jul 14 09:23:54.344049 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 58/111] 10.222.0.40 () {56 vars in 1096 bytes} [Thu Jul 14 09:23:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:23:54.344049 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d372e6-c286-4343-b1d0-3e5fabb0559c None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:23:54.386324 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fbda95-adfc-409e-93d1-dc3867292b2b None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:23:54.417130 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:23:54.469158 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d372e6-c286-4343-b1d0-3e5fabb0559c None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:23:54.514225 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43ff473-7bb8-4759-91f2-71bd3652013c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:23:54.515545 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43ff473-7bb8-4759-91f2-71bd3652013c None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:23:54.516005 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43ff473-7bb8-4759-91f2-71bd3652013c None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:23:54.516296 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43ff473-7bb8-4759-91f2-71bd3652013c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:23:54.556950 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e03846-6efb-49c4-9782-dc7d0f82947c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:23:54.556950 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e03846-6efb-49c4-9782-dc7d0f82947c None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:23:54.556950 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e03846-6efb-49c4-9782-dc7d0f82947c None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:23:54.556950 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e03846-6efb-49c4-9782-dc7d0f82947c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:23:54.607233 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e03846-6efb-49c4-9782-dc7d0f82947c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:23:54.610211 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43ff473-7bb8-4759-91f2-71bd3652013c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:23:54.615351 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-c0e03846-6efb-49c4-9782-dc7d0f82947c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 09:23:54.615351 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:23:54.615351 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:23:54.615351 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:23:54.615351 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:23:54.615351 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:23:54.615351 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:23:54.615351 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:23:54.615351 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:23:54.615351 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:23:54.615351 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:23:54.615351 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:23:54.615351 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:23:54.615351 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:23:54.615351 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:23:54.615351 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:23:54.616234 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:23:54.616234 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:23:54.616234 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:23:54.616234 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:23:54.616234 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:23:54.616234 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:23:54.616234 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:23:54.616234 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:23:54.616234 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:23:54.616234 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:23:54.616234 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:23:54.616234 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( Jul 14 09:23:54.616234 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:23:54.616234 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:23:54.616234 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:23:54.616234 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:23:54.617433 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:23:54.617433 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:23:54.617433 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:23:54.617433 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:23:54.617433 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:23:54.617433 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:23:54.617433 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:23:54.617433 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:23:54.617433 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:23:54.617433 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:23:54.617433 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 09:23:54.617433 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:23:54.617433 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 54/112] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 14 09:23:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 432 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:23:54.617433 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e03846-6efb-49c4-9782-dc7d0f82947c None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:23:54.618352 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43ff473-7bb8-4759-91f2-71bd3652013c None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:23:54.698805 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:23:54.750025 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 59/113] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 14 09:23:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 09:23:54.751407 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43ff473-7bb8-4759-91f2-71bd3652013c None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:23:54.853306 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e03846-6efb-49c4-9782-dc7d0f82947c None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:23:54.893254 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:23:54.909927 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43ff473-7bb8-4759-91f2-71bd3652013c None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:23:54.933312 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd206e5b-76ba-471d-842e-b5ba7ad1e1a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:23:54.934001 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd206e5b-76ba-471d-842e-b5ba7ad1e1a4 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:23:54.934312 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd206e5b-76ba-471d-842e-b5ba7ad1e1a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:23:54.934590 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd206e5b-76ba-471d-842e-b5ba7ad1e1a4 None admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:23:54.935366 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd206e5b-76ba-471d-842e-b5ba7ad1e1a4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:23:54.935677 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd206e5b-76ba-471d-842e-b5ba7ad1e1a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:23:54.937886 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd206e5b-76ba-471d-842e-b5ba7ad1e1a4 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:23:54.955915 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 55/114] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 14 09:23:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:23:54.956932 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd206e5b-76ba-471d-842e-b5ba7ad1e1a4 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:23:54.985044 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee7fe54-d73f-4717-8c99-ebd71e562b13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:23:54.985741 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee7fe54-d73f-4717-8c99-ebd71e562b13 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:23:54.986026 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee7fe54-d73f-4717-8c99-ebd71e562b13 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:23:54.986328 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee7fe54-d73f-4717-8c99-ebd71e562b13 None admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:23:54.987104 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee7fe54-d73f-4717-8c99-ebd71e562b13 None admin] RBAC: Adding query filter params (name=member) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:23:54.987413 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee7fe54-d73f-4717-8c99-ebd71e562b13 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:23:54.990965 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee7fe54-d73f-4717-8c99-ebd71e562b13 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:23:55.004017 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 60/115] 10.222.0.40 () {56 vars in 1101 bytes} [Thu Jul 14 09:23:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:23:55.009432 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee7fe54-d73f-4717-8c99-ebd71e562b13 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:23:55.057585 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:23:55.147551 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd206e5b-76ba-471d-842e-b5ba7ad1e1a4 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:23:55.187195 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6787ed13-d1d1-41a9-906a-5f565d702b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:23:55.188082 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6787ed13-d1d1-41a9-906a-5f565d702b42 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:23:55.188376 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6787ed13-d1d1-41a9-906a-5f565d702b42 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:23:55.188664 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6787ed13-d1d1-41a9-906a-5f565d702b42 None admin] PATH_INFO: `/v3/projects/86c6d2afd7954c56860744ef0c7dc36d` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:23:55.189320 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee7fe54-d73f-4717-8c99-ebd71e562b13 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:23:55.190064 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6787ed13-d1d1-41a9-906a-5f565d702b42 None admin] RBAC: Authorizing `identity:get_project(project_id=86c6d2afd7954c56860744ef0c7dc36d)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:23:55.191854 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6787ed13-d1d1-41a9-906a-5f565d702b42 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:23:55.193943 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 56/116] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jul 14 09:23:54 2022] GET /identity/v3/projects/86c6d2afd7954c56860744ef0c7dc36d => generated 298 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:23:55.194652 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6787ed13-d1d1-41a9-906a-5f565d702b42 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:23:55.232617 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe281aa-fa96-468f-beee-533744d6f8d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:23:55.233885 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe281aa-fa96-468f-beee-533744d6f8d8 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:23:55.234417 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe281aa-fa96-468f-beee-533744d6f8d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:23:55.234924 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe281aa-fa96-468f-beee-533744d6f8d8 None admin] PATH_INFO: `/v3/users/d3cc085bb5914250a5e384092f9f12f8` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:23:55.236590 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe281aa-fa96-468f-beee-533744d6f8d8 None admin] RBAC: Authorizing `identity:get_user(user_id=d3cc085bb5914250a5e384092f9f12f8)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:23:55.238640 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe281aa-fa96-468f-beee-533744d6f8d8 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:23:55.240575 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 61/117] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jul 14 09:23:55 2022] GET /identity/v3/users/d3cc085bb5914250a5e384092f9f12f8 => generated 247 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:23:55.242034 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cba098a-64ee-4842-8bb9-6b8c8f3ce235 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:23:55.242648 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cba098a-64ee-4842-8bb9-6b8c8f3ce235 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:23:55.243151 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cba098a-64ee-4842-8bb9-6b8c8f3ce235 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:23:55.244919 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 62/118] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:23:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:23:55.246261 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cba098a-64ee-4842-8bb9-6b8c8f3ce235 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:23:55.254489 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:23:55.321647 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6787ed13-d1d1-41a9-906a-5f565d702b42 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:23:55.363004 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c386dd6a-01a4-4f86-9da0-5aad404de14e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:23:55.364013 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c386dd6a-01a4-4f86-9da0-5aad404de14e None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:23:55.364306 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c386dd6a-01a4-4f86-9da0-5aad404de14e None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:23:55.364586 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c386dd6a-01a4-4f86-9da0-5aad404de14e None admin] PATH_INFO: `/v3/users/9c6423457ccf46e1b9988735408785f3` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:23:55.365834 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c386dd6a-01a4-4f86-9da0-5aad404de14e None admin] RBAC: Authorizing `identity:get_user(user_id=9c6423457ccf46e1b9988735408785f3)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:23:55.367349 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c386dd6a-01a4-4f86-9da0-5aad404de14e None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:23:55.370973 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 57/119] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jul 14 09:23:55 2022] GET /identity/v3/users/9c6423457ccf46e1b9988735408785f3 => generated 275 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:23:55.370973 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c386dd6a-01a4-4f86-9da0-5aad404de14e None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:23:55.379114 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:23:55.397155 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cba098a-64ee-4842-8bb9-6b8c8f3ce235 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:23:55.439905 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb97c4d2-4806-433f-b5df-140b9d9af620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:23:55.440575 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb97c4d2-4806-433f-b5df-140b9d9af620 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:23:55.440876 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb97c4d2-4806-433f-b5df-140b9d9af620 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:23:55.441158 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb97c4d2-4806-433f-b5df-140b9d9af620 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:23:55.442013 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb97c4d2-4806-433f-b5df-140b9d9af620 None admin] RBAC: Adding query filter params (role.id=028a8869bb7b4891b03c0b6afcced73a, scope.project.id=86c6d2afd7954c56860744ef0c7dc36d, user.id=d0b2cf068f454a6280326e85a5a7bef0) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:23:55.442444 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb97c4d2-4806-433f-b5df-140b9d9af620 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:23:55.443914 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb97c4d2-4806-433f-b5df-140b9d9af620 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:23:55.449665 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 63/120] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jul 14 09:23:55 2022] GET /identity/v3/role_assignments?user.id=d0b2cf068f454a6280326e85a5a7bef0&scope.project.id=86c6d2afd7954c56860744ef0c7dc36d&role.id=028a8869bb7b4891b03c0b6afcced73a => generated 259 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:23:55.456642 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b6d126-b27c-4af0-933a-ab1494c6ce13 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:23:55.456642 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b6d126-b27c-4af0-933a-ab1494c6ce13 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:23:55.456642 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b6d126-b27c-4af0-933a-ab1494c6ce13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:23:55.474493 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-52b6d126-b27c-4af0-933a-ab1494c6ce13 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:23:55.475809 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-52b6d126-b27c-4af0-933a-ab1494c6ce13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:23:55.509460 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c386dd6a-01a4-4f86-9da0-5aad404de14e None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:23:55.531484 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:23:55.568755 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848c719a-9b7a-490a-b8b1-4f634dac3857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:23:55.570038 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848c719a-9b7a-490a-b8b1-4f634dac3857 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:23:55.570558 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848c719a-9b7a-490a-b8b1-4f634dac3857 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:23:55.578418 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 64/121] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:23:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 09:23:55.578418 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69239c8c-7f69-4b04-aaa9-8893c8189995 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:23:55.578418 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69239c8c-7f69-4b04-aaa9-8893c8189995 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:23:55.578418 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69239c8c-7f69-4b04-aaa9-8893c8189995 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:23:55.578418 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 65/122] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:23:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:23:55.578418 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69239c8c-7f69-4b04-aaa9-8893c8189995 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:23:55.579814 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848c719a-9b7a-490a-b8b1-4f634dac3857 None admin] PATH_INFO: `/v3/projects/86c6d2afd7954c56860744ef0c7dc36d` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:23:55.582714 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848c719a-9b7a-490a-b8b1-4f634dac3857 None admin] RBAC: Authorizing `identity:get_project(project_id=86c6d2afd7954c56860744ef0c7dc36d)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:23:55.584499 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848c719a-9b7a-490a-b8b1-4f634dac3857 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:23:55.587339 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 58/123] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jul 14 09:23:55 2022] GET /identity/v3/projects/86c6d2afd7954c56860744ef0c7dc36d => generated 298 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:23:55.589525 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d7b453-b09f-48f1-8303-21446cc9bca2 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:23:55.595040 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d7b453-b09f-48f1-8303-21446cc9bca2 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:23:55.595760 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d7b453-b09f-48f1-8303-21446cc9bca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:23:55.619444 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-91d7b453-b09f-48f1-8303-21446cc9bca2 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:23:55.620778 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-91d7b453-b09f-48f1-8303-21446cc9bca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:23:55.684977 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:23:55.701758 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 59/124] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:23:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 09:23:55.702478 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d7b453-b09f-48f1-8303-21446cc9bca2 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:23:55.708169 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69239c8c-7f69-4b04-aaa9-8893c8189995 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:23:55.747264 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaca65a-eb80-48e8-b217-73e192648e23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:23:55.748511 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaca65a-eb80-48e8-b217-73e192648e23 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:23:55.749021 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaca65a-eb80-48e8-b217-73e192648e23 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:23:55.749608 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaca65a-eb80-48e8-b217-73e192648e23 None admin] PATH_INFO: `/v3/projects/86c6d2afd7954c56860744ef0c7dc36d` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:23:55.752674 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceaca65a-eb80-48e8-b217-73e192648e23 None admin] RBAC: Authorizing `identity:get_project(project_id=86c6d2afd7954c56860744ef0c7dc36d)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:23:55.754618 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceaca65a-eb80-48e8-b217-73e192648e23 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:23:55.756869 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 66/125] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jul 14 09:23:55 2022] GET /identity/v3/projects/86c6d2afd7954c56860744ef0c7dc36d => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:23:55.757857 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaca65a-eb80-48e8-b217-73e192648e23 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:23:55.840939 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d7b453-b09f-48f1-8303-21446cc9bca2 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:23:55.864293 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:23:55.896882 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaca65a-eb80-48e8-b217-73e192648e23 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:23:55.899372 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc6e022-73d8-44f2-ac9f-3e7d10f27330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:23:55.900897 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc6e022-73d8-44f2-ac9f-3e7d10f27330 None admin] REQUEST_METHOD: `PUT` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:23:55.901419 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc6e022-73d8-44f2-ac9f-3e7d10f27330 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:23:55.901923 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc6e022-73d8-44f2-ac9f-3e7d10f27330 None admin] PATH_INFO: `/v3/projects/86c6d2afd7954c56860744ef0c7dc36d/users/d3cc085bb5914250a5e384092f9f12f8/roles/e3965bd0d5f1427a86a313c0c90bfef3` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:23:55.904295 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc6e022-73d8-44f2-ac9f-3e7d10f27330 None admin] RBAC: Authorizing `identity:create_grant(project_id=86c6d2afd7954c56860744ef0c7dc36d, user_id=d3cc085bb5914250a5e384092f9f12f8, role_id=e3965bd0d5f1427a86a313c0c90bfef3)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:23:55.906008 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc6e022-73d8-44f2-ac9f-3e7d10f27330 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:23:55.925699 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 60/126] 10.222.0.40 () {58 vars in 1439 bytes} [Thu Jul 14 09:23:55 2022] PUT /identity/v3/projects/86c6d2afd7954c56860744ef0c7dc36d/users/d3cc085bb5914250a5e384092f9f12f8/roles/e3965bd0d5f1427a86a313c0c90bfef3 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:23:55.927797 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc6e022-73d8-44f2-ac9f-3e7d10f27330 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:23:55.943257 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5a1d8f-4aae-4de9-9ed7-57031402fe6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:23:55.944396 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5a1d8f-4aae-4de9-9ed7-57031402fe6f None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:23:55.944396 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5a1d8f-4aae-4de9-9ed7-57031402fe6f None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:23:55.944693 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5a1d8f-4aae-4de9-9ed7-57031402fe6f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:23:55.959185 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5a1d8f-4aae-4de9-9ed7-57031402fe6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:23:55.968499 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-be5a1d8f-4aae-4de9-9ed7-57031402fe6f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 09:23:55.968499 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:23:55.968499 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:23:55.968499 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:23:55.968499 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:23:55.968499 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:23:55.968499 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:23:55.968499 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:23:55.968499 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:23:55.968499 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:23:55.968499 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:23:55.968499 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:23:55.968499 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:23:55.968499 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:23:55.968499 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:23:55.968499 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:23:55.969477 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:23:55.969477 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:23:55.969477 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:23:55.969477 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:23:55.969477 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:23:55.969477 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:23:55.969477 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:23:55.969477 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:23:55.969477 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:23:55.969477 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:23:55.969477 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:23:55.969477 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( Jul 14 09:23:55.969477 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:23:55.969477 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:23:55.969477 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:23:55.969477 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:23:55.970255 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:23:55.970255 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:23:55.970255 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:23:55.970255 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:23:55.970255 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:23:55.970255 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:23:55.970255 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:23:55.970255 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:23:55.970255 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:23:55.970255 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:23:55.970255 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 09:23:55.970255 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Jul 14 09:23:55.970255 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 67/127] 10.222.0.40 () {56 vars in 1114 bytes} [Thu Jul 14 09:23:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:23:55.970886 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5a1d8f-4aae-4de9-9ed7-57031402fe6f None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:23:55.987471 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:23:56.068097 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc6e022-73d8-44f2-ac9f-3e7d10f27330 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:23:56.091695 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5a1d8f-4aae-4de9-9ed7-57031402fe6f None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:23:56.111438 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1aa714f-8730-41e2-b42b-5d4cddcd3e80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:23:56.112651 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aa714f-8730-41e2-b42b-5d4cddcd3e80 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:23:56.113150 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aa714f-8730-41e2-b42b-5d4cddcd3e80 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:23:56.113650 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aa714f-8730-41e2-b42b-5d4cddcd3e80 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:23:56.128123 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1aa714f-8730-41e2-b42b-5d4cddcd3e80 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:23:56.133390 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84091b5-fb85-4fe9-a011-d81a0b587f19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:23:56.134335 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84091b5-fb85-4fe9-a011-d81a0b587f19 None admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:23:56.134631 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84091b5-fb85-4fe9-a011-d81a0b587f19 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:23:56.135477 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84091b5-fb85-4fe9-a011-d81a0b587f19 None admin] PATH_INFO: `/v3/projects/86c6d2afd7954c56860744ef0c7dc36d/users/9c6423457ccf46e1b9988735408785f3/roles/17dfac38a2e540fea229af7de99911bb` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:23:56.137520 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84091b5-fb85-4fe9-a011-d81a0b587f19 None admin] RBAC: Authorizing `identity:create_grant(project_id=86c6d2afd7954c56860744ef0c7dc36d, user_id=9c6423457ccf46e1b9988735408785f3, role_id=17dfac38a2e540fea229af7de99911bb)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:23:56.138303 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-d1aa714f-8730-41e2-b42b-5d4cddcd3e80 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 09:23:56.138303 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:23:56.138303 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:23:56.138303 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:23:56.138303 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:23:56.138303 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:23:56.138303 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:23:56.138303 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:23:56.138303 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:23:56.138303 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:23:56.138303 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:23:56.138303 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:23:56.138303 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:23:56.138303 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:23:56.138303 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:23:56.138303 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:23:56.139151 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:23:56.139151 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:23:56.139151 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:23:56.139151 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:23:56.139151 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:23:56.139151 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:23:56.139151 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:23:56.139151 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:23:56.139151 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:23:56.139151 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:23:56.139151 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:23:56.139151 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( Jul 14 09:23:56.139151 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:23:56.139151 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:23:56.139151 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:23:56.139151 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:23:56.139905 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:23:56.139905 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:23:56.139905 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:23:56.139905 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:23:56.139905 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:23:56.139905 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:23:56.139905 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:23:56.139905 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:23:56.139905 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:23:56.139905 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:23:56.139905 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 09:23:56.139905 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:23:56.140603 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84091b5-fb85-4fe9-a011-d81a0b587f19 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:23:56.143284 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 61/128] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 14 09:23:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:23:56.144576 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1aa714f-8730-41e2-b42b-5d4cddcd3e80 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:23:56.166556 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 68/129] 10.222.0.40 () {58 vars in 1439 bytes} [Thu Jul 14 09:23:55 2022] PUT /identity/v3/projects/86c6d2afd7954c56860744ef0c7dc36d/users/9c6423457ccf46e1b9988735408785f3/roles/17dfac38a2e540fea229af7de99911bb => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:23:56.167660 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84091b5-fb85-4fe9-a011-d81a0b587f19 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:23:56.189086 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:23:56.280614 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:23:56.284544 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1aa714f-8730-41e2-b42b-5d4cddcd3e80 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:23:56.320707 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84091b5-fb85-4fe9-a011-d81a0b587f19 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:23:56.336986 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465e0fa8-d63a-43b7-8387-d2b98b673d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:23:56.338072 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465e0fa8-d63a-43b7-8387-d2b98b673d5f None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:23:56.338878 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465e0fa8-d63a-43b7-8387-d2b98b673d5f None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:23:56.339380 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465e0fa8-d63a-43b7-8387-d2b98b673d5f None admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:23:56.340413 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465e0fa8-d63a-43b7-8387-d2b98b673d5f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:23:56.340919 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465e0fa8-d63a-43b7-8387-d2b98b673d5f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:23:56.342713 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465e0fa8-d63a-43b7-8387-d2b98b673d5f None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:23:56.359750 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 62/130] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jul 14 09:23:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:23:56.361118 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465e0fa8-d63a-43b7-8387-d2b98b673d5f None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:23:56.363749 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5215027-cb18-4487-b7cb-af46a053ba96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:23:56.364713 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5215027-cb18-4487-b7cb-af46a053ba96 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:23:56.364832 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5215027-cb18-4487-b7cb-af46a053ba96 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:23:56.365320 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5215027-cb18-4487-b7cb-af46a053ba96 None admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:23:56.366953 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5215027-cb18-4487-b7cb-af46a053ba96 None admin] RBAC: Adding query filter params (name=member) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:23:56.366953 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5215027-cb18-4487-b7cb-af46a053ba96 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:23:56.368335 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5215027-cb18-4487-b7cb-af46a053ba96 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:23:56.380231 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 69/131] 10.222.0.40 () {56 vars in 1101 bytes} [Thu Jul 14 09:23:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:23:56.386494 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5215027-cb18-4487-b7cb-af46a053ba96 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:23:56.481865 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:23:56.493551 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465e0fa8-d63a-43b7-8387-d2b98b673d5f None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:23:56.501476 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5215027-cb18-4487-b7cb-af46a053ba96 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:23:56.539605 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:23:56.551293 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e1090c-1c62-47e4-bb2f-d57b0ce46c80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:23:56.551293 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e1090c-1c62-47e4-bb2f-d57b0ce46c80 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:23:56.551293 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e1090c-1c62-47e4-bb2f-d57b0ce46c80 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:23:56.551293 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e1090c-1c62-47e4-bb2f-d57b0ce46c80 None admin] PATH_INFO: `/v3/users/9c6423457ccf46e1b9988735408785f3` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:23:56.551693 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e1090c-1c62-47e4-bb2f-d57b0ce46c80 None admin] RBAC: Authorizing `identity:get_user(user_id=9c6423457ccf46e1b9988735408785f3)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:23:56.551693 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e1090c-1c62-47e4-bb2f-d57b0ce46c80 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:23:56.561093 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 70/132] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jul 14 09:23:56 2022] GET /identity/v3/users/9c6423457ccf46e1b9988735408785f3 => generated 275 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:23:56.564641 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a191193-dfe6-45a7-b0c8-1180ff29e97f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:23:56.565380 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e1090c-1c62-47e4-bb2f-d57b0ce46c80 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:23:56.567138 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a191193-dfe6-45a7-b0c8-1180ff29e97f None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:23:56.567482 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a191193-dfe6-45a7-b0c8-1180ff29e97f None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:23:56.567754 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a191193-dfe6-45a7-b0c8-1180ff29e97f None admin] PATH_INFO: `/v3/users/9c6423457ccf46e1b9988735408785f3` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:23:56.569059 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a191193-dfe6-45a7-b0c8-1180ff29e97f None admin] RBAC: Authorizing `identity:get_user(user_id=9c6423457ccf46e1b9988735408785f3)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:23:56.572692 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a191193-dfe6-45a7-b0c8-1180ff29e97f None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:23:56.574520 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 63/133] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jul 14 09:23:56 2022] GET /identity/v3/users/9c6423457ccf46e1b9988735408785f3 => generated 275 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:23:56.580155 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a191193-dfe6-45a7-b0c8-1180ff29e97f None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:23:56.696716 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a191193-dfe6-45a7-b0c8-1180ff29e97f None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:23:56.704248 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e1090c-1c62-47e4-bb2f-d57b0ce46c80 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:23:56.736210 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8172b78d-c8d6-4e15-b2da-b150b9cd5a12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:23:56.737129 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8172b78d-c8d6-4e15-b2da-b150b9cd5a12 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:23:56.737419 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8172b78d-c8d6-4e15-b2da-b150b9cd5a12 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:23:56.737701 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8172b78d-c8d6-4e15-b2da-b150b9cd5a12 None admin] PATH_INFO: `/v3/projects/86c6d2afd7954c56860744ef0c7dc36d` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:23:56.739319 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8172b78d-c8d6-4e15-b2da-b150b9cd5a12 None admin] RBAC: Authorizing `identity:get_project(project_id=86c6d2afd7954c56860744ef0c7dc36d)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:23:56.740777 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8172b78d-c8d6-4e15-b2da-b150b9cd5a12 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:23:56.742916 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 64/134] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jul 14 09:23:56 2022] GET /identity/v3/projects/86c6d2afd7954c56860744ef0c7dc36d => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:23:56.744385 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94ecb43-81cf-46f2-9405-f93051d803c4 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:23:56.744674 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94ecb43-81cf-46f2-9405-f93051d803c4 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:23:56.744954 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94ecb43-81cf-46f2-9405-f93051d803c4 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:23:56.745537 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342fe38e-b93d-4d06-8f50-dd90da075a5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:23:56.746177 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 65/135] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:23:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:23:56.746920 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342fe38e-b93d-4d06-8f50-dd90da075a5b None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:23:56.747516 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342fe38e-b93d-4d06-8f50-dd90da075a5b None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:23:56.748095 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342fe38e-b93d-4d06-8f50-dd90da075a5b None admin] PATH_INFO: `/v3/projects/934d49a6ee1f43e6906f74cc5c8cd171` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:23:56.749546 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342fe38e-b93d-4d06-8f50-dd90da075a5b None admin] RBAC: Authorizing `identity:get_project(project_id=934d49a6ee1f43e6906f74cc5c8cd171)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:23:56.751433 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342fe38e-b93d-4d06-8f50-dd90da075a5b None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:23:56.752340 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf3572d-faca-4d80-9810-18b3a427b729 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:23:56.752677 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf3572d-faca-4d80-9810-18b3a427b729 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:23:56.752973 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf3572d-faca-4d80-9810-18b3a427b729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:23:56.754143 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 71/136] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jul 14 09:23:56 2022] GET /identity/v3/projects/934d49a6ee1f43e6906f74cc5c8cd171 => generated 312 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:23:56.755353 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342fe38e-b93d-4d06-8f50-dd90da075a5b None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:23:56.776390 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-faf3572d-faca-4d80-9810-18b3a427b729 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:23:56.777772 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-faf3572d-faca-4d80-9810-18b3a427b729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:23:56.802672 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:23:56.849393 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:23:56.858873 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 66/137] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:23:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 09:23:56.859852 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf3572d-faca-4d80-9810-18b3a427b729 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:23:56.887379 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342fe38e-b93d-4d06-8f50-dd90da075a5b None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:23:56.924836 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc37a9c-fa0d-4247-b62f-1fff01eff0f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:23:56.925758 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc37a9c-fa0d-4247-b62f-1fff01eff0f6 None admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:23:56.926053 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc37a9c-fa0d-4247-b62f-1fff01eff0f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:23:56.926385 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc37a9c-fa0d-4247-b62f-1fff01eff0f6 None admin] PATH_INFO: `/v3/projects/86c6d2afd7954c56860744ef0c7dc36d/users/9c6423457ccf46e1b9988735408785f3/roles/f755c764373f47bababa1e942a53c2e1` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:23:56.929524 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc37a9c-fa0d-4247-b62f-1fff01eff0f6 None admin] RBAC: Authorizing `identity:create_grant(project_id=86c6d2afd7954c56860744ef0c7dc36d, user_id=9c6423457ccf46e1b9988735408785f3, role_id=f755c764373f47bababa1e942a53c2e1)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:23:56.932206 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc37a9c-fa0d-4247-b62f-1fff01eff0f6 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:23:56.951734 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 72/138] 10.222.0.40 () {58 vars in 1439 bytes} [Thu Jul 14 09:23:56 2022] PUT /identity/v3/projects/86c6d2afd7954c56860744ef0c7dc36d/users/9c6423457ccf46e1b9988735408785f3/roles/f755c764373f47bababa1e942a53c2e1 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:23:56.952878 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc37a9c-fa0d-4247-b62f-1fff01eff0f6 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:23:57.060701 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf3572d-faca-4d80-9810-18b3a427b729 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:23:57.079077 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc37a9c-fa0d-4247-b62f-1fff01eff0f6 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:23:57.114756 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:23:57.120958 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084f95ac-54ac-4e95-bdb4-3fe1fb9b4c3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:23:57.121806 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084f95ac-54ac-4e95-bdb4-3fe1fb9b4c3c None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:23:57.122101 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084f95ac-54ac-4e95-bdb4-3fe1fb9b4c3c None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:23:57.122422 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084f95ac-54ac-4e95-bdb4-3fe1fb9b4c3c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:23:57.124005 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084f95ac-54ac-4e95-bdb4-3fe1fb9b4c3c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:23:57.125638 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084f95ac-54ac-4e95-bdb4-3fe1fb9b4c3c None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:23:57.127567 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 73/139] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 09:23:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:23:57.134087 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084f95ac-54ac-4e95-bdb4-3fe1fb9b4c3c None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:23:57.214970 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb623dbe-8a37-48a7-bca3-c921993170ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:23:57.215906 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb623dbe-8a37-48a7-bca3-c921993170ef None admin] REQUEST_METHOD: `PUT` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:23:57.216197 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb623dbe-8a37-48a7-bca3-c921993170ef None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:23:57.216484 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb623dbe-8a37-48a7-bca3-c921993170ef None admin] PATH_INFO: `/v3/projects/934d49a6ee1f43e6906f74cc5c8cd171/users/9c6423457ccf46e1b9988735408785f3/roles/17dfac38a2e540fea229af7de99911bb` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:23:57.231456 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb623dbe-8a37-48a7-bca3-c921993170ef None admin] RBAC: Authorizing `identity:create_grant(project_id=934d49a6ee1f43e6906f74cc5c8cd171, user_id=9c6423457ccf46e1b9988735408785f3, role_id=17dfac38a2e540fea229af7de99911bb)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:23:57.233142 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb623dbe-8a37-48a7-bca3-c921993170ef None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:23:57.268107 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 67/140] 10.222.0.40 () {58 vars in 1439 bytes} [Thu Jul 14 09:23:56 2022] PUT /identity/v3/projects/934d49a6ee1f43e6906f74cc5c8cd171/users/9c6423457ccf46e1b9988735408785f3/roles/17dfac38a2e540fea229af7de99911bb => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:23:57.317324 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084f95ac-54ac-4e95-bdb4-3fe1fb9b4c3c None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:23:57.363087 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b753ac54-c3b6-4993-b61b-1b670079bd6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:23:57.363906 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b753ac54-c3b6-4993-b61b-1b670079bd6c None admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:23:57.364257 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b753ac54-c3b6-4993-b61b-1b670079bd6c None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:23:57.364604 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b753ac54-c3b6-4993-b61b-1b670079bd6c None admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:23:57.365509 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b753ac54-c3b6-4993-b61b-1b670079bd6c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:23:57.367363 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b753ac54-c3b6-4993-b61b-1b670079bd6c None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:23:57.404891 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 74/141] 10.222.0.40 () {60 vars in 1132 bytes} [Thu Jul 14 09:23:57 2022] POST /identity/v3/users => generated 283 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:23:58.471193 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f96c7d0-b0c5-4cea-bbe5-90ecf8dbf463 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:23:58.471868 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f96c7d0-b0c5-4cea-bbe5-90ecf8dbf463 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:23:58.471868 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f96c7d0-b0c5-4cea-bbe5-90ecf8dbf463 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:23:58.473131 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 68/142] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:23:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:23:58.479477 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e68bc32-9bc1-4c63-ab32-ba8ee2355e42 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:23:58.479921 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e68bc32-9bc1-4c63-ab32-ba8ee2355e42 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:23:58.480125 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e68bc32-9bc1-4c63-ab32-ba8ee2355e42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:23:58.499565 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-9e68bc32-9bc1-4c63-ab32-ba8ee2355e42 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:23:58.501073 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-9e68bc32-9bc1-4c63-ab32-ba8ee2355e42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:23:58.568178 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:23:58.593072 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 75/143] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:23:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 09:23:58.616373 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f96c7d0-b0c5-4cea-bbe5-90ecf8dbf463 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:23:58.638120 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:23:58.734737 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f96c7d0-b0c5-4cea-bbe5-90ecf8dbf463 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:23:58.772105 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7efd8f-00b6-4622-8c75-f8ab1478f06b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:23:58.772931 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7efd8f-00b6-4622-8c75-f8ab1478f06b None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:23:58.773215 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7efd8f-00b6-4622-8c75-f8ab1478f06b None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:23:58.773553 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7efd8f-00b6-4622-8c75-f8ab1478f06b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:23:58.785887 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7efd8f-00b6-4622-8c75-f8ab1478f06b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:23:58.794086 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-8c7efd8f-00b6-4622-8c75-f8ab1478f06b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 09:23:58.794086 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:23:58.794086 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:23:58.794086 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:23:58.794086 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:23:58.794086 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:23:58.794086 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:23:58.794086 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:23:58.794086 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:23:58.794086 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:23:58.794086 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:23:58.794086 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:23:58.794086 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:23:58.794086 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:23:58.794086 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:23:58.794086 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:23:58.795003 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:23:58.795003 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:23:58.795003 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:23:58.795003 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:23:58.795003 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:23:58.795003 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:23:58.795003 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:23:58.795003 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:23:58.795003 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:23:58.795003 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:23:58.795003 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:23:58.795003 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( Jul 14 09:23:58.795003 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:23:58.795003 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:23:58.795003 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:23:58.795003 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:23:58.795749 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:23:58.795749 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:23:58.795749 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:23:58.795749 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:23:58.795749 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:23:58.795749 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:23:58.795749 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:23:58.795749 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:23:58.795749 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:23:58.795749 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:23:58.795749 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 09:23:58.795749 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:23:58.795749 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 69/144] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 14 09:23:58 2022] GET /identity/v3/roles/reader => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:23:58.802429 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e68bc32-9bc1-4c63-ab32-ba8ee2355e42 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:23:58.921752 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e68bc32-9bc1-4c63-ab32-ba8ee2355e42 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:23:58.968777 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777a4b9e-09ed-479b-8cc6-7379d3c8cfba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:23:58.969482 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777a4b9e-09ed-479b-8cc6-7379d3c8cfba None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:23:58.969776 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777a4b9e-09ed-479b-8cc6-7379d3c8cfba None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:23:58.970046 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777a4b9e-09ed-479b-8cc6-7379d3c8cfba None admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:23:58.970846 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777a4b9e-09ed-479b-8cc6-7379d3c8cfba None admin] RBAC: Adding query filter params (name=reader) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:23:58.971156 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777a4b9e-09ed-479b-8cc6-7379d3c8cfba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:23:58.972573 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777a4b9e-09ed-479b-8cc6-7379d3c8cfba None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:23:58.986704 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 76/145] 10.222.0.40 () {56 vars in 1101 bytes} [Thu Jul 14 09:23:58 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:23:58.992380 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7efd8f-00b6-4622-8c75-f8ab1478f06b None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:23:59.082571 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:23:59.105495 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7efd8f-00b6-4622-8c75-f8ab1478f06b None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:23:59.142536 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b1eb2d-8c1a-40de-a8bc-b781bde1f1ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:23:59.143550 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b1eb2d-8c1a-40de-a8bc-b781bde1f1ea None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:23:59.143929 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b1eb2d-8c1a-40de-a8bc-b781bde1f1ea None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:23:59.144264 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b1eb2d-8c1a-40de-a8bc-b781bde1f1ea None admin] PATH_INFO: `/v3/users/d0b2cf068f454a6280326e85a5a7bef0` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:23:59.145591 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b1eb2d-8c1a-40de-a8bc-b781bde1f1ea None admin] RBAC: Authorizing `identity:get_user(user_id=d0b2cf068f454a6280326e85a5a7bef0)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:23:59.147276 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b1eb2d-8c1a-40de-a8bc-b781bde1f1ea None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:23:59.149307 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 70/146] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jul 14 09:23:58 2022] GET /identity/v3/users/d0b2cf068f454a6280326e85a5a7bef0 => generated 289 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:23:59.154783 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777a4b9e-09ed-479b-8cc6-7379d3c8cfba None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:23:59.203666 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:23:59.265807 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777a4b9e-09ed-479b-8cc6-7379d3c8cfba None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:23:59.318137 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b57ba14-3879-4e9b-a556-c6857f8345cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:23:59.319099 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b57ba14-3879-4e9b-a556-c6857f8345cc None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:23:59.319388 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b57ba14-3879-4e9b-a556-c6857f8345cc None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:23:59.319665 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b57ba14-3879-4e9b-a556-c6857f8345cc None admin] PATH_INFO: `/v3/projects/86c6d2afd7954c56860744ef0c7dc36d` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:23:59.320951 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b57ba14-3879-4e9b-a556-c6857f8345cc None admin] RBAC: Authorizing `identity:get_project(project_id=86c6d2afd7954c56860744ef0c7dc36d)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:23:59.322551 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b57ba14-3879-4e9b-a556-c6857f8345cc None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:23:59.324685 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 77/147] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jul 14 09:23:59 2022] GET /identity/v3/projects/86c6d2afd7954c56860744ef0c7dc36d => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:23:59.330399 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b1eb2d-8c1a-40de-a8bc-b781bde1f1ea None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:23:59.357295 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69396e1e-8d00-45eb-a857-589d2a0c67bd None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:23:59.357560 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69396e1e-8d00-45eb-a857-589d2a0c67bd None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:23:59.357956 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69396e1e-8d00-45eb-a857-589d2a0c67bd None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:23:59.359465 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 78/148] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:23:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 09:23:59.365329 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a39485-a560-4a0e-817e-bc654b5133b1 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:23:59.365673 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a39485-a560-4a0e-817e-bc654b5133b1 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:23:59.366113 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a39485-a560-4a0e-817e-bc654b5133b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:23:59.391496 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-25a39485-a560-4a0e-817e-bc654b5133b1 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:23:59.393850 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-25a39485-a560-4a0e-817e-bc654b5133b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:23:59.552032 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 79/149] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:23:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 09:23:59.563695 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b1eb2d-8c1a-40de-a8bc-b781bde1f1ea None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:23:59.590179 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a39485-a560-4a0e-817e-bc654b5133b1 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:23:59.627498 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5d95d5-de26-461f-bdc9-5e3008b82087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:23:59.629240 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5d95d5-de26-461f-bdc9-5e3008b82087 None admin] REQUEST_METHOD: `PUT` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:23:59.629856 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5d95d5-de26-461f-bdc9-5e3008b82087 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:23:59.630508 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5d95d5-de26-461f-bdc9-5e3008b82087 None admin] PATH_INFO: `/v3/projects/86c6d2afd7954c56860744ef0c7dc36d/users/d0b2cf068f454a6280326e85a5a7bef0/roles/028a8869bb7b4891b03c0b6afcced73a` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:23:59.633873 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5d95d5-de26-461f-bdc9-5e3008b82087 None admin] RBAC: Authorizing `identity:create_grant(project_id=86c6d2afd7954c56860744ef0c7dc36d, user_id=d0b2cf068f454a6280326e85a5a7bef0, role_id=028a8869bb7b4891b03c0b6afcced73a)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:23:59.636236 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5d95d5-de26-461f-bdc9-5e3008b82087 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:23:59.656548 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 71/150] 10.222.0.40 () {58 vars in 1439 bytes} [Thu Jul 14 09:23:59 2022] PUT /identity/v3/projects/86c6d2afd7954c56860744ef0c7dc36d/users/d0b2cf068f454a6280326e85a5a7bef0/roles/028a8869bb7b4891b03c0b6afcced73a => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:23:59.688029 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:23:59.719295 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0af1e6-1188-4bca-ae45-98b1a98034e7 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:23:59.720084 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0af1e6-1188-4bca-ae45-98b1a98034e7 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:23:59.720715 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0af1e6-1188-4bca-ae45-98b1a98034e7 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:23:59.722370 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 72/151] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:23:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 09:23:59.728147 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250c0064-1e54-4930-8227-f77d6e39cda8 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:23:59.730105 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250c0064-1e54-4930-8227-f77d6e39cda8 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:23:59.730651 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250c0064-1e54-4930-8227-f77d6e39cda8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:23:59.752557 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:23:59.769550 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-250c0064-1e54-4930-8227-f77d6e39cda8 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:23:59.770850 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-250c0064-1e54-4930-8227-f77d6e39cda8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:23:59.782459 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a39485-a560-4a0e-817e-bc654b5133b1 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:23:59.871037 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb53845-2b74-46df-b56e-30252942c7cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:23:59.871779 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb53845-2b74-46df-b56e-30252942c7cd None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:23:59.872068 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb53845-2b74-46df-b56e-30252942c7cd None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:23:59.872346 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb53845-2b74-46df-b56e-30252942c7cd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:23:59.895790 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb53845-2b74-46df-b56e-30252942c7cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:23:59.904180 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-9bb53845-2b74-46df-b56e-30252942c7cd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 09:23:59.904180 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:23:59.904180 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:23:59.904180 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:23:59.904180 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:23:59.904180 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:23:59.904180 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:23:59.904180 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:23:59.904180 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:23:59.904180 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:23:59.904180 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:23:59.904180 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:23:59.904180 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:23:59.904180 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:23:59.904180 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:23:59.904180 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:23:59.905101 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:23:59.905101 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:23:59.905101 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:23:59.905101 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:23:59.905101 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:23:59.905101 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:23:59.905101 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:23:59.905101 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:23:59.905101 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:23:59.905101 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:23:59.905101 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:23:59.905101 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( Jul 14 09:23:59.905101 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:23:59.905101 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:23:59.905101 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:23:59.905101 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:23:59.905840 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:23:59.905840 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:23:59.905840 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:23:59.905840 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:23:59.905840 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:23:59.905840 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:23:59.905840 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:23:59.905840 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:23:59.905840 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:23:59.905840 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:23:59.905840 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 09:23:59.905840 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Jul 14 09:23:59.905840 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 80/152] 10.222.0.40 () {56 vars in 1096 bytes} [Thu Jul 14 09:23:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 09:23:59.918810 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 73/153] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:23:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 09:23:59.919072 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb53845-2b74-46df-b56e-30252942c7cd None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:23:59.966067 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250c0064-1e54-4930-8227-f77d6e39cda8 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:00.096762 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb53845-2b74-46df-b56e-30252942c7cd None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:00.099282 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:00.155420 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250c0064-1e54-4930-8227-f77d6e39cda8 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:00.163318 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0878c771-ae5a-48d1-8b03-3c67e4e64214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:00.164030 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0878c771-ae5a-48d1-8b03-3c67e4e64214 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:00.164324 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0878c771-ae5a-48d1-8b03-3c67e4e64214 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:00.164608 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0878c771-ae5a-48d1-8b03-3c67e4e64214 None admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:00.165389 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0878c771-ae5a-48d1-8b03-3c67e4e64214 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:24:00.165704 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0878c771-ae5a-48d1-8b03-3c67e4e64214 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:00.168071 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0878c771-ae5a-48d1-8b03-3c67e4e64214 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:00.182766 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 81/154] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 14 09:23:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:24:00.202474 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0878c771-ae5a-48d1-8b03-3c67e4e64214 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:00.205978 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a17ab0-19ff-41a3-bc81-484979b5ae6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:00.207079 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a17ab0-19ff-41a3-bc81-484979b5ae6a None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:00.207564 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a17ab0-19ff-41a3-bc81-484979b5ae6a None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:00.208033 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a17ab0-19ff-41a3-bc81-484979b5ae6a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:00.210242 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:00.235154 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a17ab0-19ff-41a3-bc81-484979b5ae6a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:24:00.243539 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-a7a17ab0-19ff-41a3-bc81-484979b5ae6a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 09:24:00.243539 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:24:00.243539 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:24:00.243539 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:24:00.243539 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:24:00.243539 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:24:00.243539 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:24:00.243539 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:24:00.243539 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:24:00.243539 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:24:00.243539 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:24:00.243539 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:24:00.243539 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:24:00.243539 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:24:00.243539 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:24:00.243539 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:24:00.244652 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:24:00.244652 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:24:00.244652 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:24:00.244652 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:24:00.244652 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:24:00.244652 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:24:00.244652 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:24:00.244652 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:24:00.244652 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:24:00.244652 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:24:00.244652 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:24:00.244652 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( Jul 14 09:24:00.244652 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:24:00.244652 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:24:00.244652 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:24:00.244652 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:24:00.245557 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:24:00.245557 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:24:00.245557 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:24:00.245557 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:24:00.245557 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:24:00.245557 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:24:00.245557 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:24:00.245557 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:24:00.245557 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:24:00.245557 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:24:00.245557 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 09:24:00.245557 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:24:00.252486 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 74/155] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 14 09:23:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 09:24:00.257842 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a17ab0-19ff-41a3-bc81-484979b5ae6a None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:00.345450 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0878c771-ae5a-48d1-8b03-3c67e4e64214 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:00.400351 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599c2688-c615-47c2-8c67-9a8e7220eee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:00.401245 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599c2688-c615-47c2-8c67-9a8e7220eee3 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:00.401534 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599c2688-c615-47c2-8c67-9a8e7220eee3 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:00.401818 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599c2688-c615-47c2-8c67-9a8e7220eee3 None admin] PATH_INFO: `/v3/users/d3cc085bb5914250a5e384092f9f12f8` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:00.405367 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599c2688-c615-47c2-8c67-9a8e7220eee3 None admin] RBAC: Authorizing `identity:get_user(user_id=d3cc085bb5914250a5e384092f9f12f8)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:00.407065 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599c2688-c615-47c2-8c67-9a8e7220eee3 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:00.408885 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 82/156] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jul 14 09:24:00 2022] GET /identity/v3/users/d3cc085bb5914250a5e384092f9f12f8 => generated 247 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:24:00.414408 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599c2688-c615-47c2-8c67-9a8e7220eee3 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:00.486885 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:00.549088 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a17ab0-19ff-41a3-bc81-484979b5ae6a None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:00.626911 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290a6d99-422d-4476-8eca-addfaa0de2d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:00.627653 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290a6d99-422d-4476-8eca-addfaa0de2d1 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:00.627887 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290a6d99-422d-4476-8eca-addfaa0de2d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:00.628166 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290a6d99-422d-4476-8eca-addfaa0de2d1 None admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:00.628940 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290a6d99-422d-4476-8eca-addfaa0de2d1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:24:00.629250 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290a6d99-422d-4476-8eca-addfaa0de2d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:00.630677 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290a6d99-422d-4476-8eca-addfaa0de2d1 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:00.646534 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 75/157] 10.222.0.40 () {56 vars in 1101 bytes} [Thu Jul 14 09:24:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 389 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:24:00.647498 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290a6d99-422d-4476-8eca-addfaa0de2d1 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:00.687282 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599c2688-c615-47c2-8c67-9a8e7220eee3 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:00.748865 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:00.782939 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055fe9e9-4664-4d2f-972d-85c3c4596b0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:00.783624 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055fe9e9-4664-4d2f-972d-85c3c4596b0c None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:00.783915 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055fe9e9-4664-4d2f-972d-85c3c4596b0c None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:00.784202 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055fe9e9-4664-4d2f-972d-85c3c4596b0c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:00.846055 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290a6d99-422d-4476-8eca-addfaa0de2d1 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:00.926709 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431f6b11-2e18-482b-8390-6a20493fd3ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:00.927629 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431f6b11-2e18-482b-8390-6a20493fd3ad None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:00.927915 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431f6b11-2e18-482b-8390-6a20493fd3ad None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:00.928193 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431f6b11-2e18-482b-8390-6a20493fd3ad None admin] PATH_INFO: `/v3/users/9c6423457ccf46e1b9988735408785f3` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:00.929574 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431f6b11-2e18-482b-8390-6a20493fd3ad None admin] RBAC: Authorizing `identity:get_user(user_id=9c6423457ccf46e1b9988735408785f3)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:00.931114 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431f6b11-2e18-482b-8390-6a20493fd3ad None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:00.933797 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 76/158] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jul 14 09:24:00 2022] GET /identity/v3/users/9c6423457ccf46e1b9988735408785f3 => generated 275 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:24:00.939576 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431f6b11-2e18-482b-8390-6a20493fd3ad None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:00.950237 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055fe9e9-4664-4d2f-972d-85c3c4596b0c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:00.951761 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055fe9e9-4664-4d2f-972d-85c3c4596b0c None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:01.019274 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:01.137965 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 83/159] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 14 09:24:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 724 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 14 09:24:01.156570 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055fe9e9-4664-4d2f-972d-85c3c4596b0c None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:01.212455 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431f6b11-2e18-482b-8390-6a20493fd3ad None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:01.287747 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:01.316494 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055fe9e9-4664-4d2f-972d-85c3c4596b0c None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:01.326046 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63438226-9419-4a35-8311-183e6196ec8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:01.327379 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63438226-9419-4a35-8311-183e6196ec8a None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:01.327883 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63438226-9419-4a35-8311-183e6196ec8a None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:01.328376 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63438226-9419-4a35-8311-183e6196ec8a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:01.362562 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:01.370933 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50136be8-e192-4d4f-a004-a9b705731326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:01.371887 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50136be8-e192-4d4f-a004-a9b705731326 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:01.372171 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50136be8-e192-4d4f-a004-a9b705731326 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:01.372456 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50136be8-e192-4d4f-a004-a9b705731326 None admin] PATH_INFO: `/v3/projects/86c6d2afd7954c56860744ef0c7dc36d` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:01.373827 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50136be8-e192-4d4f-a004-a9b705731326 None admin] RBAC: Authorizing `identity:get_project(project_id=86c6d2afd7954c56860744ef0c7dc36d)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:01.375408 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50136be8-e192-4d4f-a004-a9b705731326 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:01.381436 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 84/160] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jul 14 09:24:01 2022] GET /identity/v3/projects/86c6d2afd7954c56860744ef0c7dc36d => generated 298 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:24:01.407264 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50136be8-e192-4d4f-a004-a9b705731326 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:01.477817 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63438226-9419-4a35-8311-183e6196ec8a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:01.481131 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63438226-9419-4a35-8311-183e6196ec8a None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:01.566323 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50136be8-e192-4d4f-a004-a9b705731326 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:01.615453 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4472d9cd-e11d-4e52-bf1c-ce4d383702a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:01.616370 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4472d9cd-e11d-4e52-bf1c-ce4d383702a0 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:01.618814 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4472d9cd-e11d-4e52-bf1c-ce4d383702a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:01.619288 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4472d9cd-e11d-4e52-bf1c-ce4d383702a0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:01.620296 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4472d9cd-e11d-4e52-bf1c-ce4d383702a0 None admin] RBAC: Adding query filter params (role.id=e3965bd0d5f1427a86a313c0c90bfef3, scope.project.id=86c6d2afd7954c56860744ef0c7dc36d, user.id=d3cc085bb5914250a5e384092f9f12f8) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:24:01.620766 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4472d9cd-e11d-4e52-bf1c-ce4d383702a0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:01.622422 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4472d9cd-e11d-4e52-bf1c-ce4d383702a0 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:01.632034 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 77/161] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 14 09:24:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 693 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 09:24:01.633397 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af12e0a0-8288-4c1b-9e82-a44b9b756651 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:01.633690 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af12e0a0-8288-4c1b-9e82-a44b9b756651 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:01.633973 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af12e0a0-8288-4c1b-9e82-a44b9b756651 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:01.635806 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 78/162] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:24:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:24:01.642265 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 85/163] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jul 14 09:24:01 2022] GET /identity/v3/role_assignments?user.id=d3cc085bb5914250a5e384092f9f12f8&scope.project.id=86c6d2afd7954c56860744ef0c7dc36d&role.id=e3965bd0d5f1427a86a313c0c90bfef3 => generated 608 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:24:01.643729 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af12e0a0-8288-4c1b-9e82-a44b9b756651 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:01.645938 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3a2018-46c7-4db5-8864-e171e98928da None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:01.646270 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3a2018-46c7-4db5-8864-e171e98928da None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:01.646563 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3a2018-46c7-4db5-8864-e171e98928da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:01.668486 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-df3a2018-46c7-4db5-8864-e171e98928da None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:24:01.669989 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-df3a2018-46c7-4db5-8864-e171e98928da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:24:01.690618 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:01.778771 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:01.790354 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 86/164] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:24:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 09:24:01.796910 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67df6605-d8c7-4ae4-996a-5ed249941a93 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:01.797472 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67df6605-d8c7-4ae4-996a-5ed249941a93 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:01.797936 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67df6605-d8c7-4ae4-996a-5ed249941a93 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:01.799637 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 87/165] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:24:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 09:24:01.805518 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb867d97-6502-4069-8c87-7805b40811bd None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:01.806060 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb867d97-6502-4069-8c87-7805b40811bd None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:01.807155 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb867d97-6502-4069-8c87-7805b40811bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:01.817548 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af12e0a0-8288-4c1b-9e82-a44b9b756651 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:01.832717 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-eb867d97-6502-4069-8c87-7805b40811bd None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:24:01.834264 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-eb867d97-6502-4069-8c87-7805b40811bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:24:01.902960 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ea627e-ddbd-4be3-b57b-f221959b9b83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:01.910213 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ea627e-ddbd-4be3-b57b-f221959b9b83 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:01.910213 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ea627e-ddbd-4be3-b57b-f221959b9b83 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:01.910213 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ea627e-ddbd-4be3-b57b-f221959b9b83 None admin] PATH_INFO: `/v3/projects/86c6d2afd7954c56860744ef0c7dc36d` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:01.915135 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ea627e-ddbd-4be3-b57b-f221959b9b83 None admin] RBAC: Authorizing `identity:get_project(project_id=86c6d2afd7954c56860744ef0c7dc36d)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:01.917182 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ea627e-ddbd-4be3-b57b-f221959b9b83 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:01.919982 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 79/166] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jul 14 09:24:01 2022] GET /identity/v3/projects/86c6d2afd7954c56860744ef0c7dc36d => generated 298 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:24:01.919982 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ea627e-ddbd-4be3-b57b-f221959b9b83 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:01.950335 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 88/167] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:24:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 09:24:01.951561 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb867d97-6502-4069-8c87-7805b40811bd None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:02.075370 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ea627e-ddbd-4be3-b57b-f221959b9b83 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:02.078536 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:02.120688 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b32d1bf-0460-440b-89c0-bdaa511717db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:02.121558 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b32d1bf-0460-440b-89c0-bdaa511717db None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:02.121828 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b32d1bf-0460-440b-89c0-bdaa511717db None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:02.122173 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b32d1bf-0460-440b-89c0-bdaa511717db None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:02.128766 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb867d97-6502-4069-8c87-7805b40811bd None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:02.152008 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b32d1bf-0460-440b-89c0-bdaa511717db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:24:02.160494 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-1b32d1bf-0460-440b-89c0-bdaa511717db None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 09:24:02.160494 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:24:02.160494 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:24:02.160494 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:24:02.160494 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:24:02.160494 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:24:02.160494 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:24:02.160494 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:24:02.160494 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:24:02.160494 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:24:02.160494 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:24:02.160494 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:24:02.160494 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:24:02.160494 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:24:02.160494 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:24:02.160494 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:24:02.161638 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:24:02.161638 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:24:02.161638 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:24:02.161638 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:24:02.161638 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:24:02.161638 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:24:02.161638 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:24:02.161638 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:24:02.161638 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:24:02.161638 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:24:02.161638 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:24:02.161638 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( Jul 14 09:24:02.161638 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:24:02.161638 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:24:02.161638 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:24:02.161638 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:24:02.162840 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:24:02.162840 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:24:02.162840 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:24:02.162840 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:24:02.162840 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:24:02.162840 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:24:02.162840 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:24:02.162840 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:24:02.162840 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:24:02.162840 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:24:02.162840 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 09:24:02.162840 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:24:02.162840 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 80/168] 10.222.0.40 () {56 vars in 1114 bytes} [Thu Jul 14 09:24:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:24:02.162840 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b32d1bf-0460-440b-89c0-bdaa511717db None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:02.222556 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:02.250934 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9842220-680a-44d7-b284-9866b93a8e14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:02.251623 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9842220-680a-44d7-b284-9866b93a8e14 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:02.251911 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9842220-680a-44d7-b284-9866b93a8e14 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:02.252194 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9842220-680a-44d7-b284-9866b93a8e14 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:02.253170 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9842220-680a-44d7-b284-9866b93a8e14 None admin] RBAC: Adding query filter params (role.id=17dfac38a2e540fea229af7de99911bb, scope.project.id=86c6d2afd7954c56860744ef0c7dc36d, user.id=9c6423457ccf46e1b9988735408785f3) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:24:02.253490 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9842220-680a-44d7-b284-9866b93a8e14 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:02.255113 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9842220-680a-44d7-b284-9866b93a8e14 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:02.265810 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 89/169] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jul 14 09:24:01 2022] GET /identity/v3/role_assignments?user.id=9c6423457ccf46e1b9988735408785f3&scope.project.id=86c6d2afd7954c56860744ef0c7dc36d&role.id=17dfac38a2e540fea229af7de99911bb => generated 608 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:24:02.266783 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9842220-680a-44d7-b284-9866b93a8e14 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:02.280967 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b32d1bf-0460-440b-89c0-bdaa511717db None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:02.318793 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9285f16-be24-48ed-a110-c66eb0fecd75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:02.319613 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9285f16-be24-48ed-a110-c66eb0fecd75 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:02.319959 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9285f16-be24-48ed-a110-c66eb0fecd75 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:02.320242 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9285f16-be24-48ed-a110-c66eb0fecd75 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:02.332605 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9285f16-be24-48ed-a110-c66eb0fecd75 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:24:02.341640 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-f9285f16-be24-48ed-a110-c66eb0fecd75 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 09:24:02.341640 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:24:02.341640 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:24:02.341640 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:24:02.341640 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:24:02.341640 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:24:02.341640 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:24:02.341640 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:24:02.341640 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:24:02.341640 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:24:02.341640 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:24:02.341640 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:24:02.341640 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:24:02.341640 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:24:02.341640 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:24:02.341640 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:24:02.342752 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:24:02.342752 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:24:02.342752 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:24:02.342752 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:24:02.342752 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:24:02.342752 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:24:02.342752 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:24:02.342752 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:24:02.342752 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:24:02.342752 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:24:02.342752 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:24:02.342752 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( Jul 14 09:24:02.342752 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:24:02.342752 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:24:02.342752 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:24:02.342752 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:24:02.343526 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:24:02.343526 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:24:02.343526 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:24:02.343526 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:24:02.343526 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:24:02.343526 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:24:02.343526 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:24:02.343526 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:24:02.343526 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:24:02.343526 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:24:02.343526 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 09:24:02.343526 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:24:02.343526 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 81/170] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 14 09:24:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:24:02.349138 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9285f16-be24-48ed-a110-c66eb0fecd75 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:02.368180 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:02.490222 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9842220-680a-44d7-b284-9866b93a8e14 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:02.528518 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9285f16-be24-48ed-a110-c66eb0fecd75 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:02.546401 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1212846c-e383-4ab1-85f0-aca9f22f2c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:02.547470 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1212846c-e383-4ab1-85f0-aca9f22f2c06 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:02.547950 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1212846c-e383-4ab1-85f0-aca9f22f2c06 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:02.548953 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1212846c-e383-4ab1-85f0-aca9f22f2c06 None admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:02.550009 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1212846c-e383-4ab1-85f0-aca9f22f2c06 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:24:02.550872 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1212846c-e383-4ab1-85f0-aca9f22f2c06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:02.552692 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1212846c-e383-4ab1-85f0-aca9f22f2c06 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:02.569137 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 90/171] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jul 14 09:24:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:24:02.571375 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa989bcb-5c0b-4451-b2a5-40be8d20acef None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:02.572464 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa989bcb-5c0b-4451-b2a5-40be8d20acef None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:02.572948 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa989bcb-5c0b-4451-b2a5-40be8d20acef None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:02.574831 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 91/172] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:24:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:24:02.576160 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa989bcb-5c0b-4451-b2a5-40be8d20acef None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:02.612802 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8df5532-ac54-4a33-b1e9-0de54e81952b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:02.613413 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8df5532-ac54-4a33-b1e9-0de54e81952b None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:02.613700 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8df5532-ac54-4a33-b1e9-0de54e81952b None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:02.613980 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8df5532-ac54-4a33-b1e9-0de54e81952b None admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:02.614788 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8df5532-ac54-4a33-b1e9-0de54e81952b None admin] RBAC: Adding query filter params (name=member) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:24:02.615099 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8df5532-ac54-4a33-b1e9-0de54e81952b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:02.616502 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8df5532-ac54-4a33-b1e9-0de54e81952b None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:02.629112 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 82/173] 10.222.0.40 () {56 vars in 1101 bytes} [Thu Jul 14 09:24:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:24:02.634211 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb65a93c-8ef1-4f6a-ba9d-afd3c09ab611 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:02.634211 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb65a93c-8ef1-4f6a-ba9d-afd3c09ab611 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:02.634211 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb65a93c-8ef1-4f6a-ba9d-afd3c09ab611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:02.652979 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:02.657131 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-eb65a93c-8ef1-4f6a-ba9d-afd3c09ab611 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:24:02.658433 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-eb65a93c-8ef1-4f6a-ba9d-afd3c09ab611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:24:02.747780 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa989bcb-5c0b-4451-b2a5-40be8d20acef None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:02.775420 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 83/174] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:24:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 09:24:02.776159 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb65a93c-8ef1-4f6a-ba9d-afd3c09ab611 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:02.782370 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:02.814262 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce273fdb-0811-4027-a7db-4746dd16967c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:02.815416 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce273fdb-0811-4027-a7db-4746dd16967c None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:02.815709 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce273fdb-0811-4027-a7db-4746dd16967c None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:02.815987 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce273fdb-0811-4027-a7db-4746dd16967c None admin] PATH_INFO: `/v3/users/9c6423457ccf46e1b9988735408785f3` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:02.817475 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce273fdb-0811-4027-a7db-4746dd16967c None admin] RBAC: Authorizing `identity:get_user(user_id=9c6423457ccf46e1b9988735408785f3)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:02.821016 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce273fdb-0811-4027-a7db-4746dd16967c None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:02.824091 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 92/175] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jul 14 09:24:02 2022] GET /identity/v3/users/9c6423457ccf46e1b9988735408785f3 => generated 275 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:24:02.824794 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce273fdb-0811-4027-a7db-4746dd16967c None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:02.928592 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb65a93c-8ef1-4f6a-ba9d-afd3c09ab611 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:02.969112 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1ed100-fbc7-4595-8f4c-8c3d71bdd07d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:02.970275 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1ed100-fbc7-4595-8f4c-8c3d71bdd07d None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:02.970670 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1ed100-fbc7-4595-8f4c-8c3d71bdd07d None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:02.971398 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1ed100-fbc7-4595-8f4c-8c3d71bdd07d None admin] PATH_INFO: `/v3/users/9c6423457ccf46e1b9988735408785f3` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:02.972897 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1ed100-fbc7-4595-8f4c-8c3d71bdd07d None admin] RBAC: Authorizing `identity:get_user(user_id=9c6423457ccf46e1b9988735408785f3)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:02.975053 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1ed100-fbc7-4595-8f4c-8c3d71bdd07d None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:02.976916 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 84/176] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jul 14 09:24:02 2022] GET /identity/v3/users/9c6423457ccf46e1b9988735408785f3 => generated 275 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:24:02.978128 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1ed100-fbc7-4595-8f4c-8c3d71bdd07d None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:02.990314 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce273fdb-0811-4027-a7db-4746dd16967c None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:03.013122 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:03.036394 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9053d38d-546b-4596-8acd-1e48b0563ee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:03.037882 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9053d38d-546b-4596-8acd-1e48b0563ee2 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:03.038172 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9053d38d-546b-4596-8acd-1e48b0563ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:03.038477 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9053d38d-546b-4596-8acd-1e48b0563ee2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:03.053099 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9053d38d-546b-4596-8acd-1e48b0563ee2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:24:03.064780 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-9053d38d-546b-4596-8acd-1e48b0563ee2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 09:24:03.064780 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:24:03.064780 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:24:03.064780 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:24:03.064780 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:24:03.064780 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:24:03.064780 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:24:03.064780 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:24:03.064780 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:24:03.064780 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:24:03.064780 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:24:03.064780 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:24:03.064780 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:24:03.064780 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:24:03.064780 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:24:03.064780 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:24:03.065675 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:24:03.065675 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:24:03.065675 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:24:03.065675 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:24:03.065675 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:24:03.065675 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:24:03.065675 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:24:03.065675 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:24:03.065675 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:24:03.065675 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:24:03.065675 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:24:03.065675 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( Jul 14 09:24:03.065675 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:24:03.065675 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:24:03.065675 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:24:03.065675 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:24:03.066511 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:24:03.066511 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:24:03.066511 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:24:03.066511 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:24:03.066511 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:24:03.066511 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:24:03.066511 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:24:03.066511 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:24:03.066511 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:24:03.066511 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:24:03.066511 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 09:24:03.066511 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Jul 14 09:24:03.066511 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 93/177] 10.222.0.40 () {56 vars in 1096 bytes} [Thu Jul 14 09:24:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:24:03.067154 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:03.070458 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d153ed34-b959-413d-bd18-8e767578ef2c None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:03.070800 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d153ed34-b959-413d-bd18-8e767578ef2c None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:03.071089 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d153ed34-b959-413d-bd18-8e767578ef2c None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:03.072777 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 94/178] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:24:03 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:24:03.073540 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d153ed34-b959-413d-bd18-8e767578ef2c None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:03.108127 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1ed100-fbc7-4595-8f4c-8c3d71bdd07d None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:03.146156 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968923d2-7ae3-472b-b6e4-2e1b9c3dd2e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:03.146995 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968923d2-7ae3-472b-b6e4-2e1b9c3dd2e2 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:03.147287 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968923d2-7ae3-472b-b6e4-2e1b9c3dd2e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:03.147623 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968923d2-7ae3-472b-b6e4-2e1b9c3dd2e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:03.221385 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d153ed34-b959-413d-bd18-8e767578ef2c None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:03.223115 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968923d2-7ae3-472b-b6e4-2e1b9c3dd2e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:03.224604 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968923d2-7ae3-472b-b6e4-2e1b9c3dd2e2 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:03.263818 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5754735-8129-4815-bda2-63eed96e39c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:03.264483 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5754735-8129-4815-bda2-63eed96e39c7 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:03.264772 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5754735-8129-4815-bda2-63eed96e39c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:03.265051 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5754735-8129-4815-bda2-63eed96e39c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:03.318323 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:03.321818 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:03.355871 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5754735-8129-4815-bda2-63eed96e39c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:03.358476 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5754735-8129-4815-bda2-63eed96e39c7 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:03.365216 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 85/179] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 14 09:24:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 09:24:03.365216 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968923d2-7ae3-472b-b6e4-2e1b9c3dd2e2 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:03.482364 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 95/180] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 14 09:24:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 09:24:03.483681 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3d92f4-06f2-4b0b-97c3-efca9b9d7571 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:03.484078 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3d92f4-06f2-4b0b-97c3-efca9b9d7571 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:03.484483 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3d92f4-06f2-4b0b-97c3-efca9b9d7571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:03.493299 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968923d2-7ae3-472b-b6e4-2e1b9c3dd2e2 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:03.502406 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-7f3d92f4-06f2-4b0b-97c3-efca9b9d7571 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:24:03.503846 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-7f3d92f4-06f2-4b0b-97c3-efca9b9d7571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:24:03.541480 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477afbbf-12b8-4e77-9c30-19ef9f627f7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:03.542381 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477afbbf-12b8-4e77-9c30-19ef9f627f7a None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:03.542773 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477afbbf-12b8-4e77-9c30-19ef9f627f7a None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:03.543160 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477afbbf-12b8-4e77-9c30-19ef9f627f7a None admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:03.544053 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477afbbf-12b8-4e77-9c30-19ef9f627f7a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:24:03.544467 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477afbbf-12b8-4e77-9c30-19ef9f627f7a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:03.546110 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477afbbf-12b8-4e77-9c30-19ef9f627f7a None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:03.557027 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 86/181] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 14 09:24:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:24:03.558030 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477afbbf-12b8-4e77-9c30-19ef9f627f7a None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:03.598436 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 96/182] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:24:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 09:24:03.599902 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:03.603157 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3d92f4-06f2-4b0b-97c3-efca9b9d7571 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:03.614669 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:03.668908 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477afbbf-12b8-4e77-9c30-19ef9f627f7a None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:03.702273 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bb5785-e851-4d27-8e95-b5b7192079be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:03.702460 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3d92f4-06f2-4b0b-97c3-efca9b9d7571 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:03.703136 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bb5785-e851-4d27-8e95-b5b7192079be None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:03.703422 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bb5785-e851-4d27-8e95-b5b7192079be None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:03.703703 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bb5785-e851-4d27-8e95-b5b7192079be None admin] PATH_INFO: `/v3/projects/86c6d2afd7954c56860744ef0c7dc36d` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:03.704896 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bb5785-e851-4d27-8e95-b5b7192079be None admin] RBAC: Authorizing `identity:get_project(project_id=86c6d2afd7954c56860744ef0c7dc36d)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:03.706389 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bb5785-e851-4d27-8e95-b5b7192079be None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:03.708089 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 87/183] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jul 14 09:24:03 2022] GET /identity/v3/projects/86c6d2afd7954c56860744ef0c7dc36d => generated 298 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:24:03.708851 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bb5785-e851-4d27-8e95-b5b7192079be None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:03.736926 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7f426d-8eab-45b2-b3c9-853a20e4cdf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:03.737711 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7f426d-8eab-45b2-b3c9-853a20e4cdf3 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:03.737992 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7f426d-8eab-45b2-b3c9-853a20e4cdf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:03.738304 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7f426d-8eab-45b2-b3c9-853a20e4cdf3 None admin] PATH_INFO: `/v3/projects/934d49a6ee1f43e6906f74cc5c8cd171` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:03.739485 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7f426d-8eab-45b2-b3c9-853a20e4cdf3 None admin] RBAC: Authorizing `identity:get_project(project_id=934d49a6ee1f43e6906f74cc5c8cd171)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:03.740942 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7f426d-8eab-45b2-b3c9-853a20e4cdf3 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:03.742675 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 97/184] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jul 14 09:24:03 2022] GET /identity/v3/projects/934d49a6ee1f43e6906f74cc5c8cd171 => generated 312 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:24:03.744128 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f163b4-63aa-4ba6-88fb-aed0c8296722 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:03.744415 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f163b4-63aa-4ba6-88fb-aed0c8296722 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:03.744692 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f163b4-63aa-4ba6-88fb-aed0c8296722 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:03.745910 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 98/185] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:24:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:24:03.750209 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130f84df-9af1-4900-8bae-7dac86c1352b None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:03.750209 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130f84df-9af1-4900-8bae-7dac86c1352b None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:03.750209 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130f84df-9af1-4900-8bae-7dac86c1352b None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:03.750209 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 99/186] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:24:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:24:03.750209 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130f84df-9af1-4900-8bae-7dac86c1352b None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:03.820547 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bb5785-e851-4d27-8e95-b5b7192079be None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:03.822737 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:03.827540 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:03.851454 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130f84df-9af1-4900-8bae-7dac86c1352b None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:03.854924 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0deae4-6824-49ff-a01b-dbf03df51a7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:03.855803 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0deae4-6824-49ff-a01b-dbf03df51a7f None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:03.856092 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0deae4-6824-49ff-a01b-dbf03df51a7f None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:03.856373 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0deae4-6824-49ff-a01b-dbf03df51a7f None admin] PATH_INFO: `/v3/users/3b9b6daa2c6d479388c1fe642b1b1004` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:03.869889 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0deae4-6824-49ff-a01b-dbf03df51a7f None admin] RBAC: Authorizing `identity:get_user(user_id=3b9b6daa2c6d479388c1fe642b1b1004)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:03.871417 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0deae4-6824-49ff-a01b-dbf03df51a7f None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:03.873095 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 88/187] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jul 14 09:24:03 2022] GET /identity/v3/users/3b9b6daa2c6d479388c1fe642b1b1004 => generated 283 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:24:03.873866 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0deae4-6824-49ff-a01b-dbf03df51a7f None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:03.885887 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec612284-f6b9-4a57-911e-b95d87e8d9e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:03.886736 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec612284-f6b9-4a57-911e-b95d87e8d9e3 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:03.887022 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec612284-f6b9-4a57-911e-b95d87e8d9e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:03.887297 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec612284-f6b9-4a57-911e-b95d87e8d9e3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:03.897783 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec612284-f6b9-4a57-911e-b95d87e8d9e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:24:03.906558 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-ec612284-f6b9-4a57-911e-b95d87e8d9e3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 09:24:03.906558 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:24:03.906558 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:24:03.906558 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:24:03.906558 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:24:03.906558 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:24:03.906558 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:24:03.906558 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:24:03.906558 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:24:03.906558 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:24:03.906558 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:24:03.906558 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:24:03.906558 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:24:03.906558 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:24:03.906558 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:24:03.906558 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:24:03.907500 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:24:03.907500 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:24:03.907500 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:24:03.907500 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:24:03.907500 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:24:03.907500 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:24:03.907500 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:24:03.907500 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:24:03.907500 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:24:03.907500 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:24:03.907500 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:24:03.907500 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( Jul 14 09:24:03.907500 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:24:03.907500 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:24:03.907500 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:24:03.907500 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:24:03.908261 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:24:03.908261 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:24:03.908261 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:24:03.908261 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:24:03.908261 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:24:03.908261 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:24:03.908261 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:24:03.908261 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:24:03.908261 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:24:03.908261 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:24:03.908261 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 09:24:03.908261 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Jul 14 09:24:03.908261 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 100/188] 10.222.0.40 () {56 vars in 1114 bytes} [Thu Jul 14 09:24:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:24:03.911075 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec612284-f6b9-4a57-911e-b95d87e8d9e3 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:03.978149 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0deae4-6824-49ff-a01b-dbf03df51a7f None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:04.011380 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec612284-f6b9-4a57-911e-b95d87e8d9e3 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:04.011544 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f40b583-9a43-473d-9cc6-0b91950740cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:04.012257 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f40b583-9a43-473d-9cc6-0b91950740cb None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:04.012540 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f40b583-9a43-473d-9cc6-0b91950740cb None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:04.012823 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f40b583-9a43-473d-9cc6-0b91950740cb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:04.013664 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f40b583-9a43-473d-9cc6-0b91950740cb None admin] RBAC: Adding query filter params (role.id=f755c764373f47bababa1e942a53c2e1, scope.project.id=86c6d2afd7954c56860744ef0c7dc36d, user.id=9c6423457ccf46e1b9988735408785f3) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:24:04.013979 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f40b583-9a43-473d-9cc6-0b91950740cb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:04.015461 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f40b583-9a43-473d-9cc6-0b91950740cb None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:04.021291 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 89/189] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jul 14 09:24:03 2022] GET /identity/v3/role_assignments?user.id=9c6423457ccf46e1b9988735408785f3&scope.project.id=86c6d2afd7954c56860744ef0c7dc36d&role.id=f755c764373f47bababa1e942a53c2e1 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:24:04.022501 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6c6ee0-a54c-4b00-9c47-065ae777ca10 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:04.022790 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6c6ee0-a54c-4b00-9c47-065ae777ca10 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:04.023069 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6c6ee0-a54c-4b00-9c47-065ae777ca10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:04.041143 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-5a6c6ee0-a54c-4b00-9c47-065ae777ca10 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:24:04.042662 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-5a6c6ee0-a54c-4b00-9c47-065ae777ca10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:24:04.061500 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5e81ff-9524-4d9f-96d7-75e1c431f615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:04.062182 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5e81ff-9524-4d9f-96d7-75e1c431f615 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:04.062496 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5e81ff-9524-4d9f-96d7-75e1c431f615 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:04.062775 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5e81ff-9524-4d9f-96d7-75e1c431f615 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:04.062864 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:04.063716 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5e81ff-9524-4d9f-96d7-75e1c431f615 None admin] RBAC: Adding query filter params (role.id=17dfac38a2e540fea229af7de99911bb, scope.project.id=934d49a6ee1f43e6906f74cc5c8cd171, user.id=9c6423457ccf46e1b9988735408785f3) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:24:04.063974 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5e81ff-9524-4d9f-96d7-75e1c431f615 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:04.065614 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5e81ff-9524-4d9f-96d7-75e1c431f615 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:04.069694 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:04.086573 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 101/190] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jul 14 09:24:03 2022] GET /identity/v3/role_assignments?user.id=9c6423457ccf46e1b9988735408785f3&scope.project.id=934d49a6ee1f43e6906f74cc5c8cd171&role.id=17dfac38a2e540fea229af7de99911bb => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:24:04.088606 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ef89c7-08ea-4284-9fe0-2488aef58b8e None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:04.088899 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ef89c7-08ea-4284-9fe0-2488aef58b8e None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:04.089182 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ef89c7-08ea-4284-9fe0-2488aef58b8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:04.117560 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-31ef89c7-08ea-4284-9fe0-2488aef58b8e None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:24:04.120940 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-31ef89c7-08ea-4284-9fe0-2488aef58b8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:24:04.129793 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 90/191] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:24:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 09:24:04.136439 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6c6ee0-a54c-4b00-9c47-065ae777ca10 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:04.242335 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 102/192] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:24:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 09:24:04.243412 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ef89c7-08ea-4284-9fe0-2488aef58b8e None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:04.286078 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6c6ee0-a54c-4b00-9c47-065ae777ca10 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:04.329290 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206f9065-a877-4e1a-9367-b1a735fb0fdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:04.329959 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206f9065-a877-4e1a-9367-b1a735fb0fdb None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:04.330300 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206f9065-a877-4e1a-9367-b1a735fb0fdb None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:04.330589 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206f9065-a877-4e1a-9367-b1a735fb0fdb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:04.358300 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:04.376874 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ef89c7-08ea-4284-9fe0-2488aef58b8e None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:04.402505 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206f9065-a877-4e1a-9367-b1a735fb0fdb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:04.404322 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206f9065-a877-4e1a-9367-b1a735fb0fdb None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:04.405292 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:04.411366 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca42b6d7-9a34-44c5-85b0-30c3c16921ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:04.412045 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca42b6d7-9a34-44c5-85b0-30c3c16921ac None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:04.412335 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca42b6d7-9a34-44c5-85b0-30c3c16921ac None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:04.412626 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca42b6d7-9a34-44c5-85b0-30c3c16921ac None admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:04.413392 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca42b6d7-9a34-44c5-85b0-30c3c16921ac None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:24:04.413702 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca42b6d7-9a34-44c5-85b0-30c3c16921ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:04.415110 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca42b6d7-9a34-44c5-85b0-30c3c16921ac None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:04.423708 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 103/193] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jul 14 09:24:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:24:04.424507 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca42b6d7-9a34-44c5-85b0-30c3c16921ac None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:04.504740 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 91/194] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 14 09:24:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 09:24:04.505585 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206f9065-a877-4e1a-9367-b1a735fb0fdb None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:04.529042 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca42b6d7-9a34-44c5-85b0-30c3c16921ac None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:04.560720 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:04.563057 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e34e00f-9dbb-4c07-b6b5-2b9e05cd1636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:04.563870 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e34e00f-9dbb-4c07-b6b5-2b9e05cd1636 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:04.564157 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e34e00f-9dbb-4c07-b6b5-2b9e05cd1636 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:04.564438 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e34e00f-9dbb-4c07-b6b5-2b9e05cd1636 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:04.565661 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e34e00f-9dbb-4c07-b6b5-2b9e05cd1636 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:04.567178 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e34e00f-9dbb-4c07-b6b5-2b9e05cd1636 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:04.568818 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 104/195] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 09:24:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:24:04.569581 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e34e00f-9dbb-4c07-b6b5-2b9e05cd1636 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:04.606760 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206f9065-a877-4e1a-9367-b1a735fb0fdb None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:04.632602 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:04.646430 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446974f8-379e-4027-be97-ae44c23a9d4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:04.647232 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446974f8-379e-4027-be97-ae44c23a9d4c None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:04.647517 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446974f8-379e-4027-be97-ae44c23a9d4c None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:04.647847 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446974f8-379e-4027-be97-ae44c23a9d4c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:04.658474 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446974f8-379e-4027-be97-ae44c23a9d4c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:24:04.666170 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-446974f8-379e-4027-be97-ae44c23a9d4c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 09:24:04.666170 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:24:04.666170 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:24:04.666170 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:24:04.666170 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:24:04.666170 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:24:04.666170 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:24:04.666170 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:24:04.666170 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:24:04.666170 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:24:04.666170 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:24:04.666170 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:24:04.666170 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:24:04.666170 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:24:04.666170 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:24:04.666170 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:24:04.667248 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:24:04.667248 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:24:04.667248 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:24:04.667248 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:24:04.667248 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:24:04.667248 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:24:04.667248 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:24:04.667248 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:24:04.667248 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:24:04.667248 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:24:04.667248 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:24:04.667248 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( Jul 14 09:24:04.667248 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:24:04.667248 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:24:04.667248 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:24:04.667248 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:24:04.668199 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:24:04.668199 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:24:04.668199 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:24:04.668199 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:24:04.668199 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:24:04.668199 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:24:04.668199 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:24:04.668199 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:24:04.668199 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:24:04.668199 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:24:04.668199 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 09:24:04.668199 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:24:04.668199 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 92/196] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 14 09:24:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:24:04.668199 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446974f8-379e-4027-be97-ae44c23a9d4c None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:04.679799 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e34e00f-9dbb-4c07-b6b5-2b9e05cd1636 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:04.715189 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed81109-b80a-4ba8-aceb-f759c326d617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:04.716069 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed81109-b80a-4ba8-aceb-f759c326d617 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:04.716354 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed81109-b80a-4ba8-aceb-f759c326d617 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:04.716631 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed81109-b80a-4ba8-aceb-f759c326d617 None admin] PATH_INFO: `/v3/users/3b9b6daa2c6d479388c1fe642b1b1004` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:04.717832 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed81109-b80a-4ba8-aceb-f759c326d617 None admin] RBAC: Authorizing `identity:get_user(user_id=3b9b6daa2c6d479388c1fe642b1b1004)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:04.719323 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed81109-b80a-4ba8-aceb-f759c326d617 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:04.720961 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 105/197] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jul 14 09:24:04 2022] GET /identity/v3/users/3b9b6daa2c6d479388c1fe642b1b1004 => generated 283 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:24:04.725512 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed81109-b80a-4ba8-aceb-f759c326d617 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:04.767706 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446974f8-379e-4027-be97-ae44c23a9d4c None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:04.783212 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:04.810933 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e23dde-8401-4f1d-8cc7-3e5d4a862a0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:04.811831 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e23dde-8401-4f1d-8cc7-3e5d4a862a0b None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:04.812121 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e23dde-8401-4f1d-8cc7-3e5d4a862a0b None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:04.812401 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e23dde-8401-4f1d-8cc7-3e5d4a862a0b None admin] PATH_INFO: `/v3/projects/37e686c883dc4b19bd52b4543bcb33e2` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:04.813670 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e23dde-8401-4f1d-8cc7-3e5d4a862a0b None admin] RBAC: Authorizing `identity:get_project(project_id=37e686c883dc4b19bd52b4543bcb33e2)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:04.815189 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e23dde-8401-4f1d-8cc7-3e5d4a862a0b None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:04.818396 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 93/198] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jul 14 09:24:04 2022] GET /identity/v3/projects/37e686c883dc4b19bd52b4543bcb33e2 => generated 302 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:24:04.818396 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e23dde-8401-4f1d-8cc7-3e5d4a862a0b None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:04.827427 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed81109-b80a-4ba8-aceb-f759c326d617 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:04.853522 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:04.862030 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee584e69-6d66-4c2f-b9d8-6b5624cc8644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:04.862780 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee584e69-6d66-4c2f-b9d8-6b5624cc8644 None admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:04.863064 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee584e69-6d66-4c2f-b9d8-6b5624cc8644 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:04.863341 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee584e69-6d66-4c2f-b9d8-6b5624cc8644 None admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:04.864056 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee584e69-6d66-4c2f-b9d8-6b5624cc8644 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:04.865501 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee584e69-6d66-4c2f-b9d8-6b5624cc8644 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:04.885718 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 106/199] 10.222.0.40 () {60 vars in 1132 bytes} [Thu Jul 14 09:24:04 2022] POST /identity/v3/users => generated 297 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:24:04.886640 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee584e69-6d66-4c2f-b9d8-6b5624cc8644 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:04.935338 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e23dde-8401-4f1d-8cc7-3e5d4a862a0b None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:04.975847 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea73571-6d85-469d-b232-7aea1b97b65b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:04.976566 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea73571-6d85-469d-b232-7aea1b97b65b None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:04.976978 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea73571-6d85-469d-b232-7aea1b97b65b None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:04.977257 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea73571-6d85-469d-b232-7aea1b97b65b None admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:04.978218 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea73571-6d85-469d-b232-7aea1b97b65b None admin] RBAC: Adding query filter params (name=reader) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:24:04.978523 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea73571-6d85-469d-b232-7aea1b97b65b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:04.980320 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea73571-6d85-469d-b232-7aea1b97b65b None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:04.990516 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 94/200] 10.222.0.40 () {56 vars in 1101 bytes} [Thu Jul 14 09:24:04 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:24:04.991556 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea73571-6d85-469d-b232-7aea1b97b65b None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:05.010752 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee584e69-6d66-4c2f-b9d8-6b5624cc8644 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:05.046783 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f5e6b6-64f7-4ef1-9613-f4673001929d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:05.046986 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:05.047449 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f5e6b6-64f7-4ef1-9613-f4673001929d None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:05.047731 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f5e6b6-64f7-4ef1-9613-f4673001929d None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:05.048011 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f5e6b6-64f7-4ef1-9613-f4673001929d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:05.111483 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:05.116781 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea73571-6d85-469d-b232-7aea1b97b65b None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:05.133454 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f5e6b6-64f7-4ef1-9613-f4673001929d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:05.135562 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f5e6b6-64f7-4ef1-9613-f4673001929d None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:05.170339 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3af2842-389a-46e3-8629-735ab6662f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:05.171022 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3af2842-389a-46e3-8629-735ab6662f20 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:05.171307 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3af2842-389a-46e3-8629-735ab6662f20 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:05.171584 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3af2842-389a-46e3-8629-735ab6662f20 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:05.172457 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3af2842-389a-46e3-8629-735ab6662f20 None admin] RBAC: Adding query filter params (role.id=e3965bd0d5f1427a86a313c0c90bfef3, scope.project.id=37e686c883dc4b19bd52b4543bcb33e2, user.id=3b9b6daa2c6d479388c1fe642b1b1004) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:24:05.172743 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3af2842-389a-46e3-8629-735ab6662f20 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:05.174313 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3af2842-389a-46e3-8629-735ab6662f20 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:05.182259 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 95/201] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jul 14 09:24:04 2022] GET /identity/v3/role_assignments?user.id=3b9b6daa2c6d479388c1fe642b1b1004&scope.project.id=37e686c883dc4b19bd52b4543bcb33e2&role.id=e3965bd0d5f1427a86a313c0c90bfef3 => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:24:05.182652 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3af2842-389a-46e3-8629-735ab6662f20 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:05.308682 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 107/202] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 14 09:24:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 09:24:05.309681 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f5e6b6-64f7-4ef1-9613-f4673001929d None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:05.390100 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3af2842-389a-46e3-8629-735ab6662f20 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:05.403785 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:05.426571 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:05.460982 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f5e6b6-64f7-4ef1-9613-f4673001929d None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:05.470919 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba460e3-fb5e-4e91-a04c-c7d7e2c3c64b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:05.471817 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba460e3-fb5e-4e91-a04c-c7d7e2c3c64b None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:05.472103 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba460e3-fb5e-4e91-a04c-c7d7e2c3c64b None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:05.472380 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba460e3-fb5e-4e91-a04c-c7d7e2c3c64b None admin] PATH_INFO: `/v3/users/d0b2cf068f454a6280326e85a5a7bef0` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:05.473675 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba460e3-fb5e-4e91-a04c-c7d7e2c3c64b None admin] RBAC: Authorizing `identity:get_user(user_id=d0b2cf068f454a6280326e85a5a7bef0)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:05.475156 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba460e3-fb5e-4e91-a04c-c7d7e2c3c64b None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:05.476811 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 96/203] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jul 14 09:24:05 2022] GET /identity/v3/users/d0b2cf068f454a6280326e85a5a7bef0 => generated 289 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:24:05.482860 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba460e3-fb5e-4e91-a04c-c7d7e2c3c64b None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:05.514085 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b20630-55cc-4393-903d-55f272ff5cc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:05.515250 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b20630-55cc-4393-903d-55f272ff5cc3 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:05.515687 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b20630-55cc-4393-903d-55f272ff5cc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:05.516139 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b20630-55cc-4393-903d-55f272ff5cc3 None admin] PATH_INFO: `/v3/projects/37e686c883dc4b19bd52b4543bcb33e2` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:05.517627 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b20630-55cc-4393-903d-55f272ff5cc3 None admin] RBAC: Authorizing `identity:get_project(project_id=37e686c883dc4b19bd52b4543bcb33e2)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:05.519288 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b20630-55cc-4393-903d-55f272ff5cc3 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:05.521185 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 108/204] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jul 14 09:24:05 2022] GET /identity/v3/projects/37e686c883dc4b19bd52b4543bcb33e2 => generated 302 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:24:05.531405 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b20630-55cc-4393-903d-55f272ff5cc3 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:05.667578 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba460e3-fb5e-4e91-a04c-c7d7e2c3c64b None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:05.687894 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b20630-55cc-4393-903d-55f272ff5cc3 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:05.722856 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95fda07-7db9-4f60-b402-85e464531993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:05.725183 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95fda07-7db9-4f60-b402-85e464531993 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:05.726537 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95fda07-7db9-4f60-b402-85e464531993 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:05.726984 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95fda07-7db9-4f60-b402-85e464531993 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:05.760332 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6862d973-ba5a-42e9-a85a-8456f84351a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:05.762771 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6862d973-ba5a-42e9-a85a-8456f84351a4 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:05.763473 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6862d973-ba5a-42e9-a85a-8456f84351a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:05.764061 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6862d973-ba5a-42e9-a85a-8456f84351a4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:05.766577 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6862d973-ba5a-42e9-a85a-8456f84351a4 None admin] RBAC: Adding query filter params (role.id=f755c764373f47bababa1e942a53c2e1, scope.project.id=37e686c883dc4b19bd52b4543bcb33e2, user.id=3b9b6daa2c6d479388c1fe642b1b1004) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:24:05.767852 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6862d973-ba5a-42e9-a85a-8456f84351a4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:05.769335 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6862d973-ba5a-42e9-a85a-8456f84351a4 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:05.775998 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 109/205] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jul 14 09:24:05 2022] GET /identity/v3/role_assignments?user.id=3b9b6daa2c6d479388c1fe642b1b1004&scope.project.id=37e686c883dc4b19bd52b4543bcb33e2&role.id=f755c764373f47bababa1e942a53c2e1 => generated 259 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:24:05.800371 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:05.860951 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95fda07-7db9-4f60-b402-85e464531993 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:05.863112 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95fda07-7db9-4f60-b402-85e464531993 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:06.016140 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 97/206] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 14 09:24:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 534 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 14 09:24:06.026097 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6862d973-ba5a-42e9-a85a-8456f84351a4 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:06.082591 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:06.255193 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6862d973-ba5a-42e9-a85a-8456f84351a4 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:06.296713 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570adf3e-a3d0-4486-8234-22d6eee756fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:06.297979 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570adf3e-a3d0-4486-8234-22d6eee756fb None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:06.298539 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570adf3e-a3d0-4486-8234-22d6eee756fb None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:06.299033 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570adf3e-a3d0-4486-8234-22d6eee756fb None admin] PATH_INFO: `/v3/projects/86c6d2afd7954c56860744ef0c7dc36d` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:06.300436 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570adf3e-a3d0-4486-8234-22d6eee756fb None admin] RBAC: Authorizing `identity:get_project(project_id=86c6d2afd7954c56860744ef0c7dc36d)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:06.302070 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570adf3e-a3d0-4486-8234-22d6eee756fb None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:06.308889 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 110/207] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jul 14 09:24:06 2022] GET /identity/v3/projects/86c6d2afd7954c56860744ef0c7dc36d => generated 298 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:24:06.311273 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95fda07-7db9-4f60-b402-85e464531993 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:06.426154 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:06.457652 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95fda07-7db9-4f60-b402-85e464531993 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:06.501172 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f83106-245a-4ef6-8732-1556472e46d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:06.501850 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f83106-245a-4ef6-8732-1556472e46d1 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:06.502140 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f83106-245a-4ef6-8732-1556472e46d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:06.502452 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f83106-245a-4ef6-8732-1556472e46d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:06.503308 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f83106-245a-4ef6-8732-1556472e46d1 None admin] RBAC: Adding query filter params (role.id=028a8869bb7b4891b03c0b6afcced73a, scope.project.id=86c6d2afd7954c56860744ef0c7dc36d, user.id=d0b2cf068f454a6280326e85a5a7bef0) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:24:06.503628 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f83106-245a-4ef6-8732-1556472e46d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:06.505110 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f83106-245a-4ef6-8732-1556472e46d1 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:06.515661 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 98/208] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jul 14 09:24:06 2022] GET /identity/v3/role_assignments?user.id=d0b2cf068f454a6280326e85a5a7bef0&scope.project.id=86c6d2afd7954c56860744ef0c7dc36d&role.id=028a8869bb7b4891b03c0b6afcced73a => generated 608 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:24:07.370125 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f4518f-c32c-4b33-8322-85a29d191a60 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:07.370679 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f4518f-c32c-4b33-8322-85a29d191a60 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:07.370756 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f4518f-c32c-4b33-8322-85a29d191a60 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:07.372298 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 111/209] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:24:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:24:07.377913 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c219e7-9f45-4df5-8621-e1331f673886 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:07.378813 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c219e7-9f45-4df5-8621-e1331f673886 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:07.379299 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c219e7-9f45-4df5-8621-e1331f673886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:07.396694 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-b8c219e7-9f45-4df5-8621-e1331f673886 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:24:07.398239 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-b8c219e7-9f45-4df5-8621-e1331f673886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:24:07.471519 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 99/210] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:24:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 09:24:07.483288 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d6efcb-4b73-478b-b25f-67f7adf038d0 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:07.483288 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d6efcb-4b73-478b-b25f-67f7adf038d0 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:07.483288 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d6efcb-4b73-478b-b25f-67f7adf038d0 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:07.483288 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 112/211] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:24:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:24:07.487173 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1e8404-c1f7-43e0-9a35-85a482eb2c6a None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:07.487700 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1e8404-c1f7-43e0-9a35-85a482eb2c6a None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:07.488180 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1e8404-c1f7-43e0-9a35-85a482eb2c6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:07.496688 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d6efcb-4b73-478b-b25f-67f7adf038d0 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:07.506665 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-4f1e8404-c1f7-43e0-9a35-85a482eb2c6a None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:24:07.508132 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-4f1e8404-c1f7-43e0-9a35-85a482eb2c6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:24:07.582445 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 100/212] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:24:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 09:24:07.582979 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:07.595700 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:07.605614 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1e8404-c1f7-43e0-9a35-85a482eb2c6a None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:07.613511 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d6efcb-4b73-478b-b25f-67f7adf038d0 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:07.648692 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb02968b-6cdf-47a3-ad48-1e5bdc8a15b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:07.649416 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb02968b-6cdf-47a3-ad48-1e5bdc8a15b8 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:07.649700 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb02968b-6cdf-47a3-ad48-1e5bdc8a15b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:07.650532 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb02968b-6cdf-47a3-ad48-1e5bdc8a15b8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:07.661787 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb02968b-6cdf-47a3-ad48-1e5bdc8a15b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:24:07.671845 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-cb02968b-6cdf-47a3-ad48-1e5bdc8a15b8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 09:24:07.671845 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:24:07.671845 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:24:07.671845 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:24:07.671845 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:24:07.671845 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:24:07.671845 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:24:07.671845 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:24:07.671845 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:24:07.671845 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:24:07.671845 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:24:07.671845 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:24:07.671845 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:24:07.671845 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:24:07.671845 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:24:07.671845 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:24:07.677059 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:24:07.677059 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:24:07.677059 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:24:07.677059 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:24:07.677059 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:24:07.677059 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:24:07.677059 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:24:07.677059 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:24:07.677059 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:24:07.677059 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:24:07.677059 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:24:07.677059 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( Jul 14 09:24:07.677059 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:24:07.677059 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:24:07.677059 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:24:07.677059 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:24:07.680622 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:24:07.680622 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:24:07.680622 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:24:07.680622 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:24:07.680622 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:24:07.680622 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:24:07.680622 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:24:07.680622 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:24:07.680622 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:24:07.680622 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:24:07.680622 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 09:24:07.680622 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Jul 14 09:24:07.680622 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 113/213] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 14 09:24:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 09:24:07.680622 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cd60e6-53e5-46a9-bbd3-45c79a5372e3 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:07.681789 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cd60e6-53e5-46a9-bbd3-45c79a5372e3 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:07.681789 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cd60e6-53e5-46a9-bbd3-45c79a5372e3 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:07.681789 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 114/214] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:24:07 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:24:07.681789 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cd60e6-53e5-46a9-bbd3-45c79a5372e3 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:07.727265 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1e8404-c1f7-43e0-9a35-85a482eb2c6a None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:07.763932 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffae29a-12da-464d-bc2c-be066c38d231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:07.764739 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffae29a-12da-464d-bc2c-be066c38d231 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:07.765009 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffae29a-12da-464d-bc2c-be066c38d231 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:07.765283 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffae29a-12da-464d-bc2c-be066c38d231 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:07.777748 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffae29a-12da-464d-bc2c-be066c38d231 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:24:07.786374 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cd60e6-53e5-46a9-bbd3-45c79a5372e3 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:07.787276 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-fffae29a-12da-464d-bc2c-be066c38d231 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 09:24:07.787276 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:24:07.787276 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:24:07.787276 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:24:07.787276 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:24:07.787276 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:24:07.787276 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:24:07.787276 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:24:07.787276 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:24:07.787276 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:24:07.787276 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:24:07.787276 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:24:07.787276 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:24:07.787276 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:24:07.787276 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:24:07.787276 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:24:07.788108 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:24:07.788108 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:24:07.788108 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:24:07.788108 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:24:07.788108 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:24:07.788108 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:24:07.788108 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:24:07.788108 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:24:07.788108 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:24:07.788108 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:24:07.788108 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:24:07.788108 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( Jul 14 09:24:07.788108 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:24:07.788108 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:24:07.788108 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:24:07.788108 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:24:07.788898 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:24:07.788898 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:24:07.788898 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:24:07.788898 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:24:07.788898 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:24:07.788898 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:24:07.788898 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:24:07.788898 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:24:07.788898 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:24:07.788898 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:24:07.788898 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 09:24:07.788898 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:24:07.794842 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 101/215] 10.222.0.40 () {56 vars in 1096 bytes} [Thu Jul 14 09:24:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:24:07.795993 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f65ef76-091c-46f9-b66a-ed83fb252a14 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:07.796284 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f65ef76-091c-46f9-b66a-ed83fb252a14 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:07.796564 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f65ef76-091c-46f9-b66a-ed83fb252a14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:07.814298 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-4f65ef76-091c-46f9-b66a-ed83fb252a14 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:24:07.815485 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-4f65ef76-091c-46f9-b66a-ed83fb252a14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:24:07.823722 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6603555-019a-4223-af73-986d01160d7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:07.824407 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6603555-019a-4223-af73-986d01160d7c None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:07.824703 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6603555-019a-4223-af73-986d01160d7c None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:07.825349 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6603555-019a-4223-af73-986d01160d7c None admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:07.826120 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6603555-019a-4223-af73-986d01160d7c None admin] RBAC: Adding query filter params (name=member) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:24:07.826782 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6603555-019a-4223-af73-986d01160d7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:07.828171 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6603555-019a-4223-af73-986d01160d7c None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:07.838651 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 115/216] 10.222.0.40 () {56 vars in 1101 bytes} [Thu Jul 14 09:24:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:24:07.839279 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6603555-019a-4223-af73-986d01160d7c None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:07.849183 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:07.883522 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:07.897839 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 102/217] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:24:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 09:24:07.898898 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f65ef76-091c-46f9-b66a-ed83fb252a14 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:07.950661 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6603555-019a-4223-af73-986d01160d7c None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:07.990566 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6291b890-89d1-4b11-9f34-addf52fdaf55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:07.991247 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6291b890-89d1-4b11-9f34-addf52fdaf55 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:07.991544 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6291b890-89d1-4b11-9f34-addf52fdaf55 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:07.991816 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6291b890-89d1-4b11-9f34-addf52fdaf55 None admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:07.992581 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6291b890-89d1-4b11-9f34-addf52fdaf55 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:24:07.992895 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6291b890-89d1-4b11-9f34-addf52fdaf55 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:07.994634 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6291b890-89d1-4b11-9f34-addf52fdaf55 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:08.003411 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 116/218] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 14 09:24:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:24:08.004254 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6291b890-89d1-4b11-9f34-addf52fdaf55 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:08.016362 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f65ef76-091c-46f9-b66a-ed83fb252a14 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:08.054142 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fe7252-40be-4cec-a770-f924d3bf67a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:08.055227 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fe7252-40be-4cec-a770-f924d3bf67a2 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:08.055517 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fe7252-40be-4cec-a770-f924d3bf67a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:08.055789 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fe7252-40be-4cec-a770-f924d3bf67a2 None admin] PATH_INFO: `/v3/users/b3d3f40273f745ac83fc39478933b661` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:08.069998 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fe7252-40be-4cec-a770-f924d3bf67a2 None admin] RBAC: Authorizing `identity:get_user(user_id=b3d3f40273f745ac83fc39478933b661)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:08.071519 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fe7252-40be-4cec-a770-f924d3bf67a2 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:08.074089 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 103/219] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jul 14 09:24:07 2022] GET /identity/v3/users/b3d3f40273f745ac83fc39478933b661 => generated 297 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:24:08.074693 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fe7252-40be-4cec-a770-f924d3bf67a2 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:08.078830 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:08.116061 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6291b890-89d1-4b11-9f34-addf52fdaf55 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:08.130784 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:08.152368 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0234f010-22c8-4301-b5f5-4ac3b450a778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:08.153113 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0234f010-22c8-4301-b5f5-4ac3b450a778 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:08.153400 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0234f010-22c8-4301-b5f5-4ac3b450a778 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:08.153687 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0234f010-22c8-4301-b5f5-4ac3b450a778 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:08.154895 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0234f010-22c8-4301-b5f5-4ac3b450a778 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:08.156367 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0234f010-22c8-4301-b5f5-4ac3b450a778 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:08.158175 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 117/220] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 09:24:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:24:08.158823 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0234f010-22c8-4301-b5f5-4ac3b450a778 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:08.190872 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fe7252-40be-4cec-a770-f924d3bf67a2 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:08.229486 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aca0c3-b3b7-4145-91e4-d481bfd0908e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:08.230400 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aca0c3-b3b7-4145-91e4-d481bfd0908e None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:08.230689 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aca0c3-b3b7-4145-91e4-d481bfd0908e None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:08.230967 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aca0c3-b3b7-4145-91e4-d481bfd0908e None admin] PATH_INFO: `/v3/users/3b9b6daa2c6d479388c1fe642b1b1004` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:08.232184 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46aca0c3-b3b7-4145-91e4-d481bfd0908e None admin] RBAC: Authorizing `identity:get_user(user_id=3b9b6daa2c6d479388c1fe642b1b1004)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:08.233887 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46aca0c3-b3b7-4145-91e4-d481bfd0908e None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:08.235748 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 104/221] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jul 14 09:24:08 2022] GET /identity/v3/users/3b9b6daa2c6d479388c1fe642b1b1004 => generated 283 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:24:08.240675 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aca0c3-b3b7-4145-91e4-d481bfd0908e None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:08.270859 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0234f010-22c8-4301-b5f5-4ac3b450a778 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:08.305010 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289df39c-5a7b-4af7-be9a-e190384fe592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:08.305673 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289df39c-5a7b-4af7-be9a-e190384fe592 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:08.305963 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289df39c-5a7b-4af7-be9a-e190384fe592 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:08.306797 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289df39c-5a7b-4af7-be9a-e190384fe592 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:08.310352 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:08.348266 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aca0c3-b3b7-4145-91e4-d481bfd0908e None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:08.364600 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:08.378228 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289df39c-5a7b-4af7-be9a-e190384fe592 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:08.379727 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289df39c-5a7b-4af7-be9a-e190384fe592 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:08.388135 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9560982b-1243-4844-8e64-7ea8fb94dd98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:08.389318 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9560982b-1243-4844-8e64-7ea8fb94dd98 None admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:08.389608 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9560982b-1243-4844-8e64-7ea8fb94dd98 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:08.389888 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9560982b-1243-4844-8e64-7ea8fb94dd98 None admin] PATH_INFO: `/v3/users` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:08.390665 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9560982b-1243-4844-8e64-7ea8fb94dd98 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:08.392153 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9560982b-1243-4844-8e64-7ea8fb94dd98 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:08.412371 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 105/222] 10.222.0.40 () {60 vars in 1132 bytes} [Thu Jul 14 09:24:08 2022] POST /identity/v3/users => generated 297 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:24:08.413172 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9560982b-1243-4844-8e64-7ea8fb94dd98 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:08.512163 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 118/223] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 14 09:24:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 09:24:08.515758 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd84037-7263-41c9-8ebc-08e6a4634d26 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:08.516160 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd84037-7263-41c9-8ebc-08e6a4634d26 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:08.516354 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd84037-7263-41c9-8ebc-08e6a4634d26 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:08.517805 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 119/224] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:24:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:24:08.518632 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd84037-7263-41c9-8ebc-08e6a4634d26 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:08.552597 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9560982b-1243-4844-8e64-7ea8fb94dd98 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:08.568166 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:08.593332 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de15ba35-1a74-4a58-bc0e-80630a123a50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:08.594264 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de15ba35-1a74-4a58-bc0e-80630a123a50 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:08.594558 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de15ba35-1a74-4a58-bc0e-80630a123a50 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:08.594833 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de15ba35-1a74-4a58-bc0e-80630a123a50 None admin] PATH_INFO: `/v3/projects/37e686c883dc4b19bd52b4543bcb33e2` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:08.596355 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de15ba35-1a74-4a58-bc0e-80630a123a50 None admin] RBAC: Authorizing `identity:get_project(project_id=37e686c883dc4b19bd52b4543bcb33e2)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:08.597522 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de15ba35-1a74-4a58-bc0e-80630a123a50 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:08.599425 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 106/225] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jul 14 09:24:08 2022] GET /identity/v3/projects/37e686c883dc4b19bd52b4543bcb33e2 => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:24:08.600443 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0646ac60-6fdf-4710-acac-ae168eaa2884 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:08.600730 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0646ac60-6fdf-4710-acac-ae168eaa2884 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:08.601018 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0646ac60-6fdf-4710-acac-ae168eaa2884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:08.625414 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-0646ac60-6fdf-4710-acac-ae168eaa2884 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:24:08.627046 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-0646ac60-6fdf-4710-acac-ae168eaa2884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:24:08.645945 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd84037-7263-41c9-8ebc-08e6a4634d26 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:08.672294 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:08.692726 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d529fe18-aa93-4828-9e28-f7f56d5ad213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:08.693730 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d529fe18-aa93-4828-9e28-f7f56d5ad213 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:08.694081 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d529fe18-aa93-4828-9e28-f7f56d5ad213 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:08.694473 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d529fe18-aa93-4828-9e28-f7f56d5ad213 None admin] PATH_INFO: `/v3/projects/37e686c883dc4b19bd52b4543bcb33e2` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:08.696433 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d529fe18-aa93-4828-9e28-f7f56d5ad213 None admin] RBAC: Authorizing `identity:get_project(project_id=37e686c883dc4b19bd52b4543bcb33e2)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:08.697950 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d529fe18-aa93-4828-9e28-f7f56d5ad213 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:08.699741 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 120/226] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jul 14 09:24:08 2022] GET /identity/v3/projects/37e686c883dc4b19bd52b4543bcb33e2 => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:24:08.700504 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d529fe18-aa93-4828-9e28-f7f56d5ad213 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:08.716498 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 107/227] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:24:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 09:24:08.717181 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0646ac60-6fdf-4710-acac-ae168eaa2884 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:08.844175 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0646ac60-6fdf-4710-acac-ae168eaa2884 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:08.845500 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d529fe18-aa93-4828-9e28-f7f56d5ad213 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:08.849852 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:08.885659 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ab951a-a4c9-4ec5-bc26-a8122e5b00f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:08.886461 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ab951a-a4c9-4ec5-bc26-a8122e5b00f6 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:08.886749 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ab951a-a4c9-4ec5-bc26-a8122e5b00f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:08.887027 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ab951a-a4c9-4ec5-bc26-a8122e5b00f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:08.887995 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ab951a-a4c9-4ec5-bc26-a8122e5b00f6 None admin] RBAC: Adding query filter params (role.id=17dfac38a2e540fea229af7de99911bb, scope.project.id=37e686c883dc4b19bd52b4543bcb33e2, user.id=b3d3f40273f745ac83fc39478933b661) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:24:08.888313 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ab951a-a4c9-4ec5-bc26-a8122e5b00f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:08.890038 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ab951a-a4c9-4ec5-bc26-a8122e5b00f6 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:08.893238 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1f9dcb-eff4-4e66-9a11-4f79d9e2119a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:08.895271 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1f9dcb-eff4-4e66-9a11-4f79d9e2119a None admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:08.895726 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1f9dcb-eff4-4e66-9a11-4f79d9e2119a None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:08.896183 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1f9dcb-eff4-4e66-9a11-4f79d9e2119a None admin] PATH_INFO: `/v3/projects/37e686c883dc4b19bd52b4543bcb33e2/users/3b9b6daa2c6d479388c1fe642b1b1004/roles/e3965bd0d5f1427a86a313c0c90bfef3` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:08.897060 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 108/228] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jul 14 09:24:08 2022] GET /identity/v3/role_assignments?user.id=b3d3f40273f745ac83fc39478933b661&scope.project.id=37e686c883dc4b19bd52b4543bcb33e2&role.id=17dfac38a2e540fea229af7de99911bb => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:24:08.899913 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1f9dcb-eff4-4e66-9a11-4f79d9e2119a None admin] RBAC: Authorizing `identity:create_grant(project_id=37e686c883dc4b19bd52b4543bcb33e2, user_id=3b9b6daa2c6d479388c1fe642b1b1004, role_id=e3965bd0d5f1427a86a313c0c90bfef3)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:08.901670 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1f9dcb-eff4-4e66-9a11-4f79d9e2119a None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:08.902993 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ab951a-a4c9-4ec5-bc26-a8122e5b00f6 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:08.937499 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 121/229] 10.222.0.40 () {58 vars in 1439 bytes} [Thu Jul 14 09:24:08 2022] PUT /identity/v3/projects/37e686c883dc4b19bd52b4543bcb33e2/users/3b9b6daa2c6d479388c1fe642b1b1004/roles/e3965bd0d5f1427a86a313c0c90bfef3 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:24:08.957985 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:09.044244 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ab951a-a4c9-4ec5-bc26-a8122e5b00f6 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:09.085605 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f328d81-d3d3-499a-939a-98da6028b5a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:09.086530 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f328d81-d3d3-499a-939a-98da6028b5a2 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:09.086821 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f328d81-d3d3-499a-939a-98da6028b5a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:09.087097 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f328d81-d3d3-499a-939a-98da6028b5a2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:09.100437 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f328d81-d3d3-499a-939a-98da6028b5a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:24:09.109660 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-6f328d81-d3d3-499a-939a-98da6028b5a2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 09:24:09.109660 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:24:09.109660 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:24:09.109660 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:24:09.109660 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:24:09.109660 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:24:09.109660 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:24:09.109660 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:24:09.109660 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:24:09.109660 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:24:09.109660 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:24:09.109660 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:24:09.109660 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:24:09.109660 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:24:09.109660 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:24:09.109660 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:24:09.110655 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:24:09.110655 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:24:09.110655 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:24:09.110655 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:24:09.110655 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:24:09.110655 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:24:09.110655 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:24:09.110655 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:24:09.110655 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:24:09.110655 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:24:09.110655 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:24:09.110655 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( Jul 14 09:24:09.110655 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:24:09.110655 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:24:09.110655 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:24:09.110655 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:24:09.111438 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:24:09.111438 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:24:09.111438 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:24:09.111438 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:24:09.111438 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:24:09.111438 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:24:09.111438 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:24:09.111438 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:24:09.111438 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:24:09.111438 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:24:09.111438 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 09:24:09.111438 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:24:09.111438 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 109/230] 10.222.0.40 () {56 vars in 1114 bytes} [Thu Jul 14 09:24:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:24:09.119255 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1f9dcb-eff4-4e66-9a11-4f79d9e2119a None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:09.260122 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1f9dcb-eff4-4e66-9a11-4f79d9e2119a None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:09.305671 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0fabde-20f3-4454-bfd5-8a1075f27625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:09.306416 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0fabde-20f3-4454-bfd5-8a1075f27625 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:09.306707 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0fabde-20f3-4454-bfd5-8a1075f27625 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:09.306984 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0fabde-20f3-4454-bfd5-8a1075f27625 None admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:09.307771 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0fabde-20f3-4454-bfd5-8a1075f27625 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:24:09.308081 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0fabde-20f3-4454-bfd5-8a1075f27625 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:09.309504 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0fabde-20f3-4454-bfd5-8a1075f27625 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:09.320107 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 122/231] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jul 14 09:24:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:24:09.325548 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f328d81-d3d3-499a-939a-98da6028b5a2 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:09.445615 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:09.459430 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f328d81-d3d3-499a-939a-98da6028b5a2 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:09.514329 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b7e9f0-7bba-47df-b47e-9a5f1f4e5936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:09.515116 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b7e9f0-7bba-47df-b47e-9a5f1f4e5936 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:09.515455 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b7e9f0-7bba-47df-b47e-9a5f1f4e5936 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:09.515822 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b7e9f0-7bba-47df-b47e-9a5f1f4e5936 None admin] PATH_INFO: `/v3/users/3b9b6daa2c6d479388c1fe642b1b1004` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:09.517096 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b7e9f0-7bba-47df-b47e-9a5f1f4e5936 None admin] RBAC: Authorizing `identity:get_user(user_id=3b9b6daa2c6d479388c1fe642b1b1004)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:09.518584 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b7e9f0-7bba-47df-b47e-9a5f1f4e5936 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:09.520232 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 110/232] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jul 14 09:24:09 2022] GET /identity/v3/users/3b9b6daa2c6d479388c1fe642b1b1004 => generated 283 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:24:09.527059 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0fabde-20f3-4454-bfd5-8a1075f27625 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:09.608538 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:09.710169 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0fabde-20f3-4454-bfd5-8a1075f27625 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:09.755023 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84726bd-5f05-44e5-975c-88c7e1ab2232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:09.755902 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84726bd-5f05-44e5-975c-88c7e1ab2232 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:09.756195 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84726bd-5f05-44e5-975c-88c7e1ab2232 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:09.756476 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84726bd-5f05-44e5-975c-88c7e1ab2232 None admin] PATH_INFO: `/v3/projects/37e686c883dc4b19bd52b4543bcb33e2` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:09.757705 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84726bd-5f05-44e5-975c-88c7e1ab2232 None admin] RBAC: Authorizing `identity:get_project(project_id=37e686c883dc4b19bd52b4543bcb33e2)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:09.759777 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84726bd-5f05-44e5-975c-88c7e1ab2232 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:09.765404 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 123/233] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jul 14 09:24:09 2022] GET /identity/v3/projects/37e686c883dc4b19bd52b4543bcb33e2 => generated 302 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:24:09.767249 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b7e9f0-7bba-47df-b47e-9a5f1f4e5936 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:09.934171 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b7e9f0-7bba-47df-b47e-9a5f1f4e5936 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:09.981104 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00046eb6-e184-4aa0-931a-d8316e0f9ef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:09.982004 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00046eb6-e184-4aa0-931a-d8316e0f9ef6 None admin] REQUEST_METHOD: `PUT` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:09.982314 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00046eb6-e184-4aa0-931a-d8316e0f9ef6 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:09.982597 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00046eb6-e184-4aa0-931a-d8316e0f9ef6 None admin] PATH_INFO: `/v3/projects/37e686c883dc4b19bd52b4543bcb33e2/users/3b9b6daa2c6d479388c1fe642b1b1004/roles/f755c764373f47bababa1e942a53c2e1` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:09.987999 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00046eb6-e184-4aa0-931a-d8316e0f9ef6 None admin] RBAC: Authorizing `identity:create_grant(project_id=37e686c883dc4b19bd52b4543bcb33e2, user_id=3b9b6daa2c6d479388c1fe642b1b1004, role_id=f755c764373f47bababa1e942a53c2e1)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:09.989450 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00046eb6-e184-4aa0-931a-d8316e0f9ef6 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:10.016308 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 111/234] 10.222.0.40 () {58 vars in 1439 bytes} [Thu Jul 14 09:24:09 2022] PUT /identity/v3/projects/37e686c883dc4b19bd52b4543bcb33e2/users/3b9b6daa2c6d479388c1fe642b1b1004/roles/f755c764373f47bababa1e942a53c2e1 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:24:11.051694 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20db1e3-8f0c-41fc-9332-d4200e672208 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:11.052213 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20db1e3-8f0c-41fc-9332-d4200e672208 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:11.052286 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20db1e3-8f0c-41fc-9332-d4200e672208 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:11.053939 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 124/235] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:24:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:24:11.058948 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35f4d50-19b4-4670-917f-0a37a0fb3ef7 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:11.059372 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35f4d50-19b4-4670-917f-0a37a0fb3ef7 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:11.059544 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35f4d50-19b4-4670-917f-0a37a0fb3ef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:11.086454 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-f35f4d50-19b4-4670-917f-0a37a0fb3ef7 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:24:11.087731 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-f35f4d50-19b4-4670-917f-0a37a0fb3ef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:24:11.116559 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:11.188907 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 112/236] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:24:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 09:24:11.223736 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20db1e3-8f0c-41fc-9332-d4200e672208 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:11.256486 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a699ef62-623b-4a54-96d2-ec8c911a32ba None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:11.256814 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a699ef62-623b-4a54-96d2-ec8c911a32ba None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:11.257050 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a699ef62-623b-4a54-96d2-ec8c911a32ba None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:11.258507 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 113/237] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:24:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:24:11.267139 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d5249f-e024-4c3e-95b2-bcdf9a43e0d9 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:11.267446 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d5249f-e024-4c3e-95b2-bcdf9a43e0d9 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:11.267708 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d5249f-e024-4c3e-95b2-bcdf9a43e0d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:11.298681 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-48d5249f-e024-4c3e-95b2-bcdf9a43e0d9 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:24:11.299909 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-48d5249f-e024-4c3e-95b2-bcdf9a43e0d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:24:11.406641 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:11.423850 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20db1e3-8f0c-41fc-9332-d4200e672208 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:11.443555 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 114/238] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:24:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 09:24:11.476884 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d5249f-e024-4c3e-95b2-bcdf9a43e0d9 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:11.486994 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef4d824-2ad1-4abd-873d-dbd751feeefa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:11.488198 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef4d824-2ad1-4abd-873d-dbd751feeefa None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:11.488717 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef4d824-2ad1-4abd-873d-dbd751feeefa None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:11.489197 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef4d824-2ad1-4abd-873d-dbd751feeefa None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:11.507689 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef4d824-2ad1-4abd-873d-dbd751feeefa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:24:11.530904 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-8ef4d824-2ad1-4abd-873d-dbd751feeefa None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 09:24:11.530904 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:24:11.530904 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:24:11.530904 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:24:11.530904 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:24:11.530904 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:24:11.530904 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:24:11.530904 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:24:11.530904 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:24:11.530904 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:24:11.530904 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:24:11.530904 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:24:11.530904 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:24:11.530904 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:24:11.530904 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:24:11.530904 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:24:11.531851 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:24:11.531851 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:24:11.531851 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:24:11.531851 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:24:11.531851 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:24:11.531851 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:24:11.531851 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:24:11.531851 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:24:11.531851 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:24:11.531851 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:24:11.531851 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:24:11.531851 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( Jul 14 09:24:11.531851 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:24:11.531851 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:24:11.531851 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:24:11.531851 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:24:11.532632 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:24:11.532632 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:24:11.532632 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:24:11.532632 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:24:11.532632 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:24:11.532632 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:24:11.532632 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:24:11.532632 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:24:11.532632 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:24:11.532632 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:24:11.532632 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 09:24:11.532632 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Jul 14 09:24:11.535374 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 125/239] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 14 09:24:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:24:11.543492 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef4d824-2ad1-4abd-873d-dbd751feeefa None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:11.574166 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:11.597112 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d5249f-e024-4c3e-95b2-bcdf9a43e0d9 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:11.641412 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4417af-abc8-4cef-ab3c-73e3c6bf1dd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:11.642585 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4417af-abc8-4cef-ab3c-73e3c6bf1dd7 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:11.642911 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4417af-abc8-4cef-ab3c-73e3c6bf1dd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:11.643186 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4417af-abc8-4cef-ab3c-73e3c6bf1dd7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:11.644863 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4417af-abc8-4cef-ab3c-73e3c6bf1dd7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:11.647474 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4417af-abc8-4cef-ab3c-73e3c6bf1dd7 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:11.651189 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 115/240] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 09:24:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:24:11.653162 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24112c8d-37a0-4c77-abca-758b4207bb51 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:11.653466 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24112c8d-37a0-4c77-abca-758b4207bb51 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:11.653749 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24112c8d-37a0-4c77-abca-758b4207bb51 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:11.659911 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 116/241] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:24:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:24:11.662856 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24112c8d-37a0-4c77-abca-758b4207bb51 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:11.703822 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef4d824-2ad1-4abd-873d-dbd751feeefa None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:11.742281 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7741144c-8e40-42ae-a8d0-a0fa0041fb84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:11.742977 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7741144c-8e40-42ae-a8d0-a0fa0041fb84 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:11.743253 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7741144c-8e40-42ae-a8d0-a0fa0041fb84 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:11.743884 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7741144c-8e40-42ae-a8d0-a0fa0041fb84 None admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:11.744896 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7741144c-8e40-42ae-a8d0-a0fa0041fb84 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:24:11.745197 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7741144c-8e40-42ae-a8d0-a0fa0041fb84 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:11.746647 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7741144c-8e40-42ae-a8d0-a0fa0041fb84 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:11.758348 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 126/242] 10.222.0.40 () {56 vars in 1101 bytes} [Thu Jul 14 09:24:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:24:11.760343 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057f0321-e5d9-4e72-a6d1-f6ebff39f93a None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:11.760593 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057f0321-e5d9-4e72-a6d1-f6ebff39f93a None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:11.760872 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057f0321-e5d9-4e72-a6d1-f6ebff39f93a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:11.778885 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-057f0321-e5d9-4e72-a6d1-f6ebff39f93a None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:24:11.780092 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-057f0321-e5d9-4e72-a6d1-f6ebff39f93a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:24:11.792055 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:11.793770 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24112c8d-37a0-4c77-abca-758b4207bb51 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:11.829962 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c165d69-62fe-4846-a0dd-a79cb48d5b4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:11.830676 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c165d69-62fe-4846-a0dd-a79cb48d5b4c None admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:11.830958 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c165d69-62fe-4846-a0dd-a79cb48d5b4c None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:11.831239 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c165d69-62fe-4846-a0dd-a79cb48d5b4c None admin] PATH_INFO: `/v3/users` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:11.831941 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c165d69-62fe-4846-a0dd-a79cb48d5b4c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:11.833369 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c165d69-62fe-4846-a0dd-a79cb48d5b4c None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:11.851739 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 127/243] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:24:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 09:24:11.853404 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf151ce-a7ee-4f0e-b579-1cf1540a1da8 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:11.853700 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf151ce-a7ee-4f0e-b579-1cf1540a1da8 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:11.853981 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf151ce-a7ee-4f0e-b579-1cf1540a1da8 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:11.855486 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 128/244] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:24:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:24:11.859995 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf151ce-a7ee-4f0e-b579-1cf1540a1da8 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:11.862757 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 117/245] 10.222.0.40 () {60 vars in 1132 bytes} [Thu Jul 14 09:24:11 2022] POST /identity/v3/users => generated 293 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:24:11.864375 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca47c3a-910a-475c-86f4-262593390101 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:11.864910 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca47c3a-910a-475c-86f4-262593390101 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:11.865384 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca47c3a-910a-475c-86f4-262593390101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:11.882233 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:11.890755 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-1ca47c3a-910a-475c-86f4-262593390101 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:24:11.893112 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-1ca47c3a-910a-475c-86f4-262593390101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:24:11.992979 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 118/246] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:24:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 09:24:11.994165 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca47c3a-910a-475c-86f4-262593390101 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:12.010138 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf151ce-a7ee-4f0e-b579-1cf1540a1da8 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:12.065222 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d083a02d-4667-4c41-9387-fb1674c488a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:12.066117 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d083a02d-4667-4c41-9387-fb1674c488a7 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:12.066451 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d083a02d-4667-4c41-9387-fb1674c488a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:12.066730 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d083a02d-4667-4c41-9387-fb1674c488a7 None admin] PATH_INFO: `/v3/users/7dd8a25ce8b54f3cba9c5a90a3dff5aa` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:12.086013 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d083a02d-4667-4c41-9387-fb1674c488a7 None admin] RBAC: Authorizing `identity:get_user(user_id=7dd8a25ce8b54f3cba9c5a90a3dff5aa)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:12.087652 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d083a02d-4667-4c41-9387-fb1674c488a7 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:12.090399 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 129/247] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jul 14 09:24:11 2022] GET /identity/v3/users/7dd8a25ce8b54f3cba9c5a90a3dff5aa => generated 297 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:24:12.090399 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d083a02d-4667-4c41-9387-fb1674c488a7 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:12.095884 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:12.121519 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca47c3a-910a-475c-86f4-262593390101 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:12.189389 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417363b8-8b10-4e60-8c5d-836bd08b2ef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:12.190568 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417363b8-8b10-4e60-8c5d-836bd08b2ef6 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:12.190894 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417363b8-8b10-4e60-8c5d-836bd08b2ef6 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:12.191272 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417363b8-8b10-4e60-8c5d-836bd08b2ef6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:12.194735 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:12.205581 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417363b8-8b10-4e60-8c5d-836bd08b2ef6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:24:12.214382 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-417363b8-8b10-4e60-8c5d-836bd08b2ef6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 09:24:12.214382 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:24:12.214382 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:24:12.214382 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:24:12.214382 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:24:12.214382 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:24:12.214382 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:24:12.214382 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:24:12.214382 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:24:12.214382 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:24:12.214382 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:24:12.214382 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:24:12.214382 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:24:12.214382 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:24:12.214382 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:24:12.214382 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:24:12.215304 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:24:12.215304 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:24:12.215304 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:24:12.215304 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:24:12.215304 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:24:12.215304 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:24:12.215304 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:24:12.215304 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:24:12.215304 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:24:12.215304 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:24:12.215304 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:24:12.215304 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( Jul 14 09:24:12.215304 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:24:12.215304 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:24:12.215304 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:24:12.215304 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:24:12.216331 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:24:12.216331 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:24:12.216331 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:24:12.216331 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:24:12.216331 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:24:12.216331 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:24:12.216331 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:24:12.216331 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:24:12.216331 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:24:12.216331 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:24:12.216331 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 09:24:12.216331 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:24:12.216331 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 119/248] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 14 09:24:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:24:12.218776 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417363b8-8b10-4e60-8c5d-836bd08b2ef6 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:12.262685 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d083a02d-4667-4c41-9387-fb1674c488a7 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:12.325449 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb7ff64-6bda-4b13-9403-bc41d8a51f60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:12.327017 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb7ff64-6bda-4b13-9403-bc41d8a51f60 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:12.327883 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb7ff64-6bda-4b13-9403-bc41d8a51f60 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:12.328134 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb7ff64-6bda-4b13-9403-bc41d8a51f60 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:12.349422 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb7ff64-6bda-4b13-9403-bc41d8a51f60 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:24:12.364945 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417363b8-8b10-4e60-8c5d-836bd08b2ef6 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:12.366506 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-dbb7ff64-6bda-4b13-9403-bc41d8a51f60 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 09:24:12.366506 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:24:12.366506 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:24:12.366506 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:24:12.366506 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:24:12.366506 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:24:12.366506 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:24:12.366506 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:24:12.366506 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:24:12.366506 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:24:12.366506 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:24:12.366506 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:24:12.366506 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:24:12.366506 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:24:12.366506 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:24:12.366506 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:24:12.367369 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:24:12.367369 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:24:12.367369 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:24:12.367369 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:24:12.367369 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:24:12.367369 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:24:12.367369 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:24:12.367369 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:24:12.367369 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:24:12.367369 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:24:12.367369 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:24:12.367369 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( Jul 14 09:24:12.367369 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:24:12.367369 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:24:12.367369 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:24:12.367369 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:24:12.368158 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:24:12.368158 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:24:12.368158 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:24:12.368158 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:24:12.368158 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:24:12.368158 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:24:12.368158 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:24:12.368158 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:24:12.368158 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:24:12.368158 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:24:12.368158 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 09:24:12.368158 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Jul 14 09:24:12.369950 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 130/249] 10.222.0.40 () {56 vars in 1096 bytes} [Thu Jul 14 09:24:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:24:12.371273 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb7ff64-6bda-4b13-9403-bc41d8a51f60 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:12.407271 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f9d416-ba50-40dd-b520-968ae6b77be1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:12.408291 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f9d416-ba50-40dd-b520-968ae6b77be1 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:12.408777 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f9d416-ba50-40dd-b520-968ae6b77be1 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:12.409253 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f9d416-ba50-40dd-b520-968ae6b77be1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:12.477178 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:12.489705 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f9d416-ba50-40dd-b520-968ae6b77be1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:12.498217 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f9d416-ba50-40dd-b520-968ae6b77be1 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:12.498985 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:12.580655 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb7ff64-6bda-4b13-9403-bc41d8a51f60 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:12.638030 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62ff91b-fd16-4e2d-8f40-20b8d6a16c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:12.638758 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62ff91b-fd16-4e2d-8f40-20b8d6a16c3a None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:12.639045 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62ff91b-fd16-4e2d-8f40-20b8d6a16c3a None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:12.639322 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62ff91b-fd16-4e2d-8f40-20b8d6a16c3a None admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:12.640099 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62ff91b-fd16-4e2d-8f40-20b8d6a16c3a None admin] RBAC: Adding query filter params (name=member) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:24:12.640410 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62ff91b-fd16-4e2d-8f40-20b8d6a16c3a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:12.642113 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62ff91b-fd16-4e2d-8f40-20b8d6a16c3a None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:12.668138 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 131/250] 10.222.0.40 () {56 vars in 1101 bytes} [Thu Jul 14 09:24:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:24:12.669003 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62ff91b-fd16-4e2d-8f40-20b8d6a16c3a None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:12.701635 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 120/251] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 14 09:24:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 485 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 09:24:12.702796 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f9d416-ba50-40dd-b520-968ae6b77be1 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:12.816226 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:12.822807 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f9d416-ba50-40dd-b520-968ae6b77be1 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:12.840268 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62ff91b-fd16-4e2d-8f40-20b8d6a16c3a None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:12.858602 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18188513-6106-4e13-bc3a-bcd5f464e5bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:12.859729 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18188513-6106-4e13-bc3a-bcd5f464e5bc None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:12.859729 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18188513-6106-4e13-bc3a-bcd5f464e5bc None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:12.860014 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18188513-6106-4e13-bc3a-bcd5f464e5bc None admin] PATH_INFO: `/v3/users/b3d3f40273f745ac83fc39478933b661` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:12.861409 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18188513-6106-4e13-bc3a-bcd5f464e5bc None admin] RBAC: Authorizing `identity:get_user(user_id=b3d3f40273f745ac83fc39478933b661)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:12.863249 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18188513-6106-4e13-bc3a-bcd5f464e5bc None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:12.865070 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 121/252] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jul 14 09:24:12 2022] GET /identity/v3/users/b3d3f40273f745ac83fc39478933b661 => generated 297 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:24:12.870219 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18188513-6106-4e13-bc3a-bcd5f464e5bc None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:12.870397 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:12.879871 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca2df9d-6229-401f-a694-2b309c479558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:12.880662 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca2df9d-6229-401f-a694-2b309c479558 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:12.881182 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca2df9d-6229-401f-a694-2b309c479558 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:12.881666 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca2df9d-6229-401f-a694-2b309c479558 None admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:12.882684 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca2df9d-6229-401f-a694-2b309c479558 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:24:12.883201 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca2df9d-6229-401f-a694-2b309c479558 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:12.884900 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca2df9d-6229-401f-a694-2b309c479558 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:12.894226 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 132/253] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 14 09:24:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:24:12.895823 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580c4a44-a27b-4961-a279-a43eae501b39 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:12.896347 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580c4a44-a27b-4961-a279-a43eae501b39 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:12.896832 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580c4a44-a27b-4961-a279-a43eae501b39 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:12.898334 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 133/254] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:24:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:24:12.899246 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580c4a44-a27b-4961-a279-a43eae501b39 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:12.980306 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18188513-6106-4e13-bc3a-bcd5f464e5bc None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:13.015862 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580c4a44-a27b-4961-a279-a43eae501b39 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:13.016086 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11979f7f-13ad-4b0d-83f1-27eba1883640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:13.016742 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11979f7f-13ad-4b0d-83f1-27eba1883640 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:13.017030 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11979f7f-13ad-4b0d-83f1-27eba1883640 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:13.017305 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11979f7f-13ad-4b0d-83f1-27eba1883640 None admin] PATH_INFO: `/v3/projects/37e686c883dc4b19bd52b4543bcb33e2` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:13.018562 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11979f7f-13ad-4b0d-83f1-27eba1883640 None admin] RBAC: Authorizing `identity:get_project(project_id=37e686c883dc4b19bd52b4543bcb33e2)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:13.020029 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11979f7f-13ad-4b0d-83f1-27eba1883640 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:13.021988 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 122/255] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jul 14 09:24:12 2022] GET /identity/v3/projects/37e686c883dc4b19bd52b4543bcb33e2 => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:24:13.023133 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11979f7f-13ad-4b0d-83f1-27eba1883640 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:13.061362 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:13.061602 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c6b66c-0391-4491-80f6-11266c09b88d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:13.062800 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c6b66c-0391-4491-80f6-11266c09b88d None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:13.063278 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c6b66c-0391-4491-80f6-11266c09b88d None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:13.063736 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c6b66c-0391-4491-80f6-11266c09b88d None admin] PATH_INFO: `/v3/projects/37e686c883dc4b19bd52b4543bcb33e2` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:13.065212 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c6b66c-0391-4491-80f6-11266c09b88d None admin] RBAC: Authorizing `identity:get_project(project_id=37e686c883dc4b19bd52b4543bcb33e2)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:13.067014 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c6b66c-0391-4491-80f6-11266c09b88d None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:13.069479 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 134/256] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jul 14 09:24:12 2022] GET /identity/v3/projects/37e686c883dc4b19bd52b4543bcb33e2 => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:24:13.071014 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833fafc5-848b-4347-adba-c0a67142cce8 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:13.071556 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833fafc5-848b-4347-adba-c0a67142cce8 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:13.072041 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833fafc5-848b-4347-adba-c0a67142cce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:13.099549 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-833fafc5-848b-4347-adba-c0a67142cce8 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:24:13.100747 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-833fafc5-848b-4347-adba-c0a67142cce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:24:13.147636 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11979f7f-13ad-4b0d-83f1-27eba1883640 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:13.172047 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:13.206215 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 135/257] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:24:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 09:24:13.206215 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833fafc5-848b-4347-adba-c0a67142cce8 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:13.208430 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a340dd6-9b28-4c59-93bd-981a9c8f5f6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:13.209549 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a340dd6-9b28-4c59-93bd-981a9c8f5f6f None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:13.210017 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a340dd6-9b28-4c59-93bd-981a9c8f5f6f None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:13.210496 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a340dd6-9b28-4c59-93bd-981a9c8f5f6f None admin] PATH_INFO: `/v3/users/3b9b6daa2c6d479388c1fe642b1b1004` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:13.215675 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a340dd6-9b28-4c59-93bd-981a9c8f5f6f None admin] RBAC: Authorizing `identity:get_user(user_id=3b9b6daa2c6d479388c1fe642b1b1004)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:13.217545 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a340dd6-9b28-4c59-93bd-981a9c8f5f6f None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:13.219860 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 123/258] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jul 14 09:24:13 2022] GET /identity/v3/users/3b9b6daa2c6d479388c1fe642b1b1004 => generated 283 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:24:13.220829 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a340dd6-9b28-4c59-93bd-981a9c8f5f6f None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:13.342918 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833fafc5-848b-4347-adba-c0a67142cce8 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:13.353046 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:13.356843 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a340dd6-9b28-4c59-93bd-981a9c8f5f6f None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:13.393062 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb5fcc7-45b5-4b2a-a6f8-06c7c4f176ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:13.393738 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb5fcc7-45b5-4b2a-a6f8-06c7c4f176ae None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:13.394029 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb5fcc7-45b5-4b2a-a6f8-06c7c4f176ae None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:13.394340 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb5fcc7-45b5-4b2a-a6f8-06c7c4f176ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:13.395205 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb5fcc7-45b5-4b2a-a6f8-06c7c4f176ae None admin] RBAC: Adding query filter params (role.id=028a8869bb7b4891b03c0b6afcced73a, scope.project.id=37e686c883dc4b19bd52b4543bcb33e2, user.id=7dd8a25ce8b54f3cba9c5a90a3dff5aa) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:24:13.395524 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb5fcc7-45b5-4b2a-a6f8-06c7c4f176ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:13.396994 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb5fcc7-45b5-4b2a-a6f8-06c7c4f176ae None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:13.402133 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbc4f2c-72ed-4ccb-b750-fd6977316ef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:13.403332 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbc4f2c-72ed-4ccb-b750-fd6977316ef6 None admin] REQUEST_METHOD: `PUT` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:13.403835 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbc4f2c-72ed-4ccb-b750-fd6977316ef6 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:13.404213 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 136/259] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jul 14 09:24:13 2022] GET /identity/v3/role_assignments?user.id=7dd8a25ce8b54f3cba9c5a90a3dff5aa&scope.project.id=37e686c883dc4b19bd52b4543bcb33e2&role.id=028a8869bb7b4891b03c0b6afcced73a => generated 259 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:24:13.404515 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbc4f2c-72ed-4ccb-b750-fd6977316ef6 None admin] PATH_INFO: `/v3/projects/37e686c883dc4b19bd52b4543bcb33e2/users/b3d3f40273f745ac83fc39478933b661/roles/17dfac38a2e540fea229af7de99911bb` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:13.405121 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb5fcc7-45b5-4b2a-a6f8-06c7c4f176ae None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:13.407198 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbc4f2c-72ed-4ccb-b750-fd6977316ef6 None admin] RBAC: Authorizing `identity:create_grant(project_id=37e686c883dc4b19bd52b4543bcb33e2, user_id=b3d3f40273f745ac83fc39478933b661, role_id=17dfac38a2e540fea229af7de99911bb)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:13.409052 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbc4f2c-72ed-4ccb-b750-fd6977316ef6 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:13.424868 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 124/260] 10.222.0.40 () {58 vars in 1439 bytes} [Thu Jul 14 09:24:13 2022] PUT /identity/v3/projects/37e686c883dc4b19bd52b4543bcb33e2/users/b3d3f40273f745ac83fc39478933b661/roles/17dfac38a2e540fea229af7de99911bb => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:24:13.426156 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbc4f2c-72ed-4ccb-b750-fd6977316ef6 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:13.466398 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:13.531866 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb5fcc7-45b5-4b2a-a6f8-06c7c4f176ae None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:13.574485 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadf96f1-dac8-4db1-9ff5-b797b53b466b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:13.575418 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadf96f1-dac8-4db1-9ff5-b797b53b466b None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:13.575857 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadf96f1-dac8-4db1-9ff5-b797b53b466b None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:13.576284 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadf96f1-dac8-4db1-9ff5-b797b53b466b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:13.591101 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbc4f2c-72ed-4ccb-b750-fd6977316ef6 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:13.645013 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c29ae8-c468-4389-be75-ece092e4d2db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:13.645792 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c29ae8-c468-4389-be75-ece092e4d2db None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:13.646225 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c29ae8-c468-4389-be75-ece092e4d2db None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:13.646616 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c29ae8-c468-4389-be75-ece092e4d2db None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:13.660238 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c29ae8-c468-4389-be75-ece092e4d2db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:24:13.672669 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-25c29ae8-c468-4389-be75-ece092e4d2db None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 09:24:13.672669 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:24:13.672669 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:24:13.672669 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:24:13.672669 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:24:13.672669 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:24:13.672669 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:24:13.672669 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:24:13.672669 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:24:13.672669 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:24:13.672669 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:24:13.672669 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:24:13.672669 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:24:13.672669 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:24:13.672669 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:24:13.672669 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:24:13.674489 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:24:13.674489 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:24:13.674489 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:24:13.674489 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:24:13.674489 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:24:13.674489 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:24:13.674489 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:24:13.674489 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:24:13.674489 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:24:13.674489 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:24:13.674489 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:24:13.674489 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( Jul 14 09:24:13.674489 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:24:13.674489 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:24:13.674489 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:24:13.674489 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:24:13.676744 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:24:13.676744 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:24:13.676744 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:24:13.676744 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:24:13.676744 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:24:13.676744 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:24:13.676744 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:24:13.676744 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:24:13.676744 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:24:13.676744 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:24:13.676744 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 09:24:13.676744 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:24:13.676744 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 125/261] 10.222.0.40 () {56 vars in 1114 bytes} [Thu Jul 14 09:24:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:24:13.683502 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c29ae8-c468-4389-be75-ece092e4d2db None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:13.716017 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadf96f1-dac8-4db1-9ff5-b797b53b466b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:13.717650 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadf96f1-dac8-4db1-9ff5-b797b53b466b None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:13.742357 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:13.796437 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:13.860600 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 137/262] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 14 09:24:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 09:24:13.867272 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadf96f1-dac8-4db1-9ff5-b797b53b466b None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:13.919223 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c29ae8-c468-4389-be75-ece092e4d2db None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:13.991035 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595d4d94-e3d5-4aaf-8afd-335fc00e6855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:13.991729 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595d4d94-e3d5-4aaf-8afd-335fc00e6855 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:13.992017 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595d4d94-e3d5-4aaf-8afd-335fc00e6855 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:13.992287 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595d4d94-e3d5-4aaf-8afd-335fc00e6855 None admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:13.993061 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595d4d94-e3d5-4aaf-8afd-335fc00e6855 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:24:13.994206 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595d4d94-e3d5-4aaf-8afd-335fc00e6855 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:13.995638 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595d4d94-e3d5-4aaf-8afd-335fc00e6855 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:14.016507 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 126/263] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jul 14 09:24:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:24:14.024140 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595d4d94-e3d5-4aaf-8afd-335fc00e6855 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:14.096622 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadf96f1-dac8-4db1-9ff5-b797b53b466b None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:14.214987 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb18417-50b3-4eae-af7f-752b2aaa4184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:14.215889 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb18417-50b3-4eae-af7f-752b2aaa4184 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:14.216182 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb18417-50b3-4eae-af7f-752b2aaa4184 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:14.216462 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb18417-50b3-4eae-af7f-752b2aaa4184 None admin] PATH_INFO: `/v3/projects/37e686c883dc4b19bd52b4543bcb33e2` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:14.217767 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb18417-50b3-4eae-af7f-752b2aaa4184 None admin] RBAC: Authorizing `identity:get_project(project_id=37e686c883dc4b19bd52b4543bcb33e2)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:14.218298 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:14.219270 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb18417-50b3-4eae-af7f-752b2aaa4184 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:14.221024 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 138/264] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jul 14 09:24:13 2022] GET /identity/v3/projects/37e686c883dc4b19bd52b4543bcb33e2 => generated 302 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:24:14.226904 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb18417-50b3-4eae-af7f-752b2aaa4184 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:14.257033 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595d4d94-e3d5-4aaf-8afd-335fc00e6855 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:14.274054 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:14.312497 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b750deae-bee0-4c10-86a7-62ded576126b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:14.313963 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b750deae-bee0-4c10-86a7-62ded576126b None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:14.314478 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b750deae-bee0-4c10-86a7-62ded576126b None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:14.315623 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b750deae-bee0-4c10-86a7-62ded576126b None admin] PATH_INFO: `/v3/users/3b9b6daa2c6d479388c1fe642b1b1004` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:14.317731 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b750deae-bee0-4c10-86a7-62ded576126b None admin] RBAC: Authorizing `identity:get_user(user_id=3b9b6daa2c6d479388c1fe642b1b1004)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:14.323505 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b750deae-bee0-4c10-86a7-62ded576126b None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:14.325889 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 127/265] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jul 14 09:24:14 2022] GET /identity/v3/users/3b9b6daa2c6d479388c1fe642b1b1004 => generated 283 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:24:14.331887 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b750deae-bee0-4c10-86a7-62ded576126b None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:14.508996 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb18417-50b3-4eae-af7f-752b2aaa4184 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:14.511688 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b750deae-bee0-4c10-86a7-62ded576126b None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:14.546525 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7051efa-442f-4094-bf57-dcba3340c016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:14.547201 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7051efa-442f-4094-bf57-dcba3340c016 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:14.547488 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7051efa-442f-4094-bf57-dcba3340c016 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:14.547767 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7051efa-442f-4094-bf57-dcba3340c016 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:14.548721 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7051efa-442f-4094-bf57-dcba3340c016 None admin] RBAC: Adding query filter params (role.id=e3965bd0d5f1427a86a313c0c90bfef3, scope.project.id=37e686c883dc4b19bd52b4543bcb33e2, user.id=3b9b6daa2c6d479388c1fe642b1b1004) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:24:14.549043 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7051efa-442f-4094-bf57-dcba3340c016 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:14.550643 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7051efa-442f-4094-bf57-dcba3340c016 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:14.557658 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 139/266] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jul 14 09:24:14 2022] GET /identity/v3/role_assignments?user.id=3b9b6daa2c6d479388c1fe642b1b1004&scope.project.id=37e686c883dc4b19bd52b4543bcb33e2&role.id=e3965bd0d5f1427a86a313c0c90bfef3 => generated 608 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:24:14.561040 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc4703e-adfc-41db-ba7a-7a941a8f0001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:14.561726 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc4703e-adfc-41db-ba7a-7a941a8f0001 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:14.562010 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc4703e-adfc-41db-ba7a-7a941a8f0001 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:14.562320 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc4703e-adfc-41db-ba7a-7a941a8f0001 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:14.594629 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:14.643564 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc4703e-adfc-41db-ba7a-7a941a8f0001 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:14.645048 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc4703e-adfc-41db-ba7a-7a941a8f0001 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:14.756090 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 128/267] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 14 09:24:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 14 09:24:14.761983 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7051efa-442f-4094-bf57-dcba3340c016 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:14.762700 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7572d0df-2039-4d5c-83da-c121540ed697 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:14.763001 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7572d0df-2039-4d5c-83da-c121540ed697 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:14.763267 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7572d0df-2039-4d5c-83da-c121540ed697 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:14.764647 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 129/268] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:24:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 09:24:14.770739 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff006916-0733-4655-b8b5-7c4274fdc5d9 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:14.771037 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff006916-0733-4655-b8b5-7c4274fdc5d9 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:14.771294 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff006916-0733-4655-b8b5-7c4274fdc5d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:14.807264 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-ff006916-0733-4655-b8b5-7c4274fdc5d9 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:24:14.808507 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-ff006916-0733-4655-b8b5-7c4274fdc5d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:24:14.894249 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:14.901760 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:14.921812 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7051efa-442f-4094-bf57-dcba3340c016 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:14.965275 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 130/269] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:24:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 09:24:14.971070 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72337fa6-5ab2-4b88-bc1a-024e662e749f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:14.971952 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72337fa6-5ab2-4b88-bc1a-024e662e749f None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:14.972240 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72337fa6-5ab2-4b88-bc1a-024e662e749f None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:14.972523 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72337fa6-5ab2-4b88-bc1a-024e662e749f None admin] PATH_INFO: `/v3/projects/37e686c883dc4b19bd52b4543bcb33e2` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:14.973764 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72337fa6-5ab2-4b88-bc1a-024e662e749f None admin] RBAC: Authorizing `identity:get_project(project_id=37e686c883dc4b19bd52b4543bcb33e2)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:14.975269 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72337fa6-5ab2-4b88-bc1a-024e662e749f None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:14.977265 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 140/270] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jul 14 09:24:14 2022] GET /identity/v3/projects/37e686c883dc4b19bd52b4543bcb33e2 => generated 302 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:24:14.987109 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff006916-0733-4655-b8b5-7c4274fdc5d9 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:14.990881 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5c9ae2-ee8c-4a05-bcce-a5134b625d2f None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:14.991177 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5c9ae2-ee8c-4a05-bcce-a5134b625d2f None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:14.991457 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5c9ae2-ee8c-4a05-bcce-a5134b625d2f None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:14.993118 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 141/271] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:24:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:24:14.998775 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f15d1a-fe1f-45a6-88af-6c26258081e2 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:14.999071 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f15d1a-fe1f-45a6-88af-6c26258081e2 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:14.999869 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f15d1a-fe1f-45a6-88af-6c26258081e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:15.023070 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-e1f15d1a-fe1f-45a6-88af-6c26258081e2 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:24:15.025643 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-e1f15d1a-fe1f-45a6-88af-6c26258081e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:24:15.109784 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 142/272] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:24:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 09:24:15.110593 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f15d1a-fe1f-45a6-88af-6c26258081e2 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:15.151918 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff006916-0733-4655-b8b5-7c4274fdc5d9 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:15.203020 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4857abc1-7a8e-45ed-8768-a41bd46517ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:15.204310 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4857abc1-7a8e-45ed-8768-a41bd46517ee None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:15.204615 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4857abc1-7a8e-45ed-8768-a41bd46517ee None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:15.204899 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4857abc1-7a8e-45ed-8768-a41bd46517ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:15.205765 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4857abc1-7a8e-45ed-8768-a41bd46517ee None admin] RBAC: Adding query filter params (role.id=f755c764373f47bababa1e942a53c2e1, scope.project.id=37e686c883dc4b19bd52b4543bcb33e2, user.id=3b9b6daa2c6d479388c1fe642b1b1004) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:24:15.206096 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4857abc1-7a8e-45ed-8768-a41bd46517ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:15.208129 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4857abc1-7a8e-45ed-8768-a41bd46517ee None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:15.220886 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 131/273] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jul 14 09:24:14 2022] GET /identity/v3/role_assignments?user.id=3b9b6daa2c6d479388c1fe642b1b1004&scope.project.id=37e686c883dc4b19bd52b4543bcb33e2&role.id=f755c764373f47bababa1e942a53c2e1 => generated 608 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:24:15.220886 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4857abc1-7a8e-45ed-8768-a41bd46517ee None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:15.231302 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:15.277686 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:15.285363 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f15d1a-fe1f-45a6-88af-6c26258081e2 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:15.345102 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4857abc1-7a8e-45ed-8768-a41bd46517ee None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:15.386101 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32895495-9c80-4c88-8b16-675ef4edb3cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:15.387080 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32895495-9c80-4c88-8b16-675ef4edb3cd None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:15.387300 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32895495-9c80-4c88-8b16-675ef4edb3cd None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:15.387519 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32895495-9c80-4c88-8b16-675ef4edb3cd None admin] PATH_INFO: `/v3/roles/member` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:15.393256 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7496400-9de1-41dc-aa29-aa76f0e1326a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:15.394635 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7496400-9de1-41dc-aa29-aa76f0e1326a None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:15.395152 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7496400-9de1-41dc-aa29-aa76f0e1326a None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:15.395634 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7496400-9de1-41dc-aa29-aa76f0e1326a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:15.399468 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32895495-9c80-4c88-8b16-675ef4edb3cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:24:15.400511 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7496400-9de1-41dc-aa29-aa76f0e1326a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:15.402364 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7496400-9de1-41dc-aa29-aa76f0e1326a None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:15.409205 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-32895495-9c80-4c88-8b16-675ef4edb3cd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 09:24:15.409205 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:24:15.409205 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:24:15.409205 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:24:15.409205 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:24:15.409205 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:24:15.409205 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:24:15.409205 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:24:15.409205 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:24:15.409205 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:24:15.409205 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:24:15.409205 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:24:15.409205 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:24:15.409205 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:24:15.409205 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:24:15.409205 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:24:15.410335 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:24:15.410335 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:24:15.410335 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:24:15.410335 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:24:15.410335 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:24:15.410335 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:24:15.410335 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:24:15.410335 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:24:15.410335 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:24:15.410335 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:24:15.410335 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:24:15.410335 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( Jul 14 09:24:15.410335 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:24:15.410335 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:24:15.410335 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:24:15.410335 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:24:15.411315 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:24:15.411315 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:24:15.411315 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:24:15.411315 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:24:15.411315 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:24:15.411315 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:24:15.411315 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:24:15.411315 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:24:15.411315 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:24:15.411315 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:24:15.411315 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 09:24:15.411315 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:24:15.411315 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 132/274] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 14 09:24:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:24:15.412106 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 143/275] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 09:24:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:24:15.412887 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32895495-9c80-4c88-8b16-675ef4edb3cd None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:15.418879 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7496400-9de1-41dc-aa29-aa76f0e1326a None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:15.549367 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32895495-9c80-4c88-8b16-675ef4edb3cd None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:15.552249 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:15.579145 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7496400-9de1-41dc-aa29-aa76f0e1326a None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:15.604396 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423b318a-be55-4d1a-9ce0-61461e61f1d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:15.605364 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423b318a-be55-4d1a-9ce0-61461e61f1d6 None admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:15.605474 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423b318a-be55-4d1a-9ce0-61461e61f1d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:15.605749 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423b318a-be55-4d1a-9ce0-61461e61f1d6 None admin] PATH_INFO: `/v3/users` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:15.606527 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423b318a-be55-4d1a-9ce0-61461e61f1d6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:15.608008 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423b318a-be55-4d1a-9ce0-61461e61f1d6 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:15.623749 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a67a89-2925-4154-8c64-4de43a454a75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:15.624871 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a67a89-2925-4154-8c64-4de43a454a75 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:15.625362 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a67a89-2925-4154-8c64-4de43a454a75 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:15.625963 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a67a89-2925-4154-8c64-4de43a454a75 None admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:15.627065 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a67a89-2925-4154-8c64-4de43a454a75 None admin] RBAC: Adding query filter params (name=member) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:24:15.627667 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a67a89-2925-4154-8c64-4de43a454a75 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:15.629354 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a67a89-2925-4154-8c64-4de43a454a75 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:15.637125 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 133/276] 10.222.0.40 () {60 vars in 1132 bytes} [Thu Jul 14 09:24:15 2022] POST /identity/v3/users => generated 293 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:24:15.642408 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 144/277] 10.222.0.40 () {56 vars in 1101 bytes} [Thu Jul 14 09:24:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:24:15.649686 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423b318a-be55-4d1a-9ce0-61461e61f1d6 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:15.829532 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423b318a-be55-4d1a-9ce0-61461e61f1d6 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:15.874738 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51d4599-6423-44a6-b40c-314716174a02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:15.875695 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51d4599-6423-44a6-b40c-314716174a02 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:15.876068 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51d4599-6423-44a6-b40c-314716174a02 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:15.876407 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51d4599-6423-44a6-b40c-314716174a02 None admin] PATH_INFO: `/v3/users/0321cc63a28248c4aa231963acda2810` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:15.892553 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51d4599-6423-44a6-b40c-314716174a02 None admin] RBAC: Authorizing `identity:get_user(user_id=0321cc63a28248c4aa231963acda2810)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:15.894075 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51d4599-6423-44a6-b40c-314716174a02 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:15.896092 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 134/278] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jul 14 09:24:15 2022] GET /identity/v3/users/0321cc63a28248c4aa231963acda2810 => generated 293 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:24:15.904481 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a67a89-2925-4154-8c64-4de43a454a75 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:15.924159 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:16.054725 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a67a89-2925-4154-8c64-4de43a454a75 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:16.101863 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6c0da0-b370-4337-b18d-5f9210b7b0dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:16.103470 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6c0da0-b370-4337-b18d-5f9210b7b0dd None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:16.103981 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6c0da0-b370-4337-b18d-5f9210b7b0dd None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:16.104454 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6c0da0-b370-4337-b18d-5f9210b7b0dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:16.105505 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6c0da0-b370-4337-b18d-5f9210b7b0dd None admin] RBAC: Adding query filter params (role.id=17dfac38a2e540fea229af7de99911bb, user.id=0321cc63a28248c4aa231963acda2810, scope.system=all) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:24:16.105994 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6c0da0-b370-4337-b18d-5f9210b7b0dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:16.107653 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6c0da0-b370-4337-b18d-5f9210b7b0dd None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:16.116098 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 145/279] 10.222.0.40 () {56 vars in 1308 bytes} [Thu Jul 14 09:24:15 2022] GET /identity/v3/role_assignments?user.id=0321cc63a28248c4aa231963acda2810&scope.system=all&role.id=17dfac38a2e540fea229af7de99911bb => generated 226 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:24:16.191892 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3635c07f-b0e7-4cf0-b3bd-e9eb810ae776 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:16.192213 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3635c07f-b0e7-4cf0-b3bd-e9eb810ae776 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:16.192570 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3635c07f-b0e7-4cf0-b3bd-e9eb810ae776 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:16.194222 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 135/280] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:24:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:24:16.200656 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5b6f22-1840-4d30-8593-37f391dd49e7 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:16.201271 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5b6f22-1840-4d30-8593-37f391dd49e7 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:16.201787 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5b6f22-1840-4d30-8593-37f391dd49e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:16.221211 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-7b5b6f22-1840-4d30-8593-37f391dd49e7 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:24:16.222798 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-7b5b6f22-1840-4d30-8593-37f391dd49e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:24:16.333518 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 146/281] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:24:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 09:24:16.376704 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3635c07f-b0e7-4cf0-b3bd-e9eb810ae776 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:16.398646 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:16.514536 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3635c07f-b0e7-4cf0-b3bd-e9eb810ae776 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:16.551634 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa6f2be-f9e4-43f9-b48b-d8fe8db0bce4 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:16.552029 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa6f2be-f9e4-43f9-b48b-d8fe8db0bce4 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:16.552500 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa6f2be-f9e4-43f9-b48b-d8fe8db0bce4 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:16.557953 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 147/282] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:24:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:24:16.568243 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167fb04f-b343-4a32-8445-43fd126528d7 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:16.568243 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167fb04f-b343-4a32-8445-43fd126528d7 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:16.568243 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167fb04f-b343-4a32-8445-43fd126528d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:16.568590 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78325a2a-c410-45bd-8d11-35caec4d0a8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:16.568590 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78325a2a-c410-45bd-8d11-35caec4d0a8b None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:16.568590 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78325a2a-c410-45bd-8d11-35caec4d0a8b None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:16.568590 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78325a2a-c410-45bd-8d11-35caec4d0a8b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:16.593436 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:16.598850 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-167fb04f-b343-4a32-8445-43fd126528d7 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:24:16.599210 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78325a2a-c410-45bd-8d11-35caec4d0a8b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:24:16.600209 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-167fb04f-b343-4a32-8445-43fd126528d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:24:16.615705 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-78325a2a-c410-45bd-8d11-35caec4d0a8b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 09:24:16.615705 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:24:16.615705 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:24:16.615705 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:24:16.615705 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:24:16.615705 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:24:16.615705 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:24:16.615705 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:24:16.615705 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:24:16.615705 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:24:16.615705 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:24:16.615705 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:24:16.615705 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:24:16.615705 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:24:16.615705 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:24:16.615705 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:24:16.616858 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:24:16.616858 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:24:16.616858 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:24:16.616858 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:24:16.616858 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:24:16.616858 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:24:16.616858 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:24:16.616858 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:24:16.616858 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:24:16.616858 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:24:16.616858 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:24:16.616858 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( Jul 14 09:24:16.616858 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:24:16.616858 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:24:16.616858 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:24:16.616858 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:24:16.619169 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:24:16.619169 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:24:16.619169 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:24:16.619169 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:24:16.619169 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:24:16.619169 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:24:16.619169 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:24:16.619169 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:24:16.619169 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:24:16.619169 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:24:16.619169 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 09:24:16.619169 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:24:16.619169 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 136/283] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 14 09:24:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:24:16.635548 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78325a2a-c410-45bd-8d11-35caec4d0a8b None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:16.685856 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 148/284] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:24:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 09:24:16.713614 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167fb04f-b343-4a32-8445-43fd126528d7 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:16.815925 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:16.837730 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167fb04f-b343-4a32-8445-43fd126528d7 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:16.867339 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78325a2a-c410-45bd-8d11-35caec4d0a8b None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:16.877427 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a701205-ca55-4e4b-bfdb-da1acee61429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:16.878273 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a701205-ca55-4e4b-bfdb-da1acee61429 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:16.878562 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a701205-ca55-4e4b-bfdb-da1acee61429 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:16.878838 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a701205-ca55-4e4b-bfdb-da1acee61429 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:16.886719 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:16.893578 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a701205-ca55-4e4b-bfdb-da1acee61429 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:24:16.903395 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-7a701205-ca55-4e4b-bfdb-da1acee61429 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 09:24:16.903395 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:24:16.903395 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:24:16.903395 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:24:16.903395 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:24:16.903395 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:24:16.903395 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:24:16.903395 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:24:16.903395 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:24:16.903395 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:24:16.903395 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:24:16.903395 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:24:16.903395 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:24:16.903395 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:24:16.903395 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:24:16.903395 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:24:16.905134 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:24:16.905134 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:24:16.905134 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:24:16.905134 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:24:16.905134 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:24:16.905134 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:24:16.905134 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:24:16.905134 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:24:16.905134 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:24:16.905134 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:24:16.905134 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:24:16.905134 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( Jul 14 09:24:16.905134 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:24:16.905134 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:24:16.905134 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:24:16.905134 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:24:16.906470 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:24:16.906470 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:24:16.906470 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:24:16.906470 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:24:16.906470 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:24:16.906470 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:24:16.906470 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:24:16.906470 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:24:16.906470 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:24:16.906470 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:24:16.906470 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 09:24:16.906470 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Jul 14 09:24:16.906470 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 149/285] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 14 09:24:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 09:24:16.912675 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a701205-ca55-4e4b-bfdb-da1acee61429 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:16.944955 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d6656b-b22c-4533-873c-dcccdf75c232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:16.946889 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d6656b-b22c-4533-873c-dcccdf75c232 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:16.947178 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d6656b-b22c-4533-873c-dcccdf75c232 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:16.948882 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d6656b-b22c-4533-873c-dcccdf75c232 None admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:16.949672 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d6656b-b22c-4533-873c-dcccdf75c232 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:24:16.949985 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d6656b-b22c-4533-873c-dcccdf75c232 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:16.954458 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d6656b-b22c-4533-873c-dcccdf75c232 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:16.970636 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 137/286] 10.222.0.40 () {56 vars in 1101 bytes} [Thu Jul 14 09:24:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:24:16.972137 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d6656b-b22c-4533-873c-dcccdf75c232 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:17.135008 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a701205-ca55-4e4b-bfdb-da1acee61429 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:17.152919 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d6656b-b22c-4533-873c-dcccdf75c232 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:17.177987 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40667488-04b7-4115-8441-029e64f1b51d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:17.178689 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40667488-04b7-4115-8441-029e64f1b51d None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:17.178972 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40667488-04b7-4115-8441-029e64f1b51d None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:17.179247 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40667488-04b7-4115-8441-029e64f1b51d None admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:17.180009 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40667488-04b7-4115-8441-029e64f1b51d None admin] RBAC: Adding query filter params (name=member) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:24:17.180315 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40667488-04b7-4115-8441-029e64f1b51d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:17.182529 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40667488-04b7-4115-8441-029e64f1b51d None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:17.198746 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 150/287] 10.222.0.40 () {56 vars in 1101 bytes} [Thu Jul 14 09:24:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:24:17.206668 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40667488-04b7-4115-8441-029e64f1b51d None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:17.207170 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02e55ac-90d2-4bdf-baa0-daafab6cfe14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:17.208175 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02e55ac-90d2-4bdf-baa0-daafab6cfe14 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:17.208460 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02e55ac-90d2-4bdf-baa0-daafab6cfe14 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:17.208798 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02e55ac-90d2-4bdf-baa0-daafab6cfe14 None admin] PATH_INFO: `/v3/users/7dd8a25ce8b54f3cba9c5a90a3dff5aa` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:17.210071 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02e55ac-90d2-4bdf-baa0-daafab6cfe14 None admin] RBAC: Authorizing `identity:get_user(user_id=7dd8a25ce8b54f3cba9c5a90a3dff5aa)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:17.211561 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02e55ac-90d2-4bdf-baa0-daafab6cfe14 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:17.213296 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 138/288] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jul 14 09:24:16 2022] GET /identity/v3/users/7dd8a25ce8b54f3cba9c5a90a3dff5aa => generated 297 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:24:17.218537 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02e55ac-90d2-4bdf-baa0-daafab6cfe14 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:17.232669 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:17.323163 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:17.325694 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02e55ac-90d2-4bdf-baa0-daafab6cfe14 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:17.367506 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27dba00-7bd1-4b1c-90f9-603af0f9bb95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:17.368941 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27dba00-7bd1-4b1c-90f9-603af0f9bb95 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:17.369372 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27dba00-7bd1-4b1c-90f9-603af0f9bb95 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:17.369790 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27dba00-7bd1-4b1c-90f9-603af0f9bb95 None admin] PATH_INFO: `/v3/projects/37e686c883dc4b19bd52b4543bcb33e2` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:17.371167 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27dba00-7bd1-4b1c-90f9-603af0f9bb95 None admin] RBAC: Authorizing `identity:get_project(project_id=37e686c883dc4b19bd52b4543bcb33e2)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:17.372747 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27dba00-7bd1-4b1c-90f9-603af0f9bb95 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:17.374632 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 139/289] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jul 14 09:24:17 2022] GET /identity/v3/projects/37e686c883dc4b19bd52b4543bcb33e2 => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:24:17.380479 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27dba00-7bd1-4b1c-90f9-603af0f9bb95 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:17.448985 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40667488-04b7-4115-8441-029e64f1b51d None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:17.490545 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27dba00-7bd1-4b1c-90f9-603af0f9bb95 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:17.514563 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:17.529370 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b05745-07ef-4015-87c2-0977b5506d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:17.530521 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b05745-07ef-4015-87c2-0977b5506d53 None admin] REQUEST_METHOD: `PUT` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:17.530863 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b05745-07ef-4015-87c2-0977b5506d53 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:17.531631 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b05745-07ef-4015-87c2-0977b5506d53 None admin] PATH_INFO: `/v3/projects/37e686c883dc4b19bd52b4543bcb33e2/users/7dd8a25ce8b54f3cba9c5a90a3dff5aa/roles/028a8869bb7b4891b03c0b6afcced73a` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:17.533825 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b05745-07ef-4015-87c2-0977b5506d53 None admin] RBAC: Authorizing `identity:create_grant(project_id=37e686c883dc4b19bd52b4543bcb33e2, user_id=7dd8a25ce8b54f3cba9c5a90a3dff5aa, role_id=028a8869bb7b4891b03c0b6afcced73a)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:17.535550 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b05745-07ef-4015-87c2-0977b5506d53 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:17.549327 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aa0dbf-33af-419c-b320-33ac74c34bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:17.551386 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aa0dbf-33af-419c-b320-33ac74c34bb2 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:17.551505 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 140/290] 10.222.0.40 () {58 vars in 1439 bytes} [Thu Jul 14 09:24:17 2022] PUT /identity/v3/projects/37e686c883dc4b19bd52b4543bcb33e2/users/7dd8a25ce8b54f3cba9c5a90a3dff5aa/roles/028a8869bb7b4891b03c0b6afcced73a => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 09:24:17.551704 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aa0dbf-33af-419c-b320-33ac74c34bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:17.551991 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aa0dbf-33af-419c-b320-33ac74c34bb2 None admin] PATH_INFO: `/v3/users/b3d3f40273f745ac83fc39478933b661` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:17.559785 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49aa0dbf-33af-419c-b320-33ac74c34bb2 None admin] RBAC: Authorizing `identity:get_user(user_id=b3d3f40273f745ac83fc39478933b661)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:17.561408 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49aa0dbf-33af-419c-b320-33ac74c34bb2 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:17.567801 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 151/291] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jul 14 09:24:17 2022] GET /identity/v3/users/b3d3f40273f745ac83fc39478933b661 => generated 297 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:24:17.573837 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b05745-07ef-4015-87c2-0977b5506d53 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:17.716699 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b05745-07ef-4015-87c2-0977b5506d53 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:17.762728 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e448d33-24e7-48b0-ad6b-ea6b392d7ba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:17.763467 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e448d33-24e7-48b0-ad6b-ea6b392d7ba2 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:17.763758 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e448d33-24e7-48b0-ad6b-ea6b392d7ba2 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:17.764090 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e448d33-24e7-48b0-ad6b-ea6b392d7ba2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:17.770046 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:17.871618 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e448d33-24e7-48b0-ad6b-ea6b392d7ba2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:17.873633 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e448d33-24e7-48b0-ad6b-ea6b392d7ba2 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:17.984463 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 141/292] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 14 09:24:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 09:24:17.991692 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aa0dbf-33af-419c-b320-33ac74c34bb2 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:18.127717 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aa0dbf-33af-419c-b320-33ac74c34bb2 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:18.152562 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:18.169683 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb8d784-95de-40e1-8e55-41db490a3b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:18.170580 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb8d784-95de-40e1-8e55-41db490a3b62 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:18.170866 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb8d784-95de-40e1-8e55-41db490a3b62 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:18.171142 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb8d784-95de-40e1-8e55-41db490a3b62 None admin] PATH_INFO: `/v3/projects/37e686c883dc4b19bd52b4543bcb33e2` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:18.172380 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb8d784-95de-40e1-8e55-41db490a3b62 None admin] RBAC: Authorizing `identity:get_project(project_id=37e686c883dc4b19bd52b4543bcb33e2)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:18.173821 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb8d784-95de-40e1-8e55-41db490a3b62 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:18.175562 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 152/293] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jul 14 09:24:17 2022] GET /identity/v3/projects/37e686c883dc4b19bd52b4543bcb33e2 => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:24:18.181470 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e448d33-24e7-48b0-ad6b-ea6b392d7ba2 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:18.227136 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:18.311076 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e448d33-24e7-48b0-ad6b-ea6b392d7ba2 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:18.352150 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c95d18-1312-4eb8-82b0-7a6fd9e63a05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:18.353718 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c95d18-1312-4eb8-82b0-7a6fd9e63a05 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:18.354218 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c95d18-1312-4eb8-82b0-7a6fd9e63a05 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:18.354788 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c95d18-1312-4eb8-82b0-7a6fd9e63a05 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:18.358301 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c95d18-1312-4eb8-82b0-7a6fd9e63a05 None admin] RBAC: Adding query filter params (role.id=17dfac38a2e540fea229af7de99911bb, scope.project.id=37e686c883dc4b19bd52b4543bcb33e2, user.id=b3d3f40273f745ac83fc39478933b661) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:24:18.359945 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c95d18-1312-4eb8-82b0-7a6fd9e63a05 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:18.361880 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c95d18-1312-4eb8-82b0-7a6fd9e63a05 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:18.373638 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 142/294] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jul 14 09:24:18 2022] GET /identity/v3/role_assignments?user.id=b3d3f40273f745ac83fc39478933b661&scope.project.id=37e686c883dc4b19bd52b4543bcb33e2&role.id=17dfac38a2e540fea229af7de99911bb => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:24:18.717073 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067e55c6-55dc-403e-b5bf-785509164953 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:18.717445 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067e55c6-55dc-403e-b5bf-785509164953 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:18.717645 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067e55c6-55dc-403e-b5bf-785509164953 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:18.719374 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 153/295] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:24:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:24:18.724518 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11862864-0709-4c0a-b318-b57ab504f1e7 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:18.724989 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11862864-0709-4c0a-b318-b57ab504f1e7 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:18.725064 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11862864-0709-4c0a-b318-b57ab504f1e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:18.744214 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-11862864-0709-4c0a-b318-b57ab504f1e7 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:24:18.745409 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-11862864-0709-4c0a-b318-b57ab504f1e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:24:18.842080 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 143/296] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:24:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 09:24:18.846236 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb275e43-764e-4ffe-99bf-799743479250 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:18.846568 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb275e43-764e-4ffe-99bf-799743479250 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:18.846850 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb275e43-764e-4ffe-99bf-799743479250 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:18.848215 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 154/297] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:24:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:24:18.853554 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c744dc40-038e-49c2-b548-c9015f890574 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:18.854069 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c744dc40-038e-49c2-b548-c9015f890574 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:18.854525 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c744dc40-038e-49c2-b548-c9015f890574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:18.869342 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb275e43-764e-4ffe-99bf-799743479250 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:18.875171 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-c744dc40-038e-49c2-b548-c9015f890574 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:24:18.876468 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-c744dc40-038e-49c2-b548-c9015f890574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:24:18.905843 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:18.964724 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 144/298] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:24:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 09:24:18.987033 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c744dc40-038e-49c2-b548-c9015f890574 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:19.010099 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb275e43-764e-4ffe-99bf-799743479250 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:19.050153 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf22d73-61b0-450d-b70b-e1b3de084dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:19.051451 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf22d73-61b0-450d-b70b-e1b3de084dd9 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:19.051933 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf22d73-61b0-450d-b70b-e1b3de084dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:19.052680 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf22d73-61b0-450d-b70b-e1b3de084dd9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:19.066353 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf22d73-61b0-450d-b70b-e1b3de084dd9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:24:19.074663 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-adf22d73-61b0-450d-b70b-e1b3de084dd9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 09:24:19.074663 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:24:19.074663 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:24:19.074663 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:24:19.074663 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:24:19.074663 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:24:19.074663 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:24:19.074663 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:24:19.074663 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:24:19.074663 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:24:19.074663 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:24:19.074663 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:24:19.074663 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:24:19.074663 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:24:19.074663 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:24:19.074663 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:24:19.076471 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:24:19.076471 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:24:19.076471 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:24:19.076471 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:24:19.076471 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:24:19.076471 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:24:19.076471 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:24:19.076471 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:24:19.076471 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:24:19.076471 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:24:19.076471 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:24:19.076471 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( Jul 14 09:24:19.076471 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:24:19.076471 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:24:19.076471 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:24:19.076471 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:24:19.077980 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:24:19.077980 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:24:19.077980 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:24:19.077980 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:24:19.077980 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:24:19.077980 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:24:19.077980 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:24:19.077980 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:24:19.077980 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:24:19.077980 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:24:19.077980 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 09:24:19.077980 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Jul 14 09:24:19.077980 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 155/299] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 14 09:24:18 2022] GET /identity/v3/roles/reader => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:24:19.077980 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eef1650-fd4c-4e8e-a1cb-bbd035ffec0a None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:19.078718 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eef1650-fd4c-4e8e-a1cb-bbd035ffec0a None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:19.078718 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eef1650-fd4c-4e8e-a1cb-bbd035ffec0a None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:19.082243 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 156/300] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:24:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:24:19.082243 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eef1650-fd4c-4e8e-a1cb-bbd035ffec0a None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:19.107955 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c744dc40-038e-49c2-b548-c9015f890574 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:19.140735 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:19.148087 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39410aa-b031-4d35-a256-1b3551c115b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:19.149303 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39410aa-b031-4d35-a256-1b3551c115b9 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:19.150157 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39410aa-b031-4d35-a256-1b3551c115b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:19.150529 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39410aa-b031-4d35-a256-1b3551c115b9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:19.151817 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39410aa-b031-4d35-a256-1b3551c115b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:19.153344 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39410aa-b031-4d35-a256-1b3551c115b9 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:19.155179 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 145/301] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 09:24:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:24:19.160681 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88592dce-705e-4d58-9a48-dcf82170db06 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:19.160970 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88592dce-705e-4d58-9a48-dcf82170db06 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:19.161250 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88592dce-705e-4d58-9a48-dcf82170db06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:19.177542 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-88592dce-705e-4d58-9a48-dcf82170db06 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:24:19.178762 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-88592dce-705e-4d58-9a48-dcf82170db06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:24:19.199077 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eef1650-fd4c-4e8e-a1cb-bbd035ffec0a None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:19.205572 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:19.237616 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0367f566-7347-4daa-b8f8-73e54f66b965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:19.238230 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0367f566-7347-4daa-b8f8-73e54f66b965 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:19.238697 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0367f566-7347-4daa-b8f8-73e54f66b965 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:19.238826 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0367f566-7347-4daa-b8f8-73e54f66b965 None admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:19.239558 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0367f566-7347-4daa-b8f8-73e54f66b965 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:24:19.239868 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0367f566-7347-4daa-b8f8-73e54f66b965 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:19.241260 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0367f566-7347-4daa-b8f8-73e54f66b965 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:19.257728 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 157/302] 10.222.0.40 () {56 vars in 1101 bytes} [Thu Jul 14 09:24:19 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:24:19.257728 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0367f566-7347-4daa-b8f8-73e54f66b965 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:19.266110 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 146/303] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:24:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 09:24:19.276819 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88592dce-705e-4d58-9a48-dcf82170db06 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:19.368695 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0367f566-7347-4daa-b8f8-73e54f66b965 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:19.382805 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:19.403416 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88592dce-705e-4d58-9a48-dcf82170db06 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:19.405050 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33baf05-7853-4054-83e8-d98957c37a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:19.405738 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33baf05-7853-4054-83e8-d98957c37a04 None admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:19.406033 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33baf05-7853-4054-83e8-d98957c37a04 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:19.406349 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33baf05-7853-4054-83e8-d98957c37a04 None admin] PATH_INFO: `/v3/groups` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:19.407062 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33baf05-7853-4054-83e8-d98957c37a04 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:19.409360 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33baf05-7853-4054-83e8-d98957c37a04 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:19.442352 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 158/304] 10.222.0.40 () {60 vars in 1134 bytes} [Thu Jul 14 09:24:19 2022] POST /identity/v3/groups => generated 229 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:24:19.442352 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33baf05-7853-4054-83e8-d98957c37a04 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:19.454808 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2e60e7-53f8-4ac9-9985-9bd623497d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:19.455912 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2e60e7-53f8-4ac9-9985-9bd623497d1c None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:19.456292 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2e60e7-53f8-4ac9-9985-9bd623497d1c None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:19.456720 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2e60e7-53f8-4ac9-9985-9bd623497d1c None admin] PATH_INFO: `/v3/users/d6eb3dd8a5fb44c797e47963a17dd430` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:19.475431 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2e60e7-53f8-4ac9-9985-9bd623497d1c None admin] RBAC: Authorizing `identity:get_user(user_id=d6eb3dd8a5fb44c797e47963a17dd430)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:19.477180 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2e60e7-53f8-4ac9-9985-9bd623497d1c None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:19.479673 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 147/305] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jul 14 09:24:19 2022] GET /identity/v3/users/d6eb3dd8a5fb44c797e47963a17dd430 => generated 293 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:24:19.485200 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2e60e7-53f8-4ac9-9985-9bd623497d1c None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:19.511576 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:19.628318 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33baf05-7853-4054-83e8-d98957c37a04 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:19.650921 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2e60e7-53f8-4ac9-9985-9bd623497d1c None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:19.681660 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1e7193-7d68-43e1-9930-dcb97bd9991a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:19.683071 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1e7193-7d68-43e1-9930-dcb97bd9991a None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:19.683658 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1e7193-7d68-43e1-9930-dcb97bd9991a None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:19.683949 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1e7193-7d68-43e1-9930-dcb97bd9991a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:19.702025 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1e7193-7d68-43e1-9930-dcb97bd9991a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:24:19.706513 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b733e13-2cdf-4a98-a4f8-4298180c08ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:19.707276 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b733e13-2cdf-4a98-a4f8-4298180c08ac None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:19.707706 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b733e13-2cdf-4a98-a4f8-4298180c08ac None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:19.708058 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b733e13-2cdf-4a98-a4f8-4298180c08ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:19.709150 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b733e13-2cdf-4a98-a4f8-4298180c08ac None admin] RBAC: Adding query filter params (role.id=028a8869bb7b4891b03c0b6afcced73a, user.id=d6eb3dd8a5fb44c797e47963a17dd430, scope.system=all) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:24:19.709529 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b733e13-2cdf-4a98-a4f8-4298180c08ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:19.710830 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-be1e7193-7d68-43e1-9930-dcb97bd9991a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 09:24:19.710830 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:24:19.710830 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:24:19.710830 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:24:19.710830 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:24:19.710830 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:24:19.710830 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:24:19.710830 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:24:19.710830 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:24:19.710830 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:24:19.710830 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:24:19.710830 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:24:19.710830 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:24:19.710830 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:24:19.710830 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:24:19.710830 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:24:19.712568 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:24:19.712568 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:24:19.712568 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:24:19.712568 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:24:19.712568 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:24:19.712568 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:24:19.712568 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:24:19.712568 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:24:19.712568 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:24:19.712568 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:24:19.712568 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:24:19.712568 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( Jul 14 09:24:19.712568 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:24:19.712568 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:24:19.712568 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:24:19.712568 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:24:19.713454 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:24:19.713454 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:24:19.713454 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:24:19.713454 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:24:19.713454 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:24:19.713454 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:24:19.713454 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:24:19.713454 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:24:19.713454 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:24:19.713454 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:24:19.713454 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 09:24:19.713454 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Jul 14 09:24:19.714152 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b733e13-2cdf-4a98-a4f8-4298180c08ac None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:19.718429 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 159/306] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 14 09:24:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:24:19.720343 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1e7193-7d68-43e1-9930-dcb97bd9991a None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:19.726470 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 148/307] 10.222.0.40 () {56 vars in 1308 bytes} [Thu Jul 14 09:24:19 2022] GET /identity/v3/role_assignments?user.id=d6eb3dd8a5fb44c797e47963a17dd430&scope.system=all&role.id=028a8869bb7b4891b03c0b6afcced73a => generated 226 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:24:19.784782 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:19.889650 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1e7193-7d68-43e1-9930-dcb97bd9991a None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:19.944806 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae819b3e-fda5-4990-a9ea-cd6b36259b90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:19.945845 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae819b3e-fda5-4990-a9ea-cd6b36259b90 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:19.946391 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae819b3e-fda5-4990-a9ea-cd6b36259b90 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:19.946855 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae819b3e-fda5-4990-a9ea-cd6b36259b90 None admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:19.947821 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae819b3e-fda5-4990-a9ea-cd6b36259b90 None admin] RBAC: Adding query filter params (name=member) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:24:19.948320 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae819b3e-fda5-4990-a9ea-cd6b36259b90 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:19.949937 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae819b3e-fda5-4990-a9ea-cd6b36259b90 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:19.959723 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 160/308] 10.222.0.40 () {56 vars in 1101 bytes} [Thu Jul 14 09:24:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:24:19.969962 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b733e13-2cdf-4a98-a4f8-4298180c08ac None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:20.068977 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:20.108401 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b733e13-2cdf-4a98-a4f8-4298180c08ac None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:20.147636 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b960a2-0a72-4fe6-b7e4-e1eca258100c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:20.148592 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b960a2-0a72-4fe6-b7e4-e1eca258100c None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:20.148976 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b960a2-0a72-4fe6-b7e4-e1eca258100c None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:20.149369 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b960a2-0a72-4fe6-b7e4-e1eca258100c None admin] PATH_INFO: `/v3/users/0321cc63a28248c4aa231963acda2810` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:20.150926 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b960a2-0a72-4fe6-b7e4-e1eca258100c None admin] RBAC: Authorizing `identity:get_user(user_id=0321cc63a28248c4aa231963acda2810)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:20.152403 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b960a2-0a72-4fe6-b7e4-e1eca258100c None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:20.154546 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 149/309] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jul 14 09:24:19 2022] GET /identity/v3/users/0321cc63a28248c4aa231963acda2810 => generated 293 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:24:20.161717 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae819b3e-fda5-4990-a9ea-cd6b36259b90 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:20.198866 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e5aad9-041b-424f-bacd-6676e8434419 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:20.199369 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e5aad9-041b-424f-bacd-6676e8434419 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:20.200028 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e5aad9-041b-424f-bacd-6676e8434419 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:20.202539 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 150/310] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:24:20 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:24:20.210728 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd7b9d4-b567-4a62-87d1-3e49eb055849 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:20.211544 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd7b9d4-b567-4a62-87d1-3e49eb055849 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:20.212237 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd7b9d4-b567-4a62-87d1-3e49eb055849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:20.250518 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-0fd7b9d4-b567-4a62-87d1-3e49eb055849 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:24:20.252943 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-0fd7b9d4-b567-4a62-87d1-3e49eb055849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:24:20.283099 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:20.294174 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae819b3e-fda5-4990-a9ea-cd6b36259b90 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:20.348973 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537d98b8-f11b-4a6f-af6e-abb94ba8967e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:20.349768 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537d98b8-f11b-4a6f-af6e-abb94ba8967e None admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:20.350057 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537d98b8-f11b-4a6f-af6e-abb94ba8967e None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:20.350371 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537d98b8-f11b-4a6f-af6e-abb94ba8967e None admin] PATH_INFO: `/v3/system/users/0321cc63a28248c4aa231963acda2810/roles/17dfac38a2e540fea229af7de99911bb` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:20.352241 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537d98b8-f11b-4a6f-af6e-abb94ba8967e None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=0321cc63a28248c4aa231963acda2810, role_id=17dfac38a2e540fea229af7de99911bb)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:20.354267 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537d98b8-f11b-4a6f-af6e-abb94ba8967e None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:20.367599 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 151/311] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:24:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 09:24:20.370532 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 161/312] 10.222.0.40 () {58 vars in 1334 bytes} [Thu Jul 14 09:24:20 2022] PUT /identity/v3/system/users/0321cc63a28248c4aa231963acda2810/roles/17dfac38a2e540fea229af7de99911bb => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:24:20.393233 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd7b9d4-b567-4a62-87d1-3e49eb055849 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:20.503580 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:20.542373 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd7b9d4-b567-4a62-87d1-3e49eb055849 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:20.579114 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0311c210-bfd9-448d-9697-817084a958b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:20.579918 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0311c210-bfd9-448d-9697-817084a958b0 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:20.580199 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0311c210-bfd9-448d-9697-817084a958b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:20.580474 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0311c210-bfd9-448d-9697-817084a958b0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:20.596574 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0311c210-bfd9-448d-9697-817084a958b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:24:20.605282 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-0311c210-bfd9-448d-9697-817084a958b0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 09:24:20.605282 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:24:20.605282 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:24:20.605282 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:24:20.605282 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:24:20.605282 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:24:20.605282 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:24:20.605282 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:24:20.605282 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:24:20.605282 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:24:20.605282 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:24:20.605282 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:24:20.605282 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:24:20.605282 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:24:20.605282 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:24:20.605282 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:24:20.606442 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:24:20.606442 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:24:20.606442 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:24:20.606442 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:24:20.606442 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:24:20.606442 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:24:20.606442 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:24:20.606442 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:24:20.606442 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:24:20.606442 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:24:20.606442 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:24:20.606442 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( Jul 14 09:24:20.606442 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:24:20.606442 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:24:20.606442 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:24:20.606442 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:24:20.608181 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:24:20.608181 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:24:20.608181 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:24:20.608181 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:24:20.608181 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:24:20.608181 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:24:20.608181 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:24:20.608181 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:24:20.608181 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:24:20.608181 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:24:20.608181 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 09:24:20.608181 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:24:20.608181 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 152/313] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 14 09:24:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 09:24:20.612921 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537d98b8-f11b-4a6f-af6e-abb94ba8967e None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:20.718863 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537d98b8-f11b-4a6f-af6e-abb94ba8967e None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:20.753552 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c6a9d9-e281-4cff-a20e-05e92303e1ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:20.754252 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c6a9d9-e281-4cff-a20e-05e92303e1ee None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:20.754542 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c6a9d9-e281-4cff-a20e-05e92303e1ee None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:20.754816 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c6a9d9-e281-4cff-a20e-05e92303e1ee None admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:20.755578 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c6a9d9-e281-4cff-a20e-05e92303e1ee None admin] RBAC: Adding query filter params (name=reader) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:24:20.755886 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c6a9d9-e281-4cff-a20e-05e92303e1ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:20.757269 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c6a9d9-e281-4cff-a20e-05e92303e1ee None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:20.766811 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 162/314] 10.222.0.40 () {56 vars in 1101 bytes} [Thu Jul 14 09:24:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:24:20.772407 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0311c210-bfd9-448d-9697-817084a958b0 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:20.875785 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0311c210-bfd9-448d-9697-817084a958b0 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:20.911083 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef5eb6c-50fb-48a0-8410-b91ebb7482d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:20.911967 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef5eb6c-50fb-48a0-8410-b91ebb7482d1 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:20.912250 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef5eb6c-50fb-48a0-8410-b91ebb7482d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:20.912526 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef5eb6c-50fb-48a0-8410-b91ebb7482d1 None admin] PATH_INFO: `/v3/users/7dd8a25ce8b54f3cba9c5a90a3dff5aa` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:20.913741 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef5eb6c-50fb-48a0-8410-b91ebb7482d1 None admin] RBAC: Authorizing `identity:get_user(user_id=7dd8a25ce8b54f3cba9c5a90a3dff5aa)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:20.915259 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef5eb6c-50fb-48a0-8410-b91ebb7482d1 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:20.918087 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 153/315] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jul 14 09:24:20 2022] GET /identity/v3/users/7dd8a25ce8b54f3cba9c5a90a3dff5aa => generated 297 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:24:20.922885 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c6a9d9-e281-4cff-a20e-05e92303e1ee None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:20.954541 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:21.047502 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c6a9d9-e281-4cff-a20e-05e92303e1ee None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:21.082773 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb96b14c-a5b0-4ff2-89b5-4ad09e87b8bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:21.083426 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb96b14c-a5b0-4ff2-89b5-4ad09e87b8bb None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:21.083712 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb96b14c-a5b0-4ff2-89b5-4ad09e87b8bb None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:21.083991 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb96b14c-a5b0-4ff2-89b5-4ad09e87b8bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:21.153285 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb96b14c-a5b0-4ff2-89b5-4ad09e87b8bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:21.154790 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb96b14c-a5b0-4ff2-89b5-4ad09e87b8bb None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:21.178592 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:21.256231 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 163/316] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 14 09:24:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 09:24:21.262557 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef5eb6c-50fb-48a0-8410-b91ebb7482d1 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:21.281800 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:21.365091 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef5eb6c-50fb-48a0-8410-b91ebb7482d1 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:21.400951 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab683209-90ce-4047-a5eb-da2b418d7df6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:21.401842 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab683209-90ce-4047-a5eb-da2b418d7df6 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:21.402129 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab683209-90ce-4047-a5eb-da2b418d7df6 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:21.402445 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab683209-90ce-4047-a5eb-da2b418d7df6 None admin] PATH_INFO: `/v3/projects/37e686c883dc4b19bd52b4543bcb33e2` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:21.403795 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab683209-90ce-4047-a5eb-da2b418d7df6 None admin] RBAC: Authorizing `identity:get_project(project_id=37e686c883dc4b19bd52b4543bcb33e2)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:21.405279 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab683209-90ce-4047-a5eb-da2b418d7df6 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:21.407572 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 154/317] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jul 14 09:24:21 2022] GET /identity/v3/projects/37e686c883dc4b19bd52b4543bcb33e2 => generated 302 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:24:21.416136 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb96b14c-a5b0-4ff2-89b5-4ad09e87b8bb None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:21.538635 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb96b14c-a5b0-4ff2-89b5-4ad09e87b8bb None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:21.571300 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:21.581045 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7637bc3d-9351-4591-93ff-9a98e3beb987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:21.581751 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7637bc3d-9351-4591-93ff-9a98e3beb987 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:21.582038 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7637bc3d-9351-4591-93ff-9a98e3beb987 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:21.582458 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7637bc3d-9351-4591-93ff-9a98e3beb987 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:21.584023 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7637bc3d-9351-4591-93ff-9a98e3beb987 None admin] RBAC: Adding query filter params (role.id=028a8869bb7b4891b03c0b6afcced73a, scope.project.id=37e686c883dc4b19bd52b4543bcb33e2, user.id=7dd8a25ce8b54f3cba9c5a90a3dff5aa) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:24:21.584393 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7637bc3d-9351-4591-93ff-9a98e3beb987 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:21.586223 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7637bc3d-9351-4591-93ff-9a98e3beb987 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:21.593624 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 164/318] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jul 14 09:24:21 2022] GET /identity/v3/role_assignments?user.id=7dd8a25ce8b54f3cba9c5a90a3dff5aa&scope.project.id=37e686c883dc4b19bd52b4543bcb33e2&role.id=028a8869bb7b4891b03c0b6afcced73a => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:24:22.002849 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abe1982-ad33-410f-af51-a4179f321aca None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:22.003366 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abe1982-ad33-410f-af51-a4179f321aca None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:22.006368 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abe1982-ad33-410f-af51-a4179f321aca None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:22.007972 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 155/319] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:24:22 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:24:22.014087 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e43d34f-4362-43af-b166-3a6877784c90 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:22.014481 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e43d34f-4362-43af-b166-3a6877784c90 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:22.014834 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e43d34f-4362-43af-b166-3a6877784c90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:22.032700 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-9e43d34f-4362-43af-b166-3a6877784c90 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:24:22.033905 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-9e43d34f-4362-43af-b166-3a6877784c90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:24:22.054608 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2c03ed-65ee-44f6-bc2b-4226e175a105 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:22.054916 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2c03ed-65ee-44f6-bc2b-4226e175a105 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:22.055186 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2c03ed-65ee-44f6-bc2b-4226e175a105 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:22.056608 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 156/320] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:24:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:24:22.065148 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9214fe3c-bda6-4be3-a054-d9f426493f7a None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:22.065866 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9214fe3c-bda6-4be3-a054-d9f426493f7a None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:22.066159 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9214fe3c-bda6-4be3-a054-d9f426493f7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:22.086129 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-9214fe3c-bda6-4be3-a054-d9f426493f7a None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:24:22.087898 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-9214fe3c-bda6-4be3-a054-d9f426493f7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:24:22.108322 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 165/321] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:24:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 09:24:22.132182 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e43d34f-4362-43af-b166-3a6877784c90 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:22.163590 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 157/322] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:24:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 09:24:22.185562 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9214fe3c-bda6-4be3-a054-d9f426493f7a None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:22.188797 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:22.241754 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e43d34f-4362-43af-b166-3a6877784c90 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:22.259957 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:22.280385 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d55f553-f5e5-454e-83c9-c2b94a910dce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:22.281191 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d55f553-f5e5-454e-83c9-c2b94a910dce None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:22.281536 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d55f553-f5e5-454e-83c9-c2b94a910dce None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:22.281751 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d55f553-f5e5-454e-83c9-c2b94a910dce None admin] PATH_INFO: `/v3/domains/default` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:22.283092 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d55f553-f5e5-454e-83c9-c2b94a910dce None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:22.284595 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d55f553-f5e5-454e-83c9-c2b94a910dce None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:22.290225 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 166/323] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 09:24:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:24:22.291815 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d55f553-f5e5-454e-83c9-c2b94a910dce None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:22.310820 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9214fe3c-bda6-4be3-a054-d9f426493f7a None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:22.350909 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c272d8-aa44-4f95-b3cc-6d02304de8cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:22.351721 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c272d8-aa44-4f95-b3cc-6d02304de8cb None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:22.352045 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c272d8-aa44-4f95-b3cc-6d02304de8cb None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:22.352292 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c272d8-aa44-4f95-b3cc-6d02304de8cb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:22.364069 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c272d8-aa44-4f95-b3cc-6d02304de8cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:24:22.374326 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-b9c272d8-aa44-4f95-b3cc-6d02304de8cb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 09:24:22.374326 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:24:22.374326 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:24:22.374326 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:24:22.374326 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:24:22.374326 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:24:22.374326 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:24:22.374326 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:24:22.374326 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:24:22.374326 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:24:22.374326 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:24:22.374326 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:24:22.374326 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:24:22.374326 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:24:22.374326 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:24:22.374326 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:24:22.375281 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:24:22.375281 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:24:22.375281 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:24:22.375281 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:24:22.375281 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:24:22.375281 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:24:22.375281 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:24:22.375281 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:24:22.375281 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:24:22.375281 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:24:22.375281 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:24:22.375281 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( Jul 14 09:24:22.375281 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:24:22.375281 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:24:22.375281 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:24:22.375281 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:24:22.381115 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:24:22.381115 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:24:22.381115 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:24:22.381115 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:24:22.381115 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:24:22.381115 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:24:22.381115 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:24:22.381115 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:24:22.381115 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:24:22.381115 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:24:22.381115 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 09:24:22.381115 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:24:22.381115 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 158/324] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 14 09:24:22 2022] GET /identity/v3/roles/reader => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 09:24:22.381761 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c272d8-aa44-4f95-b3cc-6d02304de8cb None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:22.416262 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d55f553-f5e5-454e-83c9-c2b94a910dce None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:22.454161 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd36a6f9-f3ee-4477-bf6e-56c08f9dfb53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:22.454890 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd36a6f9-f3ee-4477-bf6e-56c08f9dfb53 None admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:22.455182 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd36a6f9-f3ee-4477-bf6e-56c08f9dfb53 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:22.455456 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd36a6f9-f3ee-4477-bf6e-56c08f9dfb53 None admin] PATH_INFO: `/v3/groups` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:22.456167 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd36a6f9-f3ee-4477-bf6e-56c08f9dfb53 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:22.457637 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd36a6f9-f3ee-4477-bf6e-56c08f9dfb53 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:22.459914 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:22.475144 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 167/325] 10.222.0.40 () {60 vars in 1134 bytes} [Thu Jul 14 09:24:22 2022] POST /identity/v3/groups => generated 226 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 09:24:22.506110 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c272d8-aa44-4f95-b3cc-6d02304de8cb None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:22.549044 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676f4b21-b62c-497a-977b-e52115c52776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:22.549679 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676f4b21-b62c-497a-977b-e52115c52776 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:22.549965 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676f4b21-b62c-497a-977b-e52115c52776 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:22.550289 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676f4b21-b62c-497a-977b-e52115c52776 None admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:22.551128 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676f4b21-b62c-497a-977b-e52115c52776 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:24:22.551650 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676f4b21-b62c-497a-977b-e52115c52776 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:22.553203 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676f4b21-b62c-497a-977b-e52115c52776 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:22.566946 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 159/326] 10.222.0.40 () {56 vars in 1101 bytes} [Thu Jul 14 09:24:22 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:24:22.573120 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd36a6f9-f3ee-4477-bf6e-56c08f9dfb53 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:22.626321 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:22.689611 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd36a6f9-f3ee-4477-bf6e-56c08f9dfb53 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:22.728959 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5516a46c-e133-4c10-b626-3a11e0f37a6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:22.729860 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5516a46c-e133-4c10-b626-3a11e0f37a6e None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:22.730148 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5516a46c-e133-4c10-b626-3a11e0f37a6e None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:22.730475 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5516a46c-e133-4c10-b626-3a11e0f37a6e None admin] PATH_INFO: `/v3/users/d6eb3dd8a5fb44c797e47963a17dd430` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:22.731746 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5516a46c-e133-4c10-b626-3a11e0f37a6e None admin] RBAC: Authorizing `identity:get_user(user_id=d6eb3dd8a5fb44c797e47963a17dd430)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:22.733220 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5516a46c-e133-4c10-b626-3a11e0f37a6e None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:22.735363 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 168/327] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jul 14 09:24:22 2022] GET /identity/v3/users/d6eb3dd8a5fb44c797e47963a17dd430 => generated 293 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:24:22.745258 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676f4b21-b62c-497a-977b-e52115c52776 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:22.779180 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99a71ef-adaf-43ba-95bb-3b6fe330203b None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:22.779465 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99a71ef-adaf-43ba-95bb-3b6fe330203b None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:22.779746 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99a71ef-adaf-43ba-95bb-3b6fe330203b None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:22.782252 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 169/328] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:24:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 09:24:22.787035 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34536d43-92d7-4398-bca3-f04a2a55d7ce None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:22.787327 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34536d43-92d7-4398-bca3-f04a2a55d7ce None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:22.787610 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34536d43-92d7-4398-bca3-f04a2a55d7ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:22.820217 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-34536d43-92d7-4398-bca3-f04a2a55d7ce None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:24:22.823241 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-34536d43-92d7-4398-bca3-f04a2a55d7ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:24:22.893309 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676f4b21-b62c-497a-977b-e52115c52776 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:22.924376 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:22.927982 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 170/329] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:24:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 09:24:22.938054 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55340bc-2a41-4b4f-aa6d-b056ed357ed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:22.939169 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55340bc-2a41-4b4f-aa6d-b056ed357ed0 None admin] REQUEST_METHOD: `PUT` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:22.939525 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55340bc-2a41-4b4f-aa6d-b056ed357ed0 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:22.939876 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55340bc-2a41-4b4f-aa6d-b056ed357ed0 None admin] PATH_INFO: `/v3/system/users/d6eb3dd8a5fb44c797e47963a17dd430/roles/028a8869bb7b4891b03c0b6afcced73a` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:22.941556 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55340bc-2a41-4b4f-aa6d-b056ed357ed0 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=d6eb3dd8a5fb44c797e47963a17dd430, role_id=028a8869bb7b4891b03c0b6afcced73a)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:22.943056 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55340bc-2a41-4b4f-aa6d-b056ed357ed0 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:22.955069 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34536d43-92d7-4398-bca3-f04a2a55d7ce None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:22.958678 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 160/330] 10.222.0.40 () {58 vars in 1334 bytes} [Thu Jul 14 09:24:22 2022] PUT /identity/v3/system/users/d6eb3dd8a5fb44c797e47963a17dd430/roles/028a8869bb7b4891b03c0b6afcced73a => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:24:23.054602 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:23.142512 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34536d43-92d7-4398-bca3-f04a2a55d7ce None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:23.184280 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b85d557-e92e-47f2-a56f-b791ba7b1d28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:23.185107 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b85d557-e92e-47f2-a56f-b791ba7b1d28 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:23.185395 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b85d557-e92e-47f2-a56f-b791ba7b1d28 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:23.185676 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b85d557-e92e-47f2-a56f-b791ba7b1d28 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:23.198842 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b85d557-e92e-47f2-a56f-b791ba7b1d28 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:24:23.206801 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-4b85d557-e92e-47f2-a56f-b791ba7b1d28 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 09:24:23.206801 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:24:23.206801 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:24:23.206801 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:24:23.206801 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:24:23.206801 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:24:23.206801 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:24:23.206801 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:24:23.206801 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:24:23.206801 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:24:23.206801 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:24:23.206801 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:24:23.206801 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:24:23.206801 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:24:23.206801 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:24:23.206801 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:24:23.207727 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:24:23.207727 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:24:23.207727 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:24:23.207727 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:24:23.207727 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:24:23.207727 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:24:23.207727 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:24:23.207727 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:24:23.207727 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:24:23.207727 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:24:23.207727 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:24:23.207727 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( Jul 14 09:24:23.207727 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:24:23.207727 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:24:23.207727 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:24:23.207727 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:24:23.208776 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:24:23.208776 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:24:23.208776 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:24:23.208776 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:24:23.208776 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:24:23.208776 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:24:23.208776 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:24:23.208776 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:24:23.208776 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:24:23.208776 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:24:23.208776 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 09:24:23.208776 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Jul 14 09:24:23.208776 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 171/331] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 14 09:24:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:24:23.216971 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55340bc-2a41-4b4f-aa6d-b056ed357ed0 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:23.381717 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55340bc-2a41-4b4f-aa6d-b056ed357ed0 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:23.422498 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7b858e-ccb5-4874-840a-877eff6425cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:23.423478 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7b858e-ccb5-4874-840a-877eff6425cb None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:23.423960 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7b858e-ccb5-4874-840a-877eff6425cb None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:23.424422 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7b858e-ccb5-4874-840a-877eff6425cb None admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:23.425803 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7b858e-ccb5-4874-840a-877eff6425cb None admin] RBAC: Adding query filter params (name=member) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:24:23.426331 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7b858e-ccb5-4874-840a-877eff6425cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:23.428915 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7b858e-ccb5-4874-840a-877eff6425cb None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:23.449781 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 161/332] 10.222.0.40 () {56 vars in 1101 bytes} [Thu Jul 14 09:24:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:24:23.455730 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b85d557-e92e-47f2-a56f-b791ba7b1d28 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:23.612877 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b85d557-e92e-47f2-a56f-b791ba7b1d28 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:23.614590 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:23.658044 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f08172b-fa32-4250-8137-4b6a5bc171be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:23.658947 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f08172b-fa32-4250-8137-4b6a5bc171be None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:23.659232 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f08172b-fa32-4250-8137-4b6a5bc171be None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:23.659513 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f08172b-fa32-4250-8137-4b6a5bc171be None admin] PATH_INFO: `/v3/users/0321cc63a28248c4aa231963acda2810` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:23.660725 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f08172b-fa32-4250-8137-4b6a5bc171be None admin] RBAC: Authorizing `identity:get_user(user_id=0321cc63a28248c4aa231963acda2810)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:23.662168 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f08172b-fa32-4250-8137-4b6a5bc171be None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:23.663931 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 172/333] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jul 14 09:24:23 2022] GET /identity/v3/users/0321cc63a28248c4aa231963acda2810 => generated 293 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:24:23.670023 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7b858e-ccb5-4874-840a-877eff6425cb None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:23.757362 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:23.820349 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7b858e-ccb5-4874-840a-877eff6425cb None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:23.864250 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad4f16f-cea6-4fbf-980d-c4e1544ad5ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:23.864922 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad4f16f-cea6-4fbf-980d-c4e1544ad5ef None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:23.865209 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad4f16f-cea6-4fbf-980d-c4e1544ad5ef None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:23.865490 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad4f16f-cea6-4fbf-980d-c4e1544ad5ef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:23.866365 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad4f16f-cea6-4fbf-980d-c4e1544ad5ef None admin] RBAC: Adding query filter params (role.id=17dfac38a2e540fea229af7de99911bb, user.id=0321cc63a28248c4aa231963acda2810, scope.system=all) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:24:23.866684 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad4f16f-cea6-4fbf-980d-c4e1544ad5ef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:23.868449 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad4f16f-cea6-4fbf-980d-c4e1544ad5ef None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:23.887145 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 162/334] 10.222.0.40 () {56 vars in 1308 bytes} [Thu Jul 14 09:24:23 2022] GET /identity/v3/role_assignments?user.id=0321cc63a28248c4aa231963acda2810&scope.system=all&role.id=17dfac38a2e540fea229af7de99911bb => generated 510 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:24:25.296433 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a21a22-f176-4fec-871d-d9921a4cdeb0 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:25.297454 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a21a22-f176-4fec-871d-d9921a4cdeb0 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:25.297959 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a21a22-f176-4fec-871d-d9921a4cdeb0 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:25.299796 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 173/335] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:24:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:24:25.305917 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcbd4c6-9bfe-4b52-af78-4e57574cc431 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:25.306806 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcbd4c6-9bfe-4b52-af78-4e57574cc431 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:25.307301 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcbd4c6-9bfe-4b52-af78-4e57574cc431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:25.326169 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-1bcbd4c6-9bfe-4b52-af78-4e57574cc431 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:24:25.327738 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-1bcbd4c6-9bfe-4b52-af78-4e57574cc431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:24:25.416947 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 163/336] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:24:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 09:24:25.444424 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a21a22-f176-4fec-871d-d9921a4cdeb0 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:25.581157 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a21a22-f176-4fec-871d-d9921a4cdeb0 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:25.623970 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5664cc-ca13-48b7-b6a9-335fb100d287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:25.624803 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5664cc-ca13-48b7-b6a9-335fb100d287 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:25.625091 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5664cc-ca13-48b7-b6a9-335fb100d287 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:25.625374 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5664cc-ca13-48b7-b6a9-335fb100d287 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:25.640675 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5664cc-ca13-48b7-b6a9-335fb100d287 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:24:25.649630 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-fb5664cc-ca13-48b7-b6a9-335fb100d287 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 09:24:25.649630 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:24:25.649630 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:24:25.649630 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:24:25.649630 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:24:25.649630 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:24:25.649630 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:24:25.649630 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:24:25.649630 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:24:25.649630 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:24:25.649630 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:24:25.649630 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:24:25.649630 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:24:25.649630 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:24:25.649630 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:24:25.649630 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:24:25.650631 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:24:25.650631 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:24:25.650631 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:24:25.650631 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:24:25.650631 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:24:25.650631 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:24:25.650631 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:24:25.650631 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:24:25.650631 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:24:25.650631 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:24:25.650631 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:24:25.650631 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( Jul 14 09:24:25.650631 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:24:25.650631 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:24:25.650631 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:24:25.650631 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:24:25.651465 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:24:25.651465 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:24:25.651465 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:24:25.651465 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:24:25.651465 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:24:25.651465 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:24:25.651465 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:24:25.651465 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:24:25.651465 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:24:25.651465 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:24:25.651465 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 09:24:25.651465 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Jul 14 09:24:25.651465 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 174/337] 10.222.0.40 () {56 vars in 1114 bytes} [Thu Jul 14 09:24:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:24:25.658560 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcbd4c6-9bfe-4b52-af78-4e57574cc431 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:25.710657 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51699ae-b431-4599-87cb-bfa6a8f3170b None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:25.710991 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51699ae-b431-4599-87cb-bfa6a8f3170b None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:25.711222 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51699ae-b431-4599-87cb-bfa6a8f3170b None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:25.713412 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 175/338] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:24:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 09:24:25.719989 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8502f960-7338-4f25-8752-032d6796fc41 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:25.720735 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8502f960-7338-4f25-8752-032d6796fc41 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:25.722421 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8502f960-7338-4f25-8752-032d6796fc41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:25.746497 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:25.760354 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-8502f960-7338-4f25-8752-032d6796fc41 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:24:25.762793 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-8502f960-7338-4f25-8752-032d6796fc41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:24:25.816026 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:25.872779 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcbd4c6-9bfe-4b52-af78-4e57574cc431 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:25.893755 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 176/339] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:24:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 09:24:25.895793 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd012e37-6c2c-4569-a925-6847b5f2bfdf None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:25.896295 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd012e37-6c2c-4569-a925-6847b5f2bfdf None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:25.896805 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd012e37-6c2c-4569-a925-6847b5f2bfdf None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:25.898442 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 177/340] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:24:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:24:25.905252 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dbdf15-37c8-4b75-95eb-fd6edf21c5c8 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:25.905834 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dbdf15-37c8-4b75-95eb-fd6edf21c5c8 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:25.906344 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dbdf15-37c8-4b75-95eb-fd6edf21c5c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:25.933572 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-93dbdf15-37c8-4b75-95eb-fd6edf21c5c8 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:24:25.935319 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-93dbdf15-37c8-4b75-95eb-fd6edf21c5c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:24:25.936838 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b6a60c-79ce-4737-a4dc-3f682774deb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:25.938104 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b6a60c-79ce-4737-a4dc-3f682774deb4 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:25.939650 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b6a60c-79ce-4737-a4dc-3f682774deb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:25.940172 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b6a60c-79ce-4737-a4dc-3f682774deb4 None admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:25.941159 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b6a60c-79ce-4737-a4dc-3f682774deb4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:24:25.941674 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b6a60c-79ce-4737-a4dc-3f682774deb4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:25.943399 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b6a60c-79ce-4737-a4dc-3f682774deb4 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:25.955737 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 164/341] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jul 14 09:24:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:24:25.957103 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b6a60c-79ce-4737-a4dc-3f682774deb4 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:26.032343 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 178/342] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:24:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 09:24:26.033258 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dbdf15-37c8-4b75-95eb-fd6edf21c5c8 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:26.108650 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b6a60c-79ce-4737-a4dc-3f682774deb4 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:26.110343 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:26.163697 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e21e2f-1d76-44b8-8875-7aecd882e75d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:26.166506 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e21e2f-1d76-44b8-8875-7aecd882e75d None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:26.167088 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e21e2f-1d76-44b8-8875-7aecd882e75d None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:26.168137 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e21e2f-1d76-44b8-8875-7aecd882e75d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:26.194125 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e21e2f-1d76-44b8-8875-7aecd882e75d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:24:26.213095 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-46e21e2f-1d76-44b8-8875-7aecd882e75d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 09:24:26.213095 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:24:26.213095 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:24:26.213095 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:24:26.213095 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:24:26.213095 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:24:26.213095 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:24:26.213095 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:24:26.213095 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:24:26.213095 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:24:26.213095 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:24:26.213095 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:24:26.213095 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:24:26.213095 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:24:26.213095 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:24:26.213095 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:24:26.214078 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:24:26.214078 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:24:26.214078 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:24:26.214078 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:24:26.214078 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:24:26.214078 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:24:26.214078 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:24:26.214078 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:24:26.214078 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:24:26.214078 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:24:26.214078 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:24:26.214078 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( Jul 14 09:24:26.214078 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:24:26.214078 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:24:26.214078 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:24:26.214078 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:24:26.214913 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:24:26.214913 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:24:26.214913 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:24:26.214913 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:24:26.214913 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:24:26.214913 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:24:26.214913 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:24:26.214913 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:24:26.214913 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:24:26.214913 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:24:26.214913 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 09:24:26.214913 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:24:26.215510 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 165/343] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 14 09:24:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:24:26.217264 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e21e2f-1d76-44b8-8875-7aecd882e75d None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:26.224544 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:26.249806 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dbdf15-37c8-4b75-95eb-fd6edf21c5c8 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:26.325179 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe758526-1cc9-48d5-a936-b2d2b2be5224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:26.326474 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe758526-1cc9-48d5-a936-b2d2b2be5224 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:26.326955 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe758526-1cc9-48d5-a936-b2d2b2be5224 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:26.327427 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe758526-1cc9-48d5-a936-b2d2b2be5224 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:26.339224 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e21e2f-1d76-44b8-8875-7aecd882e75d None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:26.388608 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661980dc-36eb-44f7-ab41-a8eb262962c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:26.389636 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661980dc-36eb-44f7-ab41-a8eb262962c0 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:26.389928 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661980dc-36eb-44f7-ab41-a8eb262962c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:26.390668 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661980dc-36eb-44f7-ab41-a8eb262962c0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:26.413181 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661980dc-36eb-44f7-ab41-a8eb262962c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:24:26.424301 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-661980dc-36eb-44f7-ab41-a8eb262962c0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 09:24:26.424301 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:24:26.424301 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:24:26.424301 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:24:26.424301 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:24:26.424301 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:24:26.424301 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:24:26.424301 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:24:26.424301 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:24:26.424301 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:24:26.424301 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:24:26.424301 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:24:26.424301 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:24:26.424301 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:24:26.424301 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:24:26.424301 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:24:26.425254 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:24:26.425254 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:24:26.425254 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:24:26.425254 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:24:26.425254 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:24:26.425254 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:24:26.425254 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:24:26.425254 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:24:26.425254 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:24:26.425254 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:24:26.425254 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:24:26.425254 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( Jul 14 09:24:26.425254 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:24:26.425254 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:24:26.425254 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:24:26.425254 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:24:26.426065 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:24:26.426065 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:24:26.426065 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:24:26.426065 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:24:26.426065 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:24:26.426065 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:24:26.426065 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:24:26.426065 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:24:26.426065 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:24:26.426065 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:24:26.426065 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 09:24:26.426065 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:24:26.426065 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 166/344] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 14 09:24:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:24:26.428386 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661980dc-36eb-44f7-ab41-a8eb262962c0 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:26.448894 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe758526-1cc9-48d5-a936-b2d2b2be5224 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:26.451105 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe758526-1cc9-48d5-a936-b2d2b2be5224 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:26.468607 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:26.555887 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:26.566866 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 179/345] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 14 09:24:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 534 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 09:24:26.567730 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe758526-1cc9-48d5-a936-b2d2b2be5224 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:26.590576 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661980dc-36eb-44f7-ab41-a8eb262962c0 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:26.635981 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac07a23d-6468-4463-bc0a-c8d745922256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:26.636665 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac07a23d-6468-4463-bc0a-c8d745922256 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:26.636950 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac07a23d-6468-4463-bc0a-c8d745922256 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:26.637329 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac07a23d-6468-4463-bc0a-c8d745922256 None admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:26.638353 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac07a23d-6468-4463-bc0a-c8d745922256 None admin] RBAC: Adding query filter params (name=member) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:24:26.638730 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac07a23d-6468-4463-bc0a-c8d745922256 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:26.640079 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac07a23d-6468-4463-bc0a-c8d745922256 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:26.650468 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 167/346] 10.222.0.40 () {56 vars in 1101 bytes} [Thu Jul 14 09:24:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:24:26.651326 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac07a23d-6468-4463-bc0a-c8d745922256 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:26.677454 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe758526-1cc9-48d5-a936-b2d2b2be5224 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:26.719108 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c20bff7-84bf-4660-a828-dbda56dc423e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:26.720478 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c20bff7-84bf-4660-a828-dbda56dc423e None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:26.721242 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c20bff7-84bf-4660-a828-dbda56dc423e None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:26.721730 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c20bff7-84bf-4660-a828-dbda56dc423e None admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:26.723217 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c20bff7-84bf-4660-a828-dbda56dc423e None admin] RBAC: Adding query filter params (name=reader) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:24:26.723875 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c20bff7-84bf-4660-a828-dbda56dc423e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:26.725760 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c20bff7-84bf-4660-a828-dbda56dc423e None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:26.737582 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 180/347] 10.222.0.40 () {56 vars in 1101 bytes} [Thu Jul 14 09:24:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:24:26.738975 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c20bff7-84bf-4660-a828-dbda56dc423e None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:26.754455 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:26.778263 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac07a23d-6468-4463-bc0a-c8d745922256 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:26.813632 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:26.825061 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dabc63d-bf47-4c70-9269-f569d7bc1a36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:26.826117 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dabc63d-bf47-4c70-9269-f569d7bc1a36 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:26.826579 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dabc63d-bf47-4c70-9269-f569d7bc1a36 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:26.826955 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dabc63d-bf47-4c70-9269-f569d7bc1a36 None admin] PATH_INFO: `/v3/projects/86c6d2afd7954c56860744ef0c7dc36d` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:26.828333 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dabc63d-bf47-4c70-9269-f569d7bc1a36 None admin] RBAC: Authorizing `identity:get_project(project_id=86c6d2afd7954c56860744ef0c7dc36d)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:26.830678 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dabc63d-bf47-4c70-9269-f569d7bc1a36 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:26.837059 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 168/348] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jul 14 09:24:26 2022] GET /identity/v3/projects/86c6d2afd7954c56860744ef0c7dc36d => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:24:26.839079 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40148e8-050f-4632-9422-25442d4628f6 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:26.839593 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40148e8-050f-4632-9422-25442d4628f6 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:26.840101 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40148e8-050f-4632-9422-25442d4628f6 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:26.841620 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 169/349] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:24:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:24:26.844818 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40148e8-050f-4632-9422-25442d4628f6 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:26.879898 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c20bff7-84bf-4660-a828-dbda56dc423e None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:26.922697 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69668852-789d-4418-acdf-52124c07d71f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:26.923321 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69668852-789d-4418-acdf-52124c07d71f None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:26.923612 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69668852-789d-4418-acdf-52124c07d71f None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:26.923895 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69668852-789d-4418-acdf-52124c07d71f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:26.967972 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40148e8-050f-4632-9422-25442d4628f6 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:27.003647 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69668852-789d-4418-acdf-52124c07d71f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:27.005239 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69668852-789d-4418-acdf-52124c07d71f None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:27.012490 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773fe31c-9e92-4f72-9360-2dcf7f531462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:27.013375 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773fe31c-9e92-4f72-9360-2dcf7f531462 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:27.013660 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773fe31c-9e92-4f72-9360-2dcf7f531462 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:27.013935 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773fe31c-9e92-4f72-9360-2dcf7f531462 None admin] PATH_INFO: `/v3/users/d6eb3dd8a5fb44c797e47963a17dd430` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:27.015806 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773fe31c-9e92-4f72-9360-2dcf7f531462 None admin] RBAC: Authorizing `identity:get_user(user_id=d6eb3dd8a5fb44c797e47963a17dd430)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:27.017869 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773fe31c-9e92-4f72-9360-2dcf7f531462 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:27.020317 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 170/350] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jul 14 09:24:26 2022] GET /identity/v3/users/d6eb3dd8a5fb44c797e47963a17dd430 => generated 293 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:24:27.021506 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773fe31c-9e92-4f72-9360-2dcf7f531462 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:27.053041 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:27.075948 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:27.140074 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 181/351] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 14 09:24:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 09:24:27.142526 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15a7e8e-e0ca-4bd2-acf7-d95b9ea1cb9a None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:27.142830 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15a7e8e-e0ca-4bd2-acf7-d95b9ea1cb9a None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:27.143118 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15a7e8e-e0ca-4bd2-acf7-d95b9ea1cb9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:27.160191 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773fe31c-9e92-4f72-9360-2dcf7f531462 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:27.182875 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-a15a7e8e-e0ca-4bd2-acf7-d95b9ea1cb9a None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:24:27.184102 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-a15a7e8e-e0ca-4bd2-acf7-d95b9ea1cb9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:24:27.204193 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07373a41-2ec9-43ad-b7a9-710601f05a19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:27.205244 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07373a41-2ec9-43ad-b7a9-710601f05a19 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:27.205529 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07373a41-2ec9-43ad-b7a9-710601f05a19 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:27.206110 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07373a41-2ec9-43ad-b7a9-710601f05a19 None admin] PATH_INFO: `/v3/groups/1356126a7cff439c889af1c50c4d89b3` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:27.212832 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07373a41-2ec9-43ad-b7a9-710601f05a19 None admin] RBAC: Authorizing `identity:get_group(group_id=1356126a7cff439c889af1c50c4d89b3)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:27.214347 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07373a41-2ec9-43ad-b7a9-710601f05a19 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:27.216068 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 171/352] 10.222.0.40 () {56 vars in 1180 bytes} [Thu Jul 14 09:24:27 2022] GET /identity/v3/groups/1356126a7cff439c889af1c50c4d89b3 => generated 226 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:24:27.221683 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07373a41-2ec9-43ad-b7a9-710601f05a19 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:27.278242 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 182/353] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:24:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 09:24:27.279586 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15a7e8e-e0ca-4bd2-acf7-d95b9ea1cb9a None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:27.358254 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:27.380404 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07373a41-2ec9-43ad-b7a9-710601f05a19 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:27.395549 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:27.420600 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15a7e8e-e0ca-4bd2-acf7-d95b9ea1cb9a None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:27.430148 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b666e29-2c1d-4635-a09b-3f5e3e68e3d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:27.431834 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b666e29-2c1d-4635-a09b-3f5e3e68e3d5 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:27.432121 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b666e29-2c1d-4635-a09b-3f5e3e68e3d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:27.432399 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b666e29-2c1d-4635-a09b-3f5e3e68e3d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:27.433756 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b666e29-2c1d-4635-a09b-3f5e3e68e3d5 None admin] RBAC: Adding query filter params (role.id=028a8869bb7b4891b03c0b6afcced73a, user.id=d6eb3dd8a5fb44c797e47963a17dd430, scope.system=all) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:24:27.434017 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b666e29-2c1d-4635-a09b-3f5e3e68e3d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:27.435801 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b666e29-2c1d-4635-a09b-3f5e3e68e3d5 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:27.453565 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 172/354] 10.222.0.40 () {56 vars in 1308 bytes} [Thu Jul 14 09:24:27 2022] GET /identity/v3/role_assignments?user.id=d6eb3dd8a5fb44c797e47963a17dd430&scope.system=all&role.id=028a8869bb7b4891b03c0b6afcced73a => generated 510 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:24:27.454934 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b666e29-2c1d-4635-a09b-3f5e3e68e3d5 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:27.466487 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af572f4-d4a8-4a69-91a5-766b12c52993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:27.467901 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af572f4-d4a8-4a69-91a5-766b12c52993 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:27.468457 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af572f4-d4a8-4a69-91a5-766b12c52993 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:27.468959 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af572f4-d4a8-4a69-91a5-766b12c52993 None admin] PATH_INFO: `/v3/projects/86c6d2afd7954c56860744ef0c7dc36d` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:27.470807 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af572f4-d4a8-4a69-91a5-766b12c52993 None admin] RBAC: Authorizing `identity:get_project(project_id=86c6d2afd7954c56860744ef0c7dc36d)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:27.472710 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af572f4-d4a8-4a69-91a5-766b12c52993 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:27.474930 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 183/355] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jul 14 09:24:27 2022] GET /identity/v3/projects/86c6d2afd7954c56860744ef0c7dc36d => generated 298 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:24:27.476147 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af572f4-d4a8-4a69-91a5-766b12c52993 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:27.629022 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b666e29-2c1d-4635-a09b-3f5e3e68e3d5 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:27.676540 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af572f4-d4a8-4a69-91a5-766b12c52993 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:27.688666 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c990461d-4b78-4c5f-a941-66a4de35aea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:27.689260 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c990461d-4b78-4c5f-a941-66a4de35aea7 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:27.689712 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c990461d-4b78-4c5f-a941-66a4de35aea7 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:27.690147 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c990461d-4b78-4c5f-a941-66a4de35aea7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:27.691044 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c990461d-4b78-4c5f-a941-66a4de35aea7 None admin] RBAC: Adding query filter params (group.id=1356126a7cff439c889af1c50c4d89b3, role.id=f755c764373f47bababa1e942a53c2e1, scope.project.id=86c6d2afd7954c56860744ef0c7dc36d) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:24:27.691359 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c990461d-4b78-4c5f-a941-66a4de35aea7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:27.692985 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c990461d-4b78-4c5f-a941-66a4de35aea7 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:27.699624 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 173/356] 10.222.0.40 () {56 vars in 1376 bytes} [Thu Jul 14 09:24:27 2022] GET /identity/v3/role_assignments?group.id=1356126a7cff439c889af1c50c4d89b3&scope.project.id=86c6d2afd7954c56860744ef0c7dc36d&role.id=f755c764373f47bababa1e942a53c2e1 => generated 260 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:24:27.701156 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69fd934-5633-492f-9e8f-a7951a5d9dbc None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:27.701617 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69fd934-5633-492f-9e8f-a7951a5d9dbc None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:27.702045 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69fd934-5633-492f-9e8f-a7951a5d9dbc None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:27.703598 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 174/357] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:24:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:24:27.704606 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69fd934-5633-492f-9e8f-a7951a5d9dbc None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:27.715488 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:27.723243 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c9d85f-6d56-44ae-88fe-348c90b212ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:27.724201 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c9d85f-6d56-44ae-88fe-348c90b212ac None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:27.724492 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c9d85f-6d56-44ae-88fe-348c90b212ac None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:27.724773 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c9d85f-6d56-44ae-88fe-348c90b212ac None admin] PATH_INFO: `/v3/roles/member` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:27.747714 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c9d85f-6d56-44ae-88fe-348c90b212ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:24:27.755833 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-54c9d85f-6d56-44ae-88fe-348c90b212ac None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 09:24:27.755833 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:24:27.755833 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:24:27.755833 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:24:27.755833 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:24:27.755833 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:24:27.755833 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:24:27.755833 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:24:27.755833 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:24:27.755833 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:24:27.755833 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:24:27.755833 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:24:27.755833 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:24:27.755833 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:24:27.755833 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:24:27.755833 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:24:27.756966 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:24:27.756966 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:24:27.756966 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:24:27.756966 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:24:27.756966 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:24:27.756966 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:24:27.756966 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:24:27.756966 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:24:27.756966 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:24:27.756966 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:24:27.756966 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:24:27.756966 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( Jul 14 09:24:27.756966 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:24:27.756966 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:24:27.756966 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:24:27.756966 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:24:27.757916 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:24:27.757916 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:24:27.757916 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:24:27.757916 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:24:27.757916 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:24:27.757916 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:24:27.757916 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:24:27.757916 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:24:27.757916 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:24:27.757916 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:24:27.757916 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 09:24:27.757916 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Jul 14 09:24:27.760332 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 184/358] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 14 09:24:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:24:27.761850 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd8832e-8d32-4620-8fbc-d0116320acb0 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:27.762334 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd8832e-8d32-4620-8fbc-d0116320acb0 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:27.762754 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd8832e-8d32-4620-8fbc-d0116320acb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:27.782664 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-bfd8832e-8d32-4620-8fbc-d0116320acb0 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:24:27.784170 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-bfd8832e-8d32-4620-8fbc-d0116320acb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:24:27.787626 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:27.837907 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69fd934-5633-492f-9e8f-a7951a5d9dbc None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:27.865544 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 185/359] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:24:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 09:24:27.866700 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd8832e-8d32-4620-8fbc-d0116320acb0 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:27.878487 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c239aea1-8d62-4015-8d2b-65df7ca6024b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:27.879735 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c239aea1-8d62-4015-8d2b-65df7ca6024b None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:27.880162 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c239aea1-8d62-4015-8d2b-65df7ca6024b None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:27.880580 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c239aea1-8d62-4015-8d2b-65df7ca6024b None admin] PATH_INFO: `/v3/groups/1356126a7cff439c889af1c50c4d89b3` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:27.882086 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c239aea1-8d62-4015-8d2b-65df7ca6024b None admin] RBAC: Authorizing `identity:get_group(group_id=1356126a7cff439c889af1c50c4d89b3)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:27.883899 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c239aea1-8d62-4015-8d2b-65df7ca6024b None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:27.885938 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 175/360] 10.222.0.40 () {56 vars in 1180 bytes} [Thu Jul 14 09:24:27 2022] GET /identity/v3/groups/1356126a7cff439c889af1c50c4d89b3 => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:24:27.892597 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c239aea1-8d62-4015-8d2b-65df7ca6024b None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:27.974992 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd8832e-8d32-4620-8fbc-d0116320acb0 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:27.986241 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:28.013269 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b494883d-f841-4207-9b75-6f9c47416197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:28.014310 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b494883d-f841-4207-9b75-6f9c47416197 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:28.014310 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b494883d-f841-4207-9b75-6f9c47416197 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:28.014310 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b494883d-f841-4207-9b75-6f9c47416197 None admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:28.015609 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b494883d-f841-4207-9b75-6f9c47416197 None admin] RBAC: Adding query filter params (name=member) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:24:28.015609 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b494883d-f841-4207-9b75-6f9c47416197 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:28.018171 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c239aea1-8d62-4015-8d2b-65df7ca6024b None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:28.018335 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b494883d-f841-4207-9b75-6f9c47416197 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:28.029625 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 186/361] 10.222.0.40 () {56 vars in 1101 bytes} [Thu Jul 14 09:24:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:24:28.030705 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b494883d-f841-4207-9b75-6f9c47416197 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:28.034324 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:28.064782 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cdbe8e-309e-4870-a08c-8f552ec5645d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:28.065453 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cdbe8e-309e-4870-a08c-8f552ec5645d None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:28.065737 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cdbe8e-309e-4870-a08c-8f552ec5645d None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:28.066013 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cdbe8e-309e-4870-a08c-8f552ec5645d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:28.066886 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cdbe8e-309e-4870-a08c-8f552ec5645d None admin] RBAC: Adding query filter params (group.id=1356126a7cff439c889af1c50c4d89b3, role.id=17dfac38a2e540fea229af7de99911bb, scope.project.id=86c6d2afd7954c56860744ef0c7dc36d) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:24:28.067204 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cdbe8e-309e-4870-a08c-8f552ec5645d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:28.068649 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cdbe8e-309e-4870-a08c-8f552ec5645d None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:28.075109 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 176/362] 10.222.0.40 () {56 vars in 1376 bytes} [Thu Jul 14 09:24:27 2022] GET /identity/v3/role_assignments?group.id=1356126a7cff439c889af1c50c4d89b3&scope.project.id=86c6d2afd7954c56860744ef0c7dc36d&role.id=17dfac38a2e540fea229af7de99911bb => generated 260 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:24:28.076568 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794e32b7-1aeb-4f7c-a187-75368f33055a None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:28.076864 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794e32b7-1aeb-4f7c-a187-75368f33055a None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:28.077149 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794e32b7-1aeb-4f7c-a187-75368f33055a None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:28.080360 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 177/363] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:24:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:24:28.080564 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794e32b7-1aeb-4f7c-a187-75368f33055a None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:28.188361 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b494883d-f841-4207-9b75-6f9c47416197 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:28.237405 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc92c4d3-e849-4ab5-9b68-d6d841c555f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:28.238502 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc92c4d3-e849-4ab5-9b68-d6d841c555f2 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:28.238792 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc92c4d3-e849-4ab5-9b68-d6d841c555f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:28.239076 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc92c4d3-e849-4ab5-9b68-d6d841c555f2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:28.250385 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794e32b7-1aeb-4f7c-a187-75368f33055a None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:28.255190 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc92c4d3-e849-4ab5-9b68-d6d841c555f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:24:28.265697 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-cc92c4d3-e849-4ab5-9b68-d6d841c555f2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 09:24:28.265697 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:24:28.265697 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:24:28.265697 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:24:28.265697 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:24:28.265697 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:24:28.265697 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:24:28.265697 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:24:28.265697 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:24:28.265697 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:24:28.265697 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:24:28.265697 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:24:28.265697 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:24:28.265697 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:24:28.265697 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:24:28.265697 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:24:28.266912 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:24:28.266912 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:24:28.266912 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:24:28.266912 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:24:28.266912 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:24:28.266912 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:24:28.266912 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:24:28.266912 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:24:28.266912 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:24:28.266912 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:24:28.266912 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:24:28.266912 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( Jul 14 09:24:28.266912 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:24:28.266912 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:24:28.266912 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:24:28.266912 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:24:28.267720 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:24:28.267720 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:24:28.267720 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:24:28.267720 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:24:28.267720 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:24:28.267720 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:24:28.267720 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:24:28.267720 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:24:28.267720 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:24:28.267720 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:24:28.267720 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 09:24:28.267720 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Jul 14 09:24:28.268813 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 187/364] 10.222.0.40 () {56 vars in 1114 bytes} [Thu Jul 14 09:24:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:24:28.269259 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437ee72f-677c-4fc4-9af8-8477422bf5e6 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:28.269553 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437ee72f-677c-4fc4-9af8-8477422bf5e6 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:28.269835 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437ee72f-677c-4fc4-9af8-8477422bf5e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:28.292296 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-437ee72f-677c-4fc4-9af8-8477422bf5e6 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:24:28.293565 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-437ee72f-677c-4fc4-9af8-8477422bf5e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:24:28.310587 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8041655c-dc8c-4370-a134-ebaaa0bd563c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:28.311324 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8041655c-dc8c-4370-a134-ebaaa0bd563c None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:28.311614 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8041655c-dc8c-4370-a134-ebaaa0bd563c None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:28.311896 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8041655c-dc8c-4370-a134-ebaaa0bd563c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:28.324864 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:28.382680 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:28.388968 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 188/365] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:24:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 09:24:28.394817 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437ee72f-677c-4fc4-9af8-8477422bf5e6 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:28.412751 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8041655c-dc8c-4370-a134-ebaaa0bd563c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:28.416314 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8041655c-dc8c-4370-a134-ebaaa0bd563c None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:28.539887 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437ee72f-677c-4fc4-9af8-8477422bf5e6 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:28.568543 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 178/366] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 14 09:24:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 09:24:28.570286 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8041655c-dc8c-4370-a134-ebaaa0bd563c None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:28.592516 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcfca24-5715-48d0-9e48-d56280865642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:28.593200 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcfca24-5715-48d0-9e48-d56280865642 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:28.593490 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcfca24-5715-48d0-9e48-d56280865642 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:28.593766 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcfca24-5715-48d0-9e48-d56280865642 None admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:28.594931 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcfca24-5715-48d0-9e48-d56280865642 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:24:28.594931 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcfca24-5715-48d0-9e48-d56280865642 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:28.596260 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcfca24-5715-48d0-9e48-d56280865642 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:28.606481 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 189/367] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jul 14 09:24:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:24:28.607360 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcfca24-5715-48d0-9e48-d56280865642 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:28.636076 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:28.681518 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:28.739075 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcfca24-5715-48d0-9e48-d56280865642 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:28.757662 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8041655c-dc8c-4370-a134-ebaaa0bd563c None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:28.783537 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea7aefe-3066-4715-8573-13de16018996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:28.784547 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea7aefe-3066-4715-8573-13de16018996 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:28.784902 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea7aefe-3066-4715-8573-13de16018996 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:28.785252 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea7aefe-3066-4715-8573-13de16018996 None admin] PATH_INFO: `/v3/projects/37e686c883dc4b19bd52b4543bcb33e2` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:28.787287 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea7aefe-3066-4715-8573-13de16018996 None admin] RBAC: Authorizing `identity:get_project(project_id=37e686c883dc4b19bd52b4543bcb33e2)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:28.789203 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea7aefe-3066-4715-8573-13de16018996 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:28.792104 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 190/368] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jul 14 09:24:28 2022] GET /identity/v3/projects/37e686c883dc4b19bd52b4543bcb33e2 => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:24:28.792992 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea7aefe-3066-4715-8573-13de16018996 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:28.804610 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121c9968-f969-484d-aff1-93d0ca6b010b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:28.806799 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121c9968-f969-484d-aff1-93d0ca6b010b None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:28.807271 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121c9968-f969-484d-aff1-93d0ca6b010b None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:28.807720 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121c9968-f969-484d-aff1-93d0ca6b010b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:28.822075 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121c9968-f969-484d-aff1-93d0ca6b010b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:24:28.832767 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-121c9968-f969-484d-aff1-93d0ca6b010b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 09:24:28.832767 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:24:28.832767 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:24:28.832767 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:24:28.832767 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:24:28.832767 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:24:28.832767 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:24:28.832767 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:24:28.832767 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:24:28.832767 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:24:28.832767 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:24:28.832767 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:24:28.832767 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:24:28.832767 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:24:28.832767 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:24:28.832767 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:24:28.833659 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:24:28.833659 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:24:28.833659 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:24:28.833659 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:24:28.833659 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:24:28.833659 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:24:28.833659 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:24:28.833659 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:24:28.833659 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:24:28.833659 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:24:28.833659 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:24:28.833659 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( Jul 14 09:24:28.833659 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:24:28.833659 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:24:28.833659 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:24:28.833659 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:24:28.834504 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:24:28.834504 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:24:28.834504 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:24:28.834504 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:24:28.834504 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:24:28.834504 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:24:28.834504 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:24:28.834504 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:24:28.834504 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:24:28.834504 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:24:28.834504 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 09:24:28.834504 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:24:28.836753 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 179/369] 10.222.0.40 () {56 vars in 1096 bytes} [Thu Jul 14 09:24:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:24:28.837691 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121c9968-f969-484d-aff1-93d0ca6b010b None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:28.917828 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea7aefe-3066-4715-8573-13de16018996 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:28.946623 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:28.959717 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:28.961075 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ce7a84-ac96-46ad-b107-2b29c8520f92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:28.961778 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ce7a84-ac96-46ad-b107-2b29c8520f92 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:28.962048 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ce7a84-ac96-46ad-b107-2b29c8520f92 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:28.962387 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ce7a84-ac96-46ad-b107-2b29c8520f92 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:28.964594 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121c9968-f969-484d-aff1-93d0ca6b010b None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:29.014629 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefff66e-30f7-4e8d-a644-fb0eb3416928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:29.015494 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefff66e-30f7-4e8d-a644-fb0eb3416928 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:29.015775 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefff66e-30f7-4e8d-a644-fb0eb3416928 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:29.016049 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefff66e-30f7-4e8d-a644-fb0eb3416928 None admin] PATH_INFO: `/v3/groups/1356126a7cff439c889af1c50c4d89b3` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:29.017827 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefff66e-30f7-4e8d-a644-fb0eb3416928 None admin] RBAC: Authorizing `identity:get_group(group_id=1356126a7cff439c889af1c50c4d89b3)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:29.019490 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefff66e-30f7-4e8d-a644-fb0eb3416928 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:29.021520 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 180/370] 10.222.0.40 () {56 vars in 1180 bytes} [Thu Jul 14 09:24:28 2022] GET /identity/v3/groups/1356126a7cff439c889af1c50c4d89b3 => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:24:29.022326 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefff66e-30f7-4e8d-a644-fb0eb3416928 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:29.053006 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ce7a84-ac96-46ad-b107-2b29c8520f92 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:29.054932 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ce7a84-ac96-46ad-b107-2b29c8520f92 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:29.148034 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefff66e-30f7-4e8d-a644-fb0eb3416928 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:29.184311 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 191/371] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 14 09:24:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 09:24:29.185265 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ce7a84-ac96-46ad-b107-2b29c8520f92 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:29.187867 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7271d77f-32e9-46fd-b5bb-2618960de51f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:29.188548 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7271d77f-32e9-46fd-b5bb-2618960de51f None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:29.188833 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7271d77f-32e9-46fd-b5bb-2618960de51f None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:29.189418 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7271d77f-32e9-46fd-b5bb-2618960de51f None admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:29.190236 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7271d77f-32e9-46fd-b5bb-2618960de51f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:24:29.190538 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7271d77f-32e9-46fd-b5bb-2618960de51f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:29.191928 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7271d77f-32e9-46fd-b5bb-2618960de51f None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:29.201180 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 181/372] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 14 09:24:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:24:29.201852 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7271d77f-32e9-46fd-b5bb-2618960de51f None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:29.219127 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:29.234491 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:29.321586 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7271d77f-32e9-46fd-b5bb-2618960de51f None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:29.322877 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ce7a84-ac96-46ad-b107-2b29c8520f92 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:29.363692 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3bebd4-ff65-414f-86a8-6e3bd93d483f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:29.364362 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3bebd4-ff65-414f-86a8-6e3bd93d483f None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:29.364645 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3bebd4-ff65-414f-86a8-6e3bd93d483f None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:29.364922 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3bebd4-ff65-414f-86a8-6e3bd93d483f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:29.365765 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3bebd4-ff65-414f-86a8-6e3bd93d483f None admin] RBAC: Adding query filter params (group.id=1356126a7cff439c889af1c50c4d89b3, role.id=17dfac38a2e540fea229af7de99911bb, scope.project.id=37e686c883dc4b19bd52b4543bcb33e2) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:24:29.366129 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3bebd4-ff65-414f-86a8-6e3bd93d483f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:29.367704 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3bebd4-ff65-414f-86a8-6e3bd93d483f None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:29.370874 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faea984-30ad-42ec-afe5-2c22b34ad17b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:29.372262 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faea984-30ad-42ec-afe5-2c22b34ad17b None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:29.372841 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faea984-30ad-42ec-afe5-2c22b34ad17b None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:29.373125 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faea984-30ad-42ec-afe5-2c22b34ad17b None admin] PATH_INFO: `/v3/projects/37e686c883dc4b19bd52b4543bcb33e2` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:29.374488 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1faea984-30ad-42ec-afe5-2c22b34ad17b None admin] RBAC: Authorizing `identity:get_project(project_id=37e686c883dc4b19bd52b4543bcb33e2)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:29.374706 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 192/373] 10.222.0.40 () {56 vars in 1376 bytes} [Thu Jul 14 09:24:29 2022] GET /identity/v3/role_assignments?group.id=1356126a7cff439c889af1c50c4d89b3&scope.project.id=37e686c883dc4b19bd52b4543bcb33e2&role.id=17dfac38a2e540fea229af7de99911bb => generated 260 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:24:29.375386 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3bebd4-ff65-414f-86a8-6e3bd93d483f None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:29.376065 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1faea984-30ad-42ec-afe5-2c22b34ad17b None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:29.377812 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 182/374] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jul 14 09:24:29 2022] GET /identity/v3/projects/37e686c883dc4b19bd52b4543bcb33e2 => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:24:29.389943 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faea984-30ad-42ec-afe5-2c22b34ad17b None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:29.562474 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:29.588491 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3bebd4-ff65-414f-86a8-6e3bd93d483f None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:29.606755 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:29.612647 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faea984-30ad-42ec-afe5-2c22b34ad17b None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:29.653045 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e108f807-86f8-406a-a015-8a69c40d02b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:29.654065 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e108f807-86f8-406a-a015-8a69c40d02b1 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:29.654488 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e108f807-86f8-406a-a015-8a69c40d02b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:29.654874 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e108f807-86f8-406a-a015-8a69c40d02b1 None admin] PATH_INFO: `/v3/groups/1356126a7cff439c889af1c50c4d89b3` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:29.654981 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c9992c-7043-41e7-adee-85bf968d1ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:29.655632 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c9992c-7043-41e7-adee-85bf968d1ae5 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:29.655931 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c9992c-7043-41e7-adee-85bf968d1ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:29.656216 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c9992c-7043-41e7-adee-85bf968d1ae5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:29.656561 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e108f807-86f8-406a-a015-8a69c40d02b1 None admin] RBAC: Authorizing `identity:get_group(group_id=1356126a7cff439c889af1c50c4d89b3)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:29.658548 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e108f807-86f8-406a-a015-8a69c40d02b1 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:29.660643 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 183/375] 10.222.0.40 () {56 vars in 1180 bytes} [Thu Jul 14 09:24:29 2022] GET /identity/v3/groups/1356126a7cff439c889af1c50c4d89b3 => generated 226 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:24:29.666115 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e108f807-86f8-406a-a015-8a69c40d02b1 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:29.736628 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c9992c-7043-41e7-adee-85bf968d1ae5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:29.738102 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c9992c-7043-41e7-adee-85bf968d1ae5 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:29.832221 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:29.833649 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e108f807-86f8-406a-a015-8a69c40d02b1 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:29.859573 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 193/376] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 14 09:24:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 09:24:29.865044 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c9992c-7043-41e7-adee-85bf968d1ae5 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:29.874848 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0762a8-19d4-4a9b-82d2-500ef130b45d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:29.875528 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0762a8-19d4-4a9b-82d2-500ef130b45d None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:29.875814 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0762a8-19d4-4a9b-82d2-500ef130b45d None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:29.876211 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0762a8-19d4-4a9b-82d2-500ef130b45d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:29.877075 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0762a8-19d4-4a9b-82d2-500ef130b45d None admin] RBAC: Adding query filter params (group.id=1356126a7cff439c889af1c50c4d89b3, role.id=f755c764373f47bababa1e942a53c2e1, scope.project.id=37e686c883dc4b19bd52b4543bcb33e2) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:24:29.877394 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0762a8-19d4-4a9b-82d2-500ef130b45d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:29.879003 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0762a8-19d4-4a9b-82d2-500ef130b45d None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:29.886718 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 184/377] 10.222.0.40 () {56 vars in 1376 bytes} [Thu Jul 14 09:24:29 2022] GET /identity/v3/role_assignments?group.id=1356126a7cff439c889af1c50c4d89b3&scope.project.id=37e686c883dc4b19bd52b4543bcb33e2&role.id=f755c764373f47bababa1e942a53c2e1 => generated 260 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:24:30.010905 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c9992c-7043-41e7-adee-85bf968d1ae5 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:30.054288 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06f898f-9e38-4140-8747-dfe8f11cdb7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:30.055976 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06f898f-9e38-4140-8747-dfe8f11cdb7d None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:30.056427 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06f898f-9e38-4140-8747-dfe8f11cdb7d None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:30.056854 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06f898f-9e38-4140-8747-dfe8f11cdb7d None admin] PATH_INFO: `/v3/projects/fc045bacae334916a4c6d8daadbcb707` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:30.058349 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06f898f-9e38-4140-8747-dfe8f11cdb7d None admin] RBAC: Authorizing `identity:get_project(project_id=fc045bacae334916a4c6d8daadbcb707)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:30.060020 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06f898f-9e38-4140-8747-dfe8f11cdb7d None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:30.062167 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 194/378] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jul 14 09:24:29 2022] GET /identity/v3/projects/fc045bacae334916a4c6d8daadbcb707 => generated 344 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:24:30.067915 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0762a8-19d4-4a9b-82d2-500ef130b45d None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:30.136532 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:30.212221 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0762a8-19d4-4a9b-82d2-500ef130b45d None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:30.250837 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6538c514-5a81-4d19-9638-0caa80071234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:30.252090 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6538c514-5a81-4d19-9638-0caa80071234 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:30.252754 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6538c514-5a81-4d19-9638-0caa80071234 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:30.253232 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6538c514-5a81-4d19-9638-0caa80071234 None admin] PATH_INFO: `/v3/groups/7bb579e6b4ed4ca7bbd1fcbefd8dab5d` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:30.264091 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6538c514-5a81-4d19-9638-0caa80071234 None admin] RBAC: Authorizing `identity:get_group(group_id=7bb579e6b4ed4ca7bbd1fcbefd8dab5d)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:30.265871 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6538c514-5a81-4d19-9638-0caa80071234 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:30.267837 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 185/379] 10.222.0.40 () {56 vars in 1180 bytes} [Thu Jul 14 09:24:30 2022] GET /identity/v3/groups/7bb579e6b4ed4ca7bbd1fcbefd8dab5d => generated 229 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:24:30.273924 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06f898f-9e38-4140-8747-dfe8f11cdb7d None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:30.353309 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:30.411097 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06f898f-9e38-4140-8747-dfe8f11cdb7d None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:30.460914 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c251574e-f186-4beb-8cea-27a25258e137 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:30.461265 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c251574e-f186-4beb-8cea-27a25258e137 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:30.461520 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c251574e-f186-4beb-8cea-27a25258e137 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:30.462002 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdf18fa-a073-4637-8b48-d52a75e6d285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:30.462741 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdf18fa-a073-4637-8b48-d52a75e6d285 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:30.463143 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 186/380] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:24:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 09:24:30.463255 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdf18fa-a073-4637-8b48-d52a75e6d285 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:30.463328 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdf18fa-a073-4637-8b48-d52a75e6d285 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:30.464125 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdf18fa-a073-4637-8b48-d52a75e6d285 None admin] RBAC: Adding query filter params (group.id=7bb579e6b4ed4ca7bbd1fcbefd8dab5d, role.id=e3965bd0d5f1427a86a313c0c90bfef3, scope.project.id=fc045bacae334916a4c6d8daadbcb707) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:24:30.464439 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdf18fa-a073-4637-8b48-d52a75e6d285 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:30.465879 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdf18fa-a073-4637-8b48-d52a75e6d285 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:30.472316 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 195/381] 10.222.0.40 () {56 vars in 1376 bytes} [Thu Jul 14 09:24:30 2022] GET /identity/v3/role_assignments?group.id=7bb579e6b4ed4ca7bbd1fcbefd8dab5d&scope.project.id=fc045bacae334916a4c6d8daadbcb707&role.id=e3965bd0d5f1427a86a313c0c90bfef3 => generated 260 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:24:30.476114 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18a64ee-3dc1-4728-9391-8906d89690e8 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:30.476404 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18a64ee-3dc1-4728-9391-8906d89690e8 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:30.476688 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18a64ee-3dc1-4728-9391-8906d89690e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:30.496245 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-b18a64ee-3dc1-4728-9391-8906d89690e8 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:24:30.497522 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-b18a64ee-3dc1-4728-9391-8906d89690e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:24:30.598495 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 187/382] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:24:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 09:24:30.619310 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdf18fa-a073-4637-8b48-d52a75e6d285 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:30.740612 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdf18fa-a073-4637-8b48-d52a75e6d285 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:30.759267 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:30.777213 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c6703b-6604-4f97-8627-fe1c58eaff8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:30.778033 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c6703b-6604-4f97-8627-fe1c58eaff8c None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:30.778349 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c6703b-6604-4f97-8627-fe1c58eaff8c None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:30.778627 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c6703b-6604-4f97-8627-fe1c58eaff8c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:30.789424 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c6703b-6604-4f97-8627-fe1c58eaff8c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:24:30.798370 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-63c6703b-6604-4f97-8627-fe1c58eaff8c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 09:24:30.798370 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:24:30.798370 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:24:30.798370 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:24:30.798370 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:24:30.798370 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:24:30.798370 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:24:30.798370 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:24:30.798370 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:24:30.798370 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:24:30.798370 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:24:30.798370 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:24:30.798370 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:24:30.798370 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:24:30.798370 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:24:30.798370 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:24:30.799286 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:24:30.799286 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:24:30.799286 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:24:30.799286 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:24:30.799286 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:24:30.799286 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:24:30.799286 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:24:30.799286 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:24:30.799286 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:24:30.799286 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:24:30.799286 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:24:30.799286 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( Jul 14 09:24:30.799286 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:24:30.799286 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:24:30.799286 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:24:30.799286 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:24:30.800060 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:24:30.800060 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:24:30.800060 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:24:30.800060 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:24:30.800060 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:24:30.800060 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:24:30.800060 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:24:30.800060 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:24:30.800060 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:24:30.800060 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:24:30.800060 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 09:24:30.800060 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Jul 14 09:24:30.801114 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 196/383] 10.222.0.40 () {56 vars in 1114 bytes} [Thu Jul 14 09:24:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:24:30.806000 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18a64ee-3dc1-4728-9391-8906d89690e8 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:30.834523 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:30.883323 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2cdcf4-8cd2-4fa7-bed9-2a73b17ae012 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:30.883632 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2cdcf4-8cd2-4fa7-bed9-2a73b17ae012 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:30.883885 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2cdcf4-8cd2-4fa7-bed9-2a73b17ae012 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:30.886865 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 197/384] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:24:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 09:24:30.891229 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21203821-843a-49fd-a224-54443ff811ac None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:30.891520 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21203821-843a-49fd-a224-54443ff811ac None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:30.891920 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21203821-843a-49fd-a224-54443ff811ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:30.921710 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-21203821-843a-49fd-a224-54443ff811ac None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:24:30.923488 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-21203821-843a-49fd-a224-54443ff811ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:24:30.959419 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18a64ee-3dc1-4728-9391-8906d89690e8 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:31.017405 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 198/385] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:24:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 09:24:31.042178 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21203821-843a-49fd-a224-54443ff811ac None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:31.051849 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dbf151-e295-4729-9837-402d5d28a393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:31.052541 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dbf151-e295-4729-9837-402d5d28a393 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:31.052823 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dbf151-e295-4729-9837-402d5d28a393 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:31.053100 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dbf151-e295-4729-9837-402d5d28a393 None admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:31.053874 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dbf151-e295-4729-9837-402d5d28a393 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:24:31.054182 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dbf151-e295-4729-9837-402d5d28a393 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:31.055633 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dbf151-e295-4729-9837-402d5d28a393 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:31.070057 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 188/386] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jul 14 09:24:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:24:31.073861 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dbf151-e295-4729-9837-402d5d28a393 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:31.201830 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:31.207757 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21203821-843a-49fd-a224-54443ff811ac None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:31.218908 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:31.233197 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dbf151-e295-4729-9837-402d5d28a393 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:31.247597 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d160a9b3-0373-4bd9-8812-cdd024d4f27d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:31.248727 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d160a9b3-0373-4bd9-8812-cdd024d4f27d None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:31.249211 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d160a9b3-0373-4bd9-8812-cdd024d4f27d None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:31.249683 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d160a9b3-0373-4bd9-8812-cdd024d4f27d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:31.264490 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d160a9b3-0373-4bd9-8812-cdd024d4f27d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:24:31.273375 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-d160a9b3-0373-4bd9-8812-cdd024d4f27d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 09:24:31.273375 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:24:31.273375 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:24:31.273375 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:24:31.273375 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:24:31.273375 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:24:31.273375 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:24:31.273375 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:24:31.273375 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:24:31.273375 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:24:31.273375 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:24:31.273375 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:24:31.273375 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:24:31.273375 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:24:31.273375 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:24:31.273375 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:24:31.274877 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:24:31.274877 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:24:31.274877 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:24:31.274877 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:24:31.274877 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:24:31.274877 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:24:31.274877 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:24:31.274877 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:24:31.274877 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:24:31.274877 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:24:31.274877 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:24:31.274877 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( Jul 14 09:24:31.274877 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:24:31.274877 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:24:31.274877 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:24:31.274877 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:24:31.275665 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:24:31.275665 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:24:31.275665 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:24:31.275665 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:24:31.275665 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:24:31.275665 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:24:31.275665 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:24:31.275665 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:24:31.275665 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:24:31.275665 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:24:31.275665 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 09:24:31.275665 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Jul 14 09:24:31.278392 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 199/387] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 14 09:24:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:24:31.284430 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d160a9b3-0373-4bd9-8812-cdd024d4f27d None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:31.315510 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44913122-5b08-4e0f-886d-7e55ea7f614b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:31.316395 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44913122-5b08-4e0f-886d-7e55ea7f614b None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:31.316688 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44913122-5b08-4e0f-886d-7e55ea7f614b None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:31.316968 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44913122-5b08-4e0f-886d-7e55ea7f614b None admin] PATH_INFO: `/v3/groups/1356126a7cff439c889af1c50c4d89b3` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:31.322917 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44913122-5b08-4e0f-886d-7e55ea7f614b None admin] RBAC: Authorizing `identity:get_group(group_id=1356126a7cff439c889af1c50c4d89b3)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:31.324475 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44913122-5b08-4e0f-886d-7e55ea7f614b None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:31.326484 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 189/388] 10.222.0.40 () {56 vars in 1180 bytes} [Thu Jul 14 09:24:31 2022] GET /identity/v3/groups/1356126a7cff439c889af1c50c4d89b3 => generated 226 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:24:31.331841 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44913122-5b08-4e0f-886d-7e55ea7f614b None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:31.459345 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d160a9b3-0373-4bd9-8812-cdd024d4f27d None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:31.487192 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44913122-5b08-4e0f-886d-7e55ea7f614b None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:31.533169 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c77c04-10aa-4307-ab30-2cd114416e72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:31.533789 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c77c04-10aa-4307-ab30-2cd114416e72 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:31.534050 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c77c04-10aa-4307-ab30-2cd114416e72 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:31.534362 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c77c04-10aa-4307-ab30-2cd114416e72 None admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:31.535245 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c77c04-10aa-4307-ab30-2cd114416e72 None admin] RBAC: Adding query filter params (name=member) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:24:31.535556 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c77c04-10aa-4307-ab30-2cd114416e72 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:31.536958 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c77c04-10aa-4307-ab30-2cd114416e72 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:31.541152 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28be35d-831c-44d5-93f5-208859c8689e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:31.542369 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28be35d-831c-44d5-93f5-208859c8689e None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:31.542959 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28be35d-831c-44d5-93f5-208859c8689e None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:31.543460 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28be35d-831c-44d5-93f5-208859c8689e None admin] PATH_INFO: `/v3/projects/86c6d2afd7954c56860744ef0c7dc36d` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:31.545010 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28be35d-831c-44d5-93f5-208859c8689e None admin] RBAC: Authorizing `identity:get_project(project_id=86c6d2afd7954c56860744ef0c7dc36d)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:31.546304 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 200/389] 10.222.0.40 () {56 vars in 1101 bytes} [Thu Jul 14 09:24:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:24:31.546967 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28be35d-831c-44d5-93f5-208859c8689e None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:31.549140 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 190/390] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jul 14 09:24:31 2022] GET /identity/v3/projects/86c6d2afd7954c56860744ef0c7dc36d => generated 298 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:24:31.558225 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c77c04-10aa-4307-ab30-2cd114416e72 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:31.559145 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28be35d-831c-44d5-93f5-208859c8689e None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:31.605280 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:31.620874 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:31.731643 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c77c04-10aa-4307-ab30-2cd114416e72 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:31.778386 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28be35d-831c-44d5-93f5-208859c8689e None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:31.797194 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d637a8b-c20d-46d9-a922-03a13ae7692c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:31.797994 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d637a8b-c20d-46d9-a922-03a13ae7692c None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:31.799262 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d637a8b-c20d-46d9-a922-03a13ae7692c None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:31.799561 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d637a8b-c20d-46d9-a922-03a13ae7692c None admin] PATH_INFO: `/v3/groups/1356126a7cff439c889af1c50c4d89b3` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:31.800849 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d637a8b-c20d-46d9-a922-03a13ae7692c None admin] RBAC: Authorizing `identity:get_group(group_id=1356126a7cff439c889af1c50c4d89b3)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:31.802455 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d637a8b-c20d-46d9-a922-03a13ae7692c None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:31.804411 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 201/391] 10.222.0.40 () {56 vars in 1180 bytes} [Thu Jul 14 09:24:31 2022] GET /identity/v3/groups/1356126a7cff439c889af1c50c4d89b3 => generated 226 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:24:31.810352 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d637a8b-c20d-46d9-a922-03a13ae7692c None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:31.874960 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad814a4-29ad-4a39-8ca1-1d0ccf287f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:31.875917 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad814a4-29ad-4a39-8ca1-1d0ccf287f97 None admin] REQUEST_METHOD: `PUT` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:31.876204 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad814a4-29ad-4a39-8ca1-1d0ccf287f97 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:31.876484 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad814a4-29ad-4a39-8ca1-1d0ccf287f97 None admin] PATH_INFO: `/v3/projects/86c6d2afd7954c56860744ef0c7dc36d/groups/1356126a7cff439c889af1c50c4d89b3/roles/f755c764373f47bababa1e942a53c2e1` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:31.879463 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad814a4-29ad-4a39-8ca1-1d0ccf287f97 None admin] RBAC: Authorizing `identity:create_grant(project_id=86c6d2afd7954c56860744ef0c7dc36d, group_id=1356126a7cff439c889af1c50c4d89b3, role_id=f755c764373f47bababa1e942a53c2e1)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:31.880924 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad814a4-29ad-4a39-8ca1-1d0ccf287f97 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:31.917703 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 191/392] 10.222.0.40 () {58 vars in 1442 bytes} [Thu Jul 14 09:24:31 2022] PUT /identity/v3/projects/86c6d2afd7954c56860744ef0c7dc36d/groups/1356126a7cff439c889af1c50c4d89b3/roles/f755c764373f47bababa1e942a53c2e1 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:24:31.931748 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d637a8b-c20d-46d9-a922-03a13ae7692c None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:31.934989 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:31.969527 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e16305-4bde-4f7d-aec7-8f5513699085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:31.970495 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e16305-4bde-4f7d-aec7-8f5513699085 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:31.971108 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e16305-4bde-4f7d-aec7-8f5513699085 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:31.971383 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e16305-4bde-4f7d-aec7-8f5513699085 None admin] PATH_INFO: `/v3/projects/86c6d2afd7954c56860744ef0c7dc36d` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:31.972709 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e16305-4bde-4f7d-aec7-8f5513699085 None admin] RBAC: Authorizing `identity:get_project(project_id=86c6d2afd7954c56860744ef0c7dc36d)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:31.974219 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e16305-4bde-4f7d-aec7-8f5513699085 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:31.976430 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 202/393] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jul 14 09:24:31 2022] GET /identity/v3/projects/86c6d2afd7954c56860744ef0c7dc36d => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:24:31.983030 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad814a4-29ad-4a39-8ca1-1d0ccf287f97 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:32.077379 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:32.100270 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad814a4-29ad-4a39-8ca1-1d0ccf287f97 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:32.147273 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e55f67c-770b-48eb-86a2-9d382b3cddbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:32.148185 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e55f67c-770b-48eb-86a2-9d382b3cddbd None admin] REQUEST_METHOD: `PUT` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:32.148474 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e55f67c-770b-48eb-86a2-9d382b3cddbd None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:32.148860 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e55f67c-770b-48eb-86a2-9d382b3cddbd None admin] PATH_INFO: `/v3/projects/86c6d2afd7954c56860744ef0c7dc36d/groups/1356126a7cff439c889af1c50c4d89b3/roles/17dfac38a2e540fea229af7de99911bb` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:32.151377 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e55f67c-770b-48eb-86a2-9d382b3cddbd None admin] RBAC: Authorizing `identity:create_grant(project_id=86c6d2afd7954c56860744ef0c7dc36d, group_id=1356126a7cff439c889af1c50c4d89b3, role_id=17dfac38a2e540fea229af7de99911bb)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:32.152860 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e55f67c-770b-48eb-86a2-9d382b3cddbd None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:32.172464 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 192/394] 10.222.0.40 () {58 vars in 1442 bytes} [Thu Jul 14 09:24:31 2022] PUT /identity/v3/projects/86c6d2afd7954c56860744ef0c7dc36d/groups/1356126a7cff439c889af1c50c4d89b3/roles/17dfac38a2e540fea229af7de99911bb => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:24:32.199364 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44831efd-4c4f-43ed-aa08-7f5ad72027a0 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:32.199666 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44831efd-4c4f-43ed-aa08-7f5ad72027a0 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:32.199928 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44831efd-4c4f-43ed-aa08-7f5ad72027a0 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:32.201556 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 203/395] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:24:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:24:32.207529 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010baf57-a567-443c-8c5b-7b3b8f32218b None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:32.207816 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010baf57-a567-443c-8c5b-7b3b8f32218b None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:32.208098 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010baf57-a567-443c-8c5b-7b3b8f32218b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:32.228929 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-010baf57-a567-443c-8c5b-7b3b8f32218b None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:24:32.230141 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-010baf57-a567-443c-8c5b-7b3b8f32218b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:24:32.319441 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 193/396] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:24:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 09:24:32.343415 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44831efd-4c4f-43ed-aa08-7f5ad72027a0 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:32.495791 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44831efd-4c4f-43ed-aa08-7f5ad72027a0 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:32.547746 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732a3949-7218-4dff-be1f-c319435c700d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:32.548953 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732a3949-7218-4dff-be1f-c319435c700d None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:32.549432 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732a3949-7218-4dff-be1f-c319435c700d None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:32.549873 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732a3949-7218-4dff-be1f-c319435c700d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:32.571431 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732a3949-7218-4dff-be1f-c319435c700d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:24:32.580038 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-732a3949-7218-4dff-be1f-c319435c700d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 09:24:32.580038 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:24:32.580038 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:24:32.580038 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:24:32.580038 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:24:32.580038 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:24:32.580038 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:24:32.580038 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:24:32.580038 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:24:32.580038 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:24:32.580038 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:24:32.580038 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:24:32.580038 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:24:32.580038 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:24:32.580038 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:24:32.580038 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:24:32.580930 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:24:32.580930 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:24:32.580930 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:24:32.580930 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:24:32.580930 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:24:32.580930 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:24:32.580930 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:24:32.580930 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:24:32.580930 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:24:32.580930 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:24:32.580930 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:24:32.580930 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( Jul 14 09:24:32.580930 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:24:32.580930 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:24:32.580930 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:24:32.580930 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:24:32.581725 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:24:32.581725 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:24:32.581725 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:24:32.581725 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:24:32.581725 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:24:32.581725 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:24:32.581725 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:24:32.581725 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:24:32.581725 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:24:32.581725 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:24:32.581725 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 09:24:32.581725 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Jul 14 09:24:32.583935 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 204/397] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 14 09:24:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:24:32.590072 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010baf57-a567-443c-8c5b-7b3b8f32218b None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:32.678742 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:32.713090 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010baf57-a567-443c-8c5b-7b3b8f32218b None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:32.723135 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1579a4f0-8306-4558-8c89-20b2630497e4 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:32.723636 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1579a4f0-8306-4558-8c89-20b2630497e4 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:32.723876 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1579a4f0-8306-4558-8c89-20b2630497e4 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:32.726033 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 205/398] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:24:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 09:24:32.736856 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27080ffb-e5bf-4b82-a9ad-76d499e39d3b None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:32.737137 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27080ffb-e5bf-4b82-a9ad-76d499e39d3b None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:32.737423 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27080ffb-e5bf-4b82-a9ad-76d499e39d3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:32.775976 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-27080ffb-e5bf-4b82-a9ad-76d499e39d3b None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:24:32.777200 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-27080ffb-e5bf-4b82-a9ad-76d499e39d3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:24:32.795523 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfcb183-2ccd-483b-b44c-e95bcf398a03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:32.796432 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfcb183-2ccd-483b-b44c-e95bcf398a03 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:32.796721 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfcb183-2ccd-483b-b44c-e95bcf398a03 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:32.797000 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfcb183-2ccd-483b-b44c-e95bcf398a03 None admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:32.797787 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfcb183-2ccd-483b-b44c-e95bcf398a03 None admin] RBAC: Adding query filter params (name=member) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:24:32.798101 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfcb183-2ccd-483b-b44c-e95bcf398a03 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:32.799525 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfcb183-2ccd-483b-b44c-e95bcf398a03 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:32.823876 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 194/399] 10.222.0.40 () {56 vars in 1101 bytes} [Thu Jul 14 09:24:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:24:32.824268 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:32.830021 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfcb183-2ccd-483b-b44c-e95bcf398a03 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:32.936629 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 206/400] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:24:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 09:24:32.990131 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27080ffb-e5bf-4b82-a9ad-76d499e39d3b None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:33.024037 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfcb183-2ccd-483b-b44c-e95bcf398a03 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:33.065572 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:33.074379 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eafeb60-3aef-4135-a7b1-0465eb11eef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:33.076474 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eafeb60-3aef-4135-a7b1-0465eb11eef4 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:33.078474 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eafeb60-3aef-4135-a7b1-0465eb11eef4 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:33.078985 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eafeb60-3aef-4135-a7b1-0465eb11eef4 None admin] PATH_INFO: `/v3/groups/1356126a7cff439c889af1c50c4d89b3` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:33.081786 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eafeb60-3aef-4135-a7b1-0465eb11eef4 None admin] RBAC: Authorizing `identity:get_group(group_id=1356126a7cff439c889af1c50c4d89b3)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:33.084459 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eafeb60-3aef-4135-a7b1-0465eb11eef4 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:33.088336 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 195/401] 10.222.0.40 () {56 vars in 1180 bytes} [Thu Jul 14 09:24:32 2022] GET /identity/v3/groups/1356126a7cff439c889af1c50c4d89b3 => generated 226 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:24:33.096489 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eafeb60-3aef-4135-a7b1-0465eb11eef4 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:33.174898 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27080ffb-e5bf-4b82-a9ad-76d499e39d3b None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:33.216143 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ad9149-f6e3-4090-a669-2a7fc0ba9bfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:33.217388 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ad9149-f6e3-4090-a669-2a7fc0ba9bfe None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:33.217891 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ad9149-f6e3-4090-a669-2a7fc0ba9bfe None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:33.218555 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ad9149-f6e3-4090-a669-2a7fc0ba9bfe None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:33.231492 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ad9149-f6e3-4090-a669-2a7fc0ba9bfe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:24:33.241513 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-21ad9149-f6e3-4090-a669-2a7fc0ba9bfe None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 09:24:33.241513 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:24:33.241513 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:24:33.241513 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:24:33.241513 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:24:33.241513 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:24:33.241513 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:24:33.241513 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:24:33.241513 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:24:33.241513 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:24:33.241513 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:24:33.241513 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:24:33.241513 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:24:33.241513 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:24:33.241513 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:24:33.241513 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:24:33.242642 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:24:33.242642 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:24:33.242642 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:24:33.242642 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:24:33.242642 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:24:33.242642 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:24:33.242642 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:24:33.242642 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:24:33.242642 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:24:33.242642 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:24:33.242642 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:24:33.242642 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( Jul 14 09:24:33.242642 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:24:33.242642 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:24:33.242642 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:24:33.242642 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:24:33.243718 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:24:33.243718 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:24:33.243718 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:24:33.243718 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:24:33.243718 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:24:33.243718 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:24:33.243718 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:24:33.243718 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:24:33.243718 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:24:33.243718 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:24:33.243718 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 09:24:33.243718 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Jul 14 09:24:33.246133 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 207/402] 10.222.0.40 () {56 vars in 1114 bytes} [Thu Jul 14 09:24:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 09:24:33.254467 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ad9149-f6e3-4090-a669-2a7fc0ba9bfe None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:33.274331 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:33.310180 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eafeb60-3aef-4135-a7b1-0465eb11eef4 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:33.379609 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421ed1b1-6f72-4c74-bc1c-7fb526c4af5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:33.380769 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421ed1b1-6f72-4c74-bc1c-7fb526c4af5b None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:33.381053 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421ed1b1-6f72-4c74-bc1c-7fb526c4af5b None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:33.381331 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421ed1b1-6f72-4c74-bc1c-7fb526c4af5b None admin] PATH_INFO: `/v3/projects/37e686c883dc4b19bd52b4543bcb33e2` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:33.383809 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421ed1b1-6f72-4c74-bc1c-7fb526c4af5b None admin] RBAC: Authorizing `identity:get_project(project_id=37e686c883dc4b19bd52b4543bcb33e2)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:33.385745 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421ed1b1-6f72-4c74-bc1c-7fb526c4af5b None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:33.388223 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 196/403] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jul 14 09:24:33 2022] GET /identity/v3/projects/37e686c883dc4b19bd52b4543bcb33e2 => generated 302 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:24:33.399776 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421ed1b1-6f72-4c74-bc1c-7fb526c4af5b None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:33.404398 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ad9149-f6e3-4090-a669-2a7fc0ba9bfe None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:33.447288 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a79fac-5092-481b-8016-ab14ef325f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:33.448250 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a79fac-5092-481b-8016-ab14ef325f15 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:33.448544 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a79fac-5092-481b-8016-ab14ef325f15 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:33.448829 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a79fac-5092-481b-8016-ab14ef325f15 None admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:33.450596 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a79fac-5092-481b-8016-ab14ef325f15 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:24:33.451037 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a79fac-5092-481b-8016-ab14ef325f15 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:33.452444 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a79fac-5092-481b-8016-ab14ef325f15 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:33.469758 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 208/404] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jul 14 09:24:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:24:33.469758 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aec948-50fe-43a8-abdd-7d2449588967 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:33.469758 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aec948-50fe-43a8-abdd-7d2449588967 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:33.469758 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aec948-50fe-43a8-abdd-7d2449588967 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:33.477297 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 209/405] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:24:33 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:24:33.477297 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aec948-50fe-43a8-abdd-7d2449588967 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:33.510427 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:33.551704 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421ed1b1-6f72-4c74-bc1c-7fb526c4af5b None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:33.584226 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:33.603827 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93f4415-f525-409a-8778-b2d8026a5c80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:33.605550 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93f4415-f525-409a-8778-b2d8026a5c80 None admin] REQUEST_METHOD: `PUT` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:33.606357 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93f4415-f525-409a-8778-b2d8026a5c80 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:33.606934 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93f4415-f525-409a-8778-b2d8026a5c80 None admin] PATH_INFO: `/v3/projects/37e686c883dc4b19bd52b4543bcb33e2/groups/1356126a7cff439c889af1c50c4d89b3/roles/17dfac38a2e540fea229af7de99911bb` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:33.608722 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aec948-50fe-43a8-abdd-7d2449588967 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:33.609543 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93f4415-f525-409a-8778-b2d8026a5c80 None admin] RBAC: Authorizing `identity:create_grant(project_id=37e686c883dc4b19bd52b4543bcb33e2, group_id=1356126a7cff439c889af1c50c4d89b3, role_id=17dfac38a2e540fea229af7de99911bb)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:33.612219 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93f4415-f525-409a-8778-b2d8026a5c80 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:33.630373 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 197/406] 10.222.0.40 () {58 vars in 1442 bytes} [Thu Jul 14 09:24:33 2022] PUT /identity/v3/projects/37e686c883dc4b19bd52b4543bcb33e2/groups/1356126a7cff439c889af1c50c4d89b3/roles/17dfac38a2e540fea229af7de99911bb => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:24:33.631652 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8146617a-6221-43c4-9743-31116f0ead37 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:33.632039 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8146617a-6221-43c4-9743-31116f0ead37 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:33.632319 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8146617a-6221-43c4-9743-31116f0ead37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:33.652944 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-8146617a-6221-43c4-9743-31116f0ead37 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:24:33.654273 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-8146617a-6221-43c4-9743-31116f0ead37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:24:33.658568 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea19199-723f-44da-a37a-e5f7797d4bc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:33.660091 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea19199-723f-44da-a37a-e5f7797d4bc4 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:33.660384 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea19199-723f-44da-a37a-e5f7797d4bc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:33.660660 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea19199-723f-44da-a37a-e5f7797d4bc4 None admin] PATH_INFO: `/v3/groups/1356126a7cff439c889af1c50c4d89b3` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:33.663047 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea19199-723f-44da-a37a-e5f7797d4bc4 None admin] RBAC: Authorizing `identity:get_group(group_id=1356126a7cff439c889af1c50c4d89b3)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:33.664931 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea19199-723f-44da-a37a-e5f7797d4bc4 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:33.668733 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 210/407] 10.222.0.40 () {56 vars in 1180 bytes} [Thu Jul 14 09:24:33 2022] GET /identity/v3/groups/1356126a7cff439c889af1c50c4d89b3 => generated 226 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:24:33.675192 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea19199-723f-44da-a37a-e5f7797d4bc4 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:33.805961 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 198/408] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:24:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 09:24:33.828864 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8146617a-6221-43c4-9743-31116f0ead37 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:33.886978 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea19199-723f-44da-a37a-e5f7797d4bc4 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:33.899302 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:33.933311 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0d57f6-98f7-4a79-8a0b-f3a8a2528914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:33.934506 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0d57f6-98f7-4a79-8a0b-f3a8a2528914 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:33.934997 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0d57f6-98f7-4a79-8a0b-f3a8a2528914 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:33.935467 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0d57f6-98f7-4a79-8a0b-f3a8a2528914 None admin] PATH_INFO: `/v3/projects/37e686c883dc4b19bd52b4543bcb33e2` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:33.937097 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0d57f6-98f7-4a79-8a0b-f3a8a2528914 None admin] RBAC: Authorizing `identity:get_project(project_id=37e686c883dc4b19bd52b4543bcb33e2)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:33.939114 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0d57f6-98f7-4a79-8a0b-f3a8a2528914 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:33.941435 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 211/409] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jul 14 09:24:33 2022] GET /identity/v3/projects/37e686c883dc4b19bd52b4543bcb33e2 => generated 302 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:24:33.951782 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0d57f6-98f7-4a79-8a0b-f3a8a2528914 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:33.962044 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8146617a-6221-43c4-9743-31116f0ead37 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:33.987698 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:34.032162 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de65a43-7d90-47c8-84b6-98cee04b3cfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:34.032966 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de65a43-7d90-47c8-84b6-98cee04b3cfd None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:34.033250 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de65a43-7d90-47c8-84b6-98cee04b3cfd None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:34.033579 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de65a43-7d90-47c8-84b6-98cee04b3cfd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:34.046143 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de65a43-7d90-47c8-84b6-98cee04b3cfd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:24:34.054092 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-5de65a43-7d90-47c8-84b6-98cee04b3cfd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 09:24:34.054092 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:24:34.054092 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:24:34.054092 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:24:34.054092 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:24:34.054092 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:24:34.054092 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:24:34.054092 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:24:34.054092 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:24:34.054092 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:24:34.054092 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:24:34.054092 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:24:34.054092 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:24:34.054092 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:24:34.054092 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:24:34.054092 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:24:34.055643 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:24:34.055643 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:24:34.055643 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:24:34.055643 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:24:34.055643 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:24:34.055643 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:24:34.055643 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:24:34.055643 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:24:34.055643 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:24:34.055643 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:24:34.055643 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:24:34.055643 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( Jul 14 09:24:34.055643 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:24:34.055643 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:24:34.055643 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:24:34.055643 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:24:34.056481 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:24:34.056481 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:24:34.056481 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:24:34.056481 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:24:34.056481 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:24:34.056481 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:24:34.056481 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:24:34.056481 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:24:34.056481 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:24:34.056481 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:24:34.056481 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 09:24:34.056481 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:24:34.056481 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 199/410] 10.222.0.40 () {56 vars in 1096 bytes} [Thu Jul 14 09:24:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:24:34.063329 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de65a43-7d90-47c8-84b6-98cee04b3cfd None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:34.158653 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0d57f6-98f7-4a79-8a0b-f3a8a2528914 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:34.169995 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de65a43-7d90-47c8-84b6-98cee04b3cfd None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:34.189893 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:34.208389 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e2cdf0-f936-407d-aa70-8d59000f8895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:34.209219 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e2cdf0-f936-407d-aa70-8d59000f8895 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:34.209608 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e2cdf0-f936-407d-aa70-8d59000f8895 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:34.209991 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e2cdf0-f936-407d-aa70-8d59000f8895 None admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:34.210889 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e2cdf0-f936-407d-aa70-8d59000f8895 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:24:34.211346 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e2cdf0-f936-407d-aa70-8d59000f8895 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:34.212818 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e2cdf0-f936-407d-aa70-8d59000f8895 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:34.221813 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 200/411] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 14 09:24:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:24:34.227722 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e2cdf0-f936-407d-aa70-8d59000f8895 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:34.258933 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0863cc85-2765-40b5-a592-c124aa28b4da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:34.259840 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0863cc85-2765-40b5-a592-c124aa28b4da None admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:34.260124 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0863cc85-2765-40b5-a592-c124aa28b4da None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:34.260399 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0863cc85-2765-40b5-a592-c124aa28b4da None admin] PATH_INFO: `/v3/projects/37e686c883dc4b19bd52b4543bcb33e2/groups/1356126a7cff439c889af1c50c4d89b3/roles/f755c764373f47bababa1e942a53c2e1` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:34.271023 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0863cc85-2765-40b5-a592-c124aa28b4da None admin] RBAC: Authorizing `identity:create_grant(project_id=37e686c883dc4b19bd52b4543bcb33e2, group_id=1356126a7cff439c889af1c50c4d89b3, role_id=f755c764373f47bababa1e942a53c2e1)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:34.272487 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0863cc85-2765-40b5-a592-c124aa28b4da None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:34.310051 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 212/412] 10.222.0.40 () {58 vars in 1442 bytes} [Thu Jul 14 09:24:33 2022] PUT /identity/v3/projects/37e686c883dc4b19bd52b4543bcb33e2/groups/1356126a7cff439c889af1c50c4d89b3/roles/f755c764373f47bababa1e942a53c2e1 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:24:34.336777 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e2cdf0-f936-407d-aa70-8d59000f8895 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:34.375873 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6c6caa-7ed9-4a92-9bca-198fff02f602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:34.376749 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6c6caa-7ed9-4a92-9bca-198fff02f602 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:34.377036 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6c6caa-7ed9-4a92-9bca-198fff02f602 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:34.377316 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6c6caa-7ed9-4a92-9bca-198fff02f602 None admin] PATH_INFO: `/v3/groups/7bb579e6b4ed4ca7bbd1fcbefd8dab5d` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:34.378578 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6c6caa-7ed9-4a92-9bca-198fff02f602 None admin] RBAC: Authorizing `identity:get_group(group_id=7bb579e6b4ed4ca7bbd1fcbefd8dab5d)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:34.380022 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6c6caa-7ed9-4a92-9bca-198fff02f602 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:34.381962 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 201/413] 10.222.0.40 () {56 vars in 1180 bytes} [Thu Jul 14 09:24:34 2022] GET /identity/v3/groups/7bb579e6b4ed4ca7bbd1fcbefd8dab5d => generated 229 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:24:34.387638 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0863cc85-2765-40b5-a592-c124aa28b4da None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:34.503523 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:34.534956 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0863cc85-2765-40b5-a592-c124aa28b4da None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:34.574718 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd3c1e3-f6f4-4e77-8063-56e6aa119d11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:34.575512 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd3c1e3-f6f4-4e77-8063-56e6aa119d11 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:34.575796 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd3c1e3-f6f4-4e77-8063-56e6aa119d11 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:34.576617 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd3c1e3-f6f4-4e77-8063-56e6aa119d11 None admin] PATH_INFO: `/v3/projects/fc045bacae334916a4c6d8daadbcb707` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:34.578006 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd3c1e3-f6f4-4e77-8063-56e6aa119d11 None admin] RBAC: Authorizing `identity:get_project(project_id=fc045bacae334916a4c6d8daadbcb707)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:34.579510 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd3c1e3-f6f4-4e77-8063-56e6aa119d11 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:34.581615 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 213/414] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jul 14 09:24:34 2022] GET /identity/v3/projects/fc045bacae334916a4c6d8daadbcb707 => generated 344 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:24:34.589004 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6c6caa-7ed9-4a92-9bca-198fff02f602 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:34.653787 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:34.711706 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6c6caa-7ed9-4a92-9bca-198fff02f602 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:34.747523 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b187a8-1c11-4370-a064-67f864350b24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:34.748412 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b187a8-1c11-4370-a064-67f864350b24 None admin] REQUEST_METHOD: `PUT` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:34.748696 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b187a8-1c11-4370-a064-67f864350b24 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:34.748972 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b187a8-1c11-4370-a064-67f864350b24 None admin] PATH_INFO: `/v3/projects/fc045bacae334916a4c6d8daadbcb707/groups/7bb579e6b4ed4ca7bbd1fcbefd8dab5d/roles/e3965bd0d5f1427a86a313c0c90bfef3` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:34.750971 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b187a8-1c11-4370-a064-67f864350b24 None admin] RBAC: Authorizing `identity:create_grant(project_id=fc045bacae334916a4c6d8daadbcb707, group_id=7bb579e6b4ed4ca7bbd1fcbefd8dab5d, role_id=e3965bd0d5f1427a86a313c0c90bfef3)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:34.752418 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b187a8-1c11-4370-a064-67f864350b24 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:34.767472 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 202/415] 10.222.0.40 () {58 vars in 1442 bytes} [Thu Jul 14 09:24:34 2022] PUT /identity/v3/projects/fc045bacae334916a4c6d8daadbcb707/groups/7bb579e6b4ed4ca7bbd1fcbefd8dab5d/roles/e3965bd0d5f1427a86a313c0c90bfef3 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:24:34.813500 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d5a8f3-8d57-4c5a-8e59-fcf11edc857b None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:34.814133 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d5a8f3-8d57-4c5a-8e59-fcf11edc857b None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:34.814661 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d5a8f3-8d57-4c5a-8e59-fcf11edc857b None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:34.816646 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 214/416] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:24:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:24:34.822445 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d37a4c2-9a35-4120-a53e-b97a8cbb9ab7 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:34.822752 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d37a4c2-9a35-4120-a53e-b97a8cbb9ab7 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:34.823018 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d37a4c2-9a35-4120-a53e-b97a8cbb9ab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:34.859596 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-2d37a4c2-9a35-4120-a53e-b97a8cbb9ab7 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:24:34.860814 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-2d37a4c2-9a35-4120-a53e-b97a8cbb9ab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:24:34.960059 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 203/417] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:24:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 09:24:34.983398 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d5a8f3-8d57-4c5a-8e59-fcf11edc857b None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:35.061993 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcae70e-c01f-42c8-907f-327a97f8b33f None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:35.063091 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcae70e-c01f-42c8-907f-327a97f8b33f None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:35.063606 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcae70e-c01f-42c8-907f-327a97f8b33f None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:35.065565 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 204/418] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:24:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 09:24:35.076512 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b65e39a-e745-4c21-a35c-74d5f8cab280 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:35.077195 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b65e39a-e745-4c21-a35c-74d5f8cab280 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:35.077784 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b65e39a-e745-4c21-a35c-74d5f8cab280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:35.103169 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d5a8f3-8d57-4c5a-8e59-fcf11edc857b None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:35.106087 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-6b65e39a-e745-4c21-a35c-74d5f8cab280 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:24:35.108372 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-6b65e39a-e745-4c21-a35c-74d5f8cab280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:24:35.166430 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:35.170066 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0f54ce-b0db-45e1-ab79-4f9eda4dd5e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:35.170923 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0f54ce-b0db-45e1-ab79-4f9eda4dd5e7 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:35.171212 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0f54ce-b0db-45e1-ab79-4f9eda4dd5e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:35.171493 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0f54ce-b0db-45e1-ab79-4f9eda4dd5e7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:35.203421 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0f54ce-b0db-45e1-ab79-4f9eda4dd5e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:24:35.219206 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-2f0f54ce-b0db-45e1-ab79-4f9eda4dd5e7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 09:24:35.219206 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:24:35.219206 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:24:35.219206 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:24:35.219206 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:24:35.219206 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:24:35.219206 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:24:35.219206 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:24:35.219206 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:24:35.219206 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:24:35.219206 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:24:35.219206 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:24:35.219206 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:24:35.219206 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:24:35.219206 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:24:35.219206 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:24:35.220156 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:24:35.220156 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:24:35.220156 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:24:35.220156 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:24:35.220156 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:24:35.220156 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:24:35.220156 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:24:35.220156 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:24:35.220156 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:24:35.220156 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:24:35.220156 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:24:35.220156 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( Jul 14 09:24:35.220156 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:24:35.220156 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:24:35.220156 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:24:35.220156 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:24:35.220944 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:24:35.220944 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:24:35.220944 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:24:35.220944 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:24:35.220944 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:24:35.220944 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:24:35.220944 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:24:35.220944 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:24:35.220944 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:24:35.220944 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:24:35.220944 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 09:24:35.220944 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Jul 14 09:24:35.227315 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 215/419] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 14 09:24:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:24:35.228658 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0f54ce-b0db-45e1-ab79-4f9eda4dd5e7 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:35.234449 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:35.269415 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 205/420] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:24:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 09:24:35.294180 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b65e39a-e745-4c21-a35c-74d5f8cab280 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:35.438373 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0f54ce-b0db-45e1-ab79-4f9eda4dd5e7 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:35.466866 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b65e39a-e745-4c21-a35c-74d5f8cab280 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:35.505326 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209e3e7e-13d6-4f97-88a0-38ef8677105d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:35.506549 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209e3e7e-13d6-4f97-88a0-38ef8677105d None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:35.506837 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209e3e7e-13d6-4f97-88a0-38ef8677105d None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:35.507116 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209e3e7e-13d6-4f97-88a0-38ef8677105d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:35.519317 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209e3e7e-13d6-4f97-88a0-38ef8677105d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:24:35.527890 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-209e3e7e-13d6-4f97-88a0-38ef8677105d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 09:24:35.527890 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:24:35.527890 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:24:35.527890 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:24:35.527890 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:24:35.527890 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:24:35.527890 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:24:35.527890 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:24:35.527890 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:24:35.527890 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:24:35.527890 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:24:35.527890 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:24:35.527890 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:24:35.527890 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:24:35.527890 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:24:35.527890 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:24:35.528830 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:24:35.528830 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:24:35.528830 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:24:35.528830 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:24:35.528830 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:24:35.528830 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:24:35.528830 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:24:35.528830 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:24:35.528830 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:24:35.528830 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:24:35.528830 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:24:35.528830 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( Jul 14 09:24:35.528830 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:24:35.528830 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:24:35.528830 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:24:35.528830 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:24:35.529619 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:24:35.529619 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:24:35.529619 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:24:35.529619 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:24:35.529619 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:24:35.529619 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:24:35.529619 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:24:35.529619 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:24:35.529619 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:24:35.529619 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:24:35.529619 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 09:24:35.529619 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:24:35.529619 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 206/421] 10.222.0.40 () {56 vars in 1114 bytes} [Thu Jul 14 09:24:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 09:24:35.538168 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e1903e-e5e4-4fc2-8f95-1cdd22df4bd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:35.538555 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209e3e7e-13d6-4f97-88a0-38ef8677105d None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:35.539209 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e1903e-e5e4-4fc2-8f95-1cdd22df4bd2 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:35.539583 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e1903e-e5e4-4fc2-8f95-1cdd22df4bd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:35.539942 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e1903e-e5e4-4fc2-8f95-1cdd22df4bd2 None admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:35.540774 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e1903e-e5e4-4fc2-8f95-1cdd22df4bd2 None admin] RBAC: Adding query filter params (name=member) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:24:35.541156 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e1903e-e5e4-4fc2-8f95-1cdd22df4bd2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:35.542758 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e1903e-e5e4-4fc2-8f95-1cdd22df4bd2 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:35.573269 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 216/422] 10.222.0.40 () {56 vars in 1101 bytes} [Thu Jul 14 09:24:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:24:35.580316 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e1903e-e5e4-4fc2-8f95-1cdd22df4bd2 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:35.594653 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:35.649625 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:35.693993 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e1903e-e5e4-4fc2-8f95-1cdd22df4bd2 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:35.757359 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbca2465-03af-44e7-bd3b-5742ad2b5414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:35.760950 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbca2465-03af-44e7-bd3b-5742ad2b5414 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:35.761475 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbca2465-03af-44e7-bd3b-5742ad2b5414 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:35.762035 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbca2465-03af-44e7-bd3b-5742ad2b5414 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:35.778139 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209e3e7e-13d6-4f97-88a0-38ef8677105d None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:35.846779 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabce3ff-2f90-40c5-b94a-4286e08efe1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:35.847458 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabce3ff-2f90-40c5-b94a-4286e08efe1c None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:35.847747 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabce3ff-2f90-40c5-b94a-4286e08efe1c None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:35.848024 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabce3ff-2f90-40c5-b94a-4286e08efe1c None admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:35.848788 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabce3ff-2f90-40c5-b94a-4286e08efe1c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:24:35.849101 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabce3ff-2f90-40c5-b94a-4286e08efe1c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:35.850520 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabce3ff-2f90-40c5-b94a-4286e08efe1c None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:35.864599 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 207/423] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jul 14 09:24:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:24:35.871000 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabce3ff-2f90-40c5-b94a-4286e08efe1c None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:35.910353 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbca2465-03af-44e7-bd3b-5742ad2b5414 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:35.911816 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbca2465-03af-44e7-bd3b-5742ad2b5414 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:36.030637 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:36.041537 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:36.058804 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabce3ff-2f90-40c5-b94a-4286e08efe1c None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:36.106337 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 217/424] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 14 09:24:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 527 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 14 09:24:36.113354 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbca2465-03af-44e7-bd3b-5742ad2b5414 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:36.125029 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a188aafb-b500-4f43-9da3-58c018806d50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:36.125694 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a188aafb-b500-4f43-9da3-58c018806d50 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:36.125989 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a188aafb-b500-4f43-9da3-58c018806d50 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:36.126296 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a188aafb-b500-4f43-9da3-58c018806d50 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:36.253404 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a188aafb-b500-4f43-9da3-58c018806d50 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:36.254911 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a188aafb-b500-4f43-9da3-58c018806d50 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:36.285354 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbca2465-03af-44e7-bd3b-5742ad2b5414 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:36.335702 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdec1fa-c118-4419-8af6-32b31ad857ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:36.335702 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdec1fa-c118-4419-8af6-32b31ad857ff None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:36.335702 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdec1fa-c118-4419-8af6-32b31ad857ff None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:36.335702 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdec1fa-c118-4419-8af6-32b31ad857ff None admin] PATH_INFO: `/v3/projects/86c6d2afd7954c56860744ef0c7dc36d` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:36.336607 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdec1fa-c118-4419-8af6-32b31ad857ff None admin] RBAC: Authorizing `identity:get_project(project_id=86c6d2afd7954c56860744ef0c7dc36d)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:36.336607 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdec1fa-c118-4419-8af6-32b31ad857ff None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:36.336607 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 218/425] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jul 14 09:24:36 2022] GET /identity/v3/projects/86c6d2afd7954c56860744ef0c7dc36d => generated 298 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:24:36.346232 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdec1fa-c118-4419-8af6-32b31ad857ff None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:36.395119 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:36.417982 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:36.428762 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 208/426] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 14 09:24:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 558 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 09:24:36.430483 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2591637d-9f6f-4356-8db5-61794989bcd6 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:36.430841 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2591637d-9f6f-4356-8db5-61794989bcd6 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:36.431186 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2591637d-9f6f-4356-8db5-61794989bcd6 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:36.436691 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 209/427] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:24:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:24:36.437813 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2591637d-9f6f-4356-8db5-61794989bcd6 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:36.483398 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdec1fa-c118-4419-8af6-32b31ad857ff None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:36.522337 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405e8f1a-b9e4-4d50-8486-c8a3baa2197d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:36.523220 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405e8f1a-b9e4-4d50-8486-c8a3baa2197d None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:36.523547 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405e8f1a-b9e4-4d50-8486-c8a3baa2197d None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:36.523829 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405e8f1a-b9e4-4d50-8486-c8a3baa2197d None admin] PATH_INFO: `/v3/groups/1356126a7cff439c889af1c50c4d89b3` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:36.525081 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405e8f1a-b9e4-4d50-8486-c8a3baa2197d None admin] RBAC: Authorizing `identity:get_group(group_id=1356126a7cff439c889af1c50c4d89b3)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:36.526579 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405e8f1a-b9e4-4d50-8486-c8a3baa2197d None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:36.533245 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 219/428] 10.222.0.40 () {56 vars in 1180 bytes} [Thu Jul 14 09:24:36 2022] GET /identity/v3/groups/1356126a7cff439c889af1c50c4d89b3 => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:24:36.534753 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41268c9-2a99-4430-9f3f-6a7a532fc4bd None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:36.535050 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41268c9-2a99-4430-9f3f-6a7a532fc4bd None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:36.535337 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41268c9-2a99-4430-9f3f-6a7a532fc4bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:36.553071 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-b41268c9-2a99-4430-9f3f-6a7a532fc4bd None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:24:36.554268 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-b41268c9-2a99-4430-9f3f-6a7a532fc4bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:24:36.581753 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2591637d-9f6f-4356-8db5-61794989bcd6 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:36.627803 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0eb746c-52e8-40ca-babd-fa2ac564e181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:36.628687 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eb746c-52e8-40ca-babd-fa2ac564e181 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:36.629026 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eb746c-52e8-40ca-babd-fa2ac564e181 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:36.629316 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eb746c-52e8-40ca-babd-fa2ac564e181 None admin] PATH_INFO: `/v3/projects/86c6d2afd7954c56860744ef0c7dc36d` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:36.630603 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0eb746c-52e8-40ca-babd-fa2ac564e181 None admin] RBAC: Authorizing `identity:get_project(project_id=86c6d2afd7954c56860744ef0c7dc36d)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:36.631475 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 220/429] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:24:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 09:24:36.632121 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0eb746c-52e8-40ca-babd-fa2ac564e181 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:36.632651 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41268c9-2a99-4430-9f3f-6a7a532fc4bd None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:36.644466 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 210/430] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jul 14 09:24:36 2022] GET /identity/v3/projects/86c6d2afd7954c56860744ef0c7dc36d => generated 298 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:24:36.645590 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0eb746c-52e8-40ca-babd-fa2ac564e181 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:36.669954 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:36.724590 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:36.749451 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41268c9-2a99-4430-9f3f-6a7a532fc4bd None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:36.772126 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0eb746c-52e8-40ca-babd-fa2ac564e181 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:36.787164 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd8955a-6a33-4c21-835e-891534d5416c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:36.788067 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd8955a-6a33-4c21-835e-891534d5416c None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:36.788530 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd8955a-6a33-4c21-835e-891534d5416c None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:36.789041 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd8955a-6a33-4c21-835e-891534d5416c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:36.790559 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd8955a-6a33-4c21-835e-891534d5416c None admin] RBAC: Adding query filter params (group.id=1356126a7cff439c889af1c50c4d89b3, role.id=17dfac38a2e540fea229af7de99911bb, scope.project.id=86c6d2afd7954c56860744ef0c7dc36d) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:24:36.791066 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd8955a-6a33-4c21-835e-891534d5416c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:36.792700 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd8955a-6a33-4c21-835e-891534d5416c None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:36.801022 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 221/431] 10.222.0.40 () {56 vars in 1376 bytes} [Thu Jul 14 09:24:36 2022] GET /identity/v3/role_assignments?group.id=1356126a7cff439c889af1c50c4d89b3&scope.project.id=86c6d2afd7954c56860744ef0c7dc36d&role.id=17dfac38a2e540fea229af7de99911bb => generated 611 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:24:36.807346 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd8955a-6a33-4c21-835e-891534d5416c None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:36.811585 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43063ca9-9d10-405d-8971-a5b6e38ea68b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:36.812605 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43063ca9-9d10-405d-8971-a5b6e38ea68b None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:36.812885 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43063ca9-9d10-405d-8971-a5b6e38ea68b None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:36.813155 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43063ca9-9d10-405d-8971-a5b6e38ea68b None admin] PATH_INFO: `/v3/groups/1356126a7cff439c889af1c50c4d89b3` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:36.814427 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43063ca9-9d10-405d-8971-a5b6e38ea68b None admin] RBAC: Authorizing `identity:get_group(group_id=1356126a7cff439c889af1c50c4d89b3)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:36.816144 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43063ca9-9d10-405d-8971-a5b6e38ea68b None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:36.823954 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 211/432] 10.222.0.40 () {56 vars in 1180 bytes} [Thu Jul 14 09:24:36 2022] GET /identity/v3/groups/1356126a7cff439c889af1c50c4d89b3 => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:24:36.823954 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43063ca9-9d10-405d-8971-a5b6e38ea68b None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:36.956949 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43063ca9-9d10-405d-8971-a5b6e38ea68b None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:36.989291 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:36.997193 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:37.000526 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd8955a-6a33-4c21-835e-891534d5416c None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:37.015342 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eea12e2-7a79-4229-a691-ebe331c7bc6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:37.016018 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eea12e2-7a79-4229-a691-ebe331c7bc6b None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:37.016305 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eea12e2-7a79-4229-a691-ebe331c7bc6b None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:37.016587 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eea12e2-7a79-4229-a691-ebe331c7bc6b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:37.017436 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eea12e2-7a79-4229-a691-ebe331c7bc6b None admin] RBAC: Adding query filter params (group.id=1356126a7cff439c889af1c50c4d89b3, role.id=f755c764373f47bababa1e942a53c2e1, scope.project.id=86c6d2afd7954c56860744ef0c7dc36d) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:24:37.017753 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eea12e2-7a79-4229-a691-ebe331c7bc6b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:37.020182 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eea12e2-7a79-4229-a691-ebe331c7bc6b None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:37.028154 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 212/433] 10.222.0.40 () {56 vars in 1376 bytes} [Thu Jul 14 09:24:36 2022] GET /identity/v3/role_assignments?group.id=1356126a7cff439c889af1c50c4d89b3&scope.project.id=86c6d2afd7954c56860744ef0c7dc36d&role.id=f755c764373f47bababa1e942a53c2e1 => generated 611 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:24:37.029461 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cad3a7-c4e5-4445-a6f7-0b809ebd7cdc None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:37.029761 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cad3a7-c4e5-4445-a6f7-0b809ebd7cdc None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:37.030044 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cad3a7-c4e5-4445-a6f7-0b809ebd7cdc None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:37.031333 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 213/434] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:24:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:24:37.037040 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883ff2d4-e2fb-411d-b15f-a004ac5096e3 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:37.037336 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883ff2d4-e2fb-411d-b15f-a004ac5096e3 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:37.037624 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883ff2d4-e2fb-411d-b15f-a004ac5096e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:37.047820 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e76a0df-2f4b-40b7-8840-c5491a2fc3e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:37.049433 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e76a0df-2f4b-40b7-8840-c5491a2fc3e3 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:37.049927 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e76a0df-2f4b-40b7-8840-c5491a2fc3e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:37.050435 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e76a0df-2f4b-40b7-8840-c5491a2fc3e3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:37.061217 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-883ff2d4-e2fb-411d-b15f-a004ac5096e3 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:24:37.062528 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-883ff2d4-e2fb-411d-b15f-a004ac5096e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:24:37.065383 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e76a0df-2f4b-40b7-8840-c5491a2fc3e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:24:37.074226 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-0e76a0df-2f4b-40b7-8840-c5491a2fc3e3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 09:24:37.074226 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:24:37.074226 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:24:37.074226 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:24:37.074226 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:24:37.074226 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:24:37.074226 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:24:37.074226 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:24:37.074226 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:24:37.074226 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:24:37.074226 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:24:37.074226 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:24:37.074226 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:24:37.074226 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:24:37.074226 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:24:37.074226 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:24:37.075188 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:24:37.075188 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:24:37.075188 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:24:37.075188 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:24:37.075188 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:24:37.075188 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:24:37.075188 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:24:37.075188 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:24:37.075188 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:24:37.075188 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:24:37.075188 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:24:37.075188 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( Jul 14 09:24:37.075188 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:24:37.075188 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:24:37.075188 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:24:37.075188 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:24:37.075993 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:24:37.075993 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:24:37.075993 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:24:37.075993 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:24:37.075993 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:24:37.075993 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:24:37.075993 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:24:37.075993 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:24:37.075993 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:24:37.075993 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:24:37.075993 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 09:24:37.075993 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Jul 14 09:24:37.078971 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 222/435] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 14 09:24:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:24:37.080528 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4049260-01d1-4058-9190-7dd5e09b2734 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:37.081037 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4049260-01d1-4058-9190-7dd5e09b2734 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:37.081320 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4049260-01d1-4058-9190-7dd5e09b2734 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:37.082683 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 223/436] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:24:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:24:37.088033 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4049260-01d1-4058-9190-7dd5e09b2734 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:37.174357 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 214/437] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:24:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 09:24:37.176412 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b448025f-91c6-4ff9-84f3-167f7c5bee2d None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:37.176713 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b448025f-91c6-4ff9-84f3-167f7c5bee2d None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:37.176992 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b448025f-91c6-4ff9-84f3-167f7c5bee2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:37.195774 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-b448025f-91c6-4ff9-84f3-167f7c5bee2d None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:24:37.197107 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-b448025f-91c6-4ff9-84f3-167f7c5bee2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:24:37.226911 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4049260-01d1-4058-9190-7dd5e09b2734 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:37.274310 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d64a63-4a8c-43dc-84a5-6d71810b44c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:37.274996 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d64a63-4a8c-43dc-84a5-6d71810b44c5 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:37.275281 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d64a63-4a8c-43dc-84a5-6d71810b44c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:37.275559 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d64a63-4a8c-43dc-84a5-6d71810b44c5 None admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:37.276326 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d64a63-4a8c-43dc-84a5-6d71810b44c5 None admin] RBAC: Adding query filter params (name=member) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:24:37.277005 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d64a63-4a8c-43dc-84a5-6d71810b44c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:37.278036 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d64a63-4a8c-43dc-84a5-6d71810b44c5 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:37.287621 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 224/438] 10.222.0.40 () {56 vars in 1101 bytes} [Thu Jul 14 09:24:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:24:37.288756 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d64a63-4a8c-43dc-84a5-6d71810b44c5 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:37.297961 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 215/439] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:24:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 09:24:37.299001 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b448025f-91c6-4ff9-84f3-167f7c5bee2d None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:37.316972 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:37.368851 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:37.420152 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d64a63-4a8c-43dc-84a5-6d71810b44c5 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:37.434760 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b448025f-91c6-4ff9-84f3-167f7c5bee2d None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:37.464046 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376b6199-68f4-4f03-a1e7-dbb1b2f1b1bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:37.464910 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376b6199-68f4-4f03-a1e7-dbb1b2f1b1bf None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:37.465207 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376b6199-68f4-4f03-a1e7-dbb1b2f1b1bf None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:37.465483 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376b6199-68f4-4f03-a1e7-dbb1b2f1b1bf None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:37.477174 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bae538-4702-4452-94e6-80ab87f9699f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:37.477385 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376b6199-68f4-4f03-a1e7-dbb1b2f1b1bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:24:37.477851 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bae538-4702-4452-94e6-80ab87f9699f None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:37.478140 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bae538-4702-4452-94e6-80ab87f9699f None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:37.478448 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bae538-4702-4452-94e6-80ab87f9699f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:37.485902 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-376b6199-68f4-4f03-a1e7-dbb1b2f1b1bf None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 09:24:37.485902 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:24:37.485902 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:24:37.485902 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:24:37.485902 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:24:37.485902 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:24:37.485902 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:24:37.485902 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:24:37.485902 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:24:37.485902 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:24:37.485902 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:24:37.485902 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:24:37.485902 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:24:37.485902 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:24:37.485902 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:24:37.485902 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:24:37.486893 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:24:37.486893 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:24:37.486893 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:24:37.486893 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:24:37.486893 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:24:37.486893 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:24:37.486893 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:24:37.486893 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:24:37.486893 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:24:37.486893 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:24:37.486893 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:24:37.486893 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( Jul 14 09:24:37.486893 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:24:37.486893 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:24:37.486893 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:24:37.486893 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:24:37.487677 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:24:37.487677 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:24:37.487677 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:24:37.487677 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:24:37.487677 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:24:37.487677 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:24:37.487677 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:24:37.487677 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:24:37.487677 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:24:37.487677 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:24:37.487677 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 09:24:37.487677 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Jul 14 09:24:37.487677 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 225/440] 10.222.0.40 () {56 vars in 1114 bytes} [Thu Jul 14 09:24:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:24:37.488397 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376b6199-68f4-4f03-a1e7-dbb1b2f1b1bf None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:37.557709 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bae538-4702-4452-94e6-80ab87f9699f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:37.559250 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bae538-4702-4452-94e6-80ab87f9699f None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:37.571391 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:37.593951 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376b6199-68f4-4f03-a1e7-dbb1b2f1b1bf None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:37.606969 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:37.627873 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a89cb6-0f71-4bb8-be1f-db9b92ced7c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:37.628755 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a89cb6-0f71-4bb8-be1f-db9b92ced7c2 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:37.629045 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a89cb6-0f71-4bb8-be1f-db9b92ced7c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:37.629321 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a89cb6-0f71-4bb8-be1f-db9b92ced7c2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:37.640581 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a89cb6-0f71-4bb8-be1f-db9b92ced7c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:24:37.648438 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-b2a89cb6-0f71-4bb8-be1f-db9b92ced7c2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 09:24:37.648438 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:24:37.648438 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:24:37.648438 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:24:37.648438 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:24:37.648438 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:24:37.648438 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:24:37.648438 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:24:37.648438 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:24:37.648438 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:24:37.648438 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:24:37.648438 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:24:37.648438 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:24:37.648438 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:24:37.648438 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:24:37.648438 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:24:37.649355 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:24:37.649355 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:24:37.649355 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:24:37.649355 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:24:37.649355 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:24:37.649355 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:24:37.649355 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:24:37.649355 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:24:37.649355 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:24:37.649355 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:24:37.649355 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:24:37.649355 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( Jul 14 09:24:37.649355 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:24:37.649355 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:24:37.649355 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:24:37.649355 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:24:37.650131 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:24:37.650131 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:24:37.650131 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:24:37.650131 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:24:37.650131 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:24:37.650131 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:24:37.650131 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:24:37.650131 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:24:37.650131 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:24:37.650131 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:24:37.650131 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 09:24:37.650131 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Jul 14 09:24:37.650131 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 226/441] 10.222.0.40 () {56 vars in 1096 bytes} [Thu Jul 14 09:24:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:24:37.650820 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a89cb6-0f71-4bb8-be1f-db9b92ced7c2 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:37.664996 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 216/442] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 14 09:24:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 09:24:37.664996 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bae538-4702-4452-94e6-80ab87f9699f None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:37.761031 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a89cb6-0f71-4bb8-be1f-db9b92ced7c2 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:37.763992 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bae538-4702-4452-94e6-80ab87f9699f None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:37.795248 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf354419-3a9c-42d2-bc2d-a286b94acd9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:37.795936 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf354419-3a9c-42d2-bc2d-a286b94acd9e None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:37.796201 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf354419-3a9c-42d2-bc2d-a286b94acd9e None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:37.796476 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf354419-3a9c-42d2-bc2d-a286b94acd9e None admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:37.797326 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf354419-3a9c-42d2-bc2d-a286b94acd9e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:24:37.797453 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eadcca-2be6-421d-b53f-0a7b0e876ce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:37.797635 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf354419-3a9c-42d2-bc2d-a286b94acd9e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:37.798052 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eadcca-2be6-421d-b53f-0a7b0e876ce0 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:37.798362 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eadcca-2be6-421d-b53f-0a7b0e876ce0 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:37.798645 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eadcca-2be6-421d-b53f-0a7b0e876ce0 None admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:37.799050 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf354419-3a9c-42d2-bc2d-a286b94acd9e None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:37.799392 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2eadcca-2be6-421d-b53f-0a7b0e876ce0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:24:37.799700 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2eadcca-2be6-421d-b53f-0a7b0e876ce0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:37.801142 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2eadcca-2be6-421d-b53f-0a7b0e876ce0 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:37.801272 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:37.808242 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 227/443] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jul 14 09:24:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:24:37.809078 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf354419-3a9c-42d2-bc2d-a286b94acd9e None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:37.810580 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 217/444] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 14 09:24:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:24:37.813995 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eadcca-2be6-421d-b53f-0a7b0e876ce0 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:37.829727 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:37.921434 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf354419-3a9c-42d2-bc2d-a286b94acd9e None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:37.928114 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eadcca-2be6-421d-b53f-0a7b0e876ce0 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:37.958625 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5057521b-5a88-4ad1-80c0-d85e7aff40d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:37.959577 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5057521b-5a88-4ad1-80c0-d85e7aff40d9 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:37.959937 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5057521b-5a88-4ad1-80c0-d85e7aff40d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:37.960261 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5057521b-5a88-4ad1-80c0-d85e7aff40d9 None admin] PATH_INFO: `/v3/projects/37e686c883dc4b19bd52b4543bcb33e2` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:37.961662 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5057521b-5a88-4ad1-80c0-d85e7aff40d9 None admin] RBAC: Authorizing `identity:get_project(project_id=37e686c883dc4b19bd52b4543bcb33e2)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:37.963203 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5057521b-5a88-4ad1-80c0-d85e7aff40d9 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:37.964943 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 228/445] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jul 14 09:24:37 2022] GET /identity/v3/projects/37e686c883dc4b19bd52b4543bcb33e2 => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:24:37.965718 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5057521b-5a88-4ad1-80c0-d85e7aff40d9 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:37.965814 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86badaea-c636-4cee-9709-aeca98aab446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:37.966495 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86badaea-c636-4cee-9709-aeca98aab446 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:37.966737 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86badaea-c636-4cee-9709-aeca98aab446 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:37.967019 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86badaea-c636-4cee-9709-aeca98aab446 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:38.034796 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:38.047032 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86badaea-c636-4cee-9709-aeca98aab446 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:38.048505 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86badaea-c636-4cee-9709-aeca98aab446 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:38.062912 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:38.070235 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5057521b-5a88-4ad1-80c0-d85e7aff40d9 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:38.106496 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cb8b59-5bd5-4e56-92c7-c08ec0ae1776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:38.107050 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cb8b59-5bd5-4e56-92c7-c08ec0ae1776 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:38.107488 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cb8b59-5bd5-4e56-92c7-c08ec0ae1776 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:38.107788 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cb8b59-5bd5-4e56-92c7-c08ec0ae1776 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:38.159482 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 218/446] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 14 09:24:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 14 09:24:38.160355 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86badaea-c636-4cee-9709-aeca98aab446 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:38.180778 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cb8b59-5bd5-4e56-92c7-c08ec0ae1776 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:38.182286 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cb8b59-5bd5-4e56-92c7-c08ec0ae1776 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:38.257644 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:38.262923 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86badaea-c636-4cee-9709-aeca98aab446 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:38.276589 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:38.295116 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 229/447] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 14 09:24:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 09:24:38.296109 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cb8b59-5bd5-4e56-92c7-c08ec0ae1776 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:38.301240 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fb5b5c-5e82-44e8-9c01-148307a4ffea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:38.302114 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fb5b5c-5e82-44e8-9c01-148307a4ffea None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:38.302432 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fb5b5c-5e82-44e8-9c01-148307a4ffea None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:38.302717 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fb5b5c-5e82-44e8-9c01-148307a4ffea None admin] PATH_INFO: `/v3/groups/1356126a7cff439c889af1c50c4d89b3` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:38.303913 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fb5b5c-5e82-44e8-9c01-148307a4ffea None admin] RBAC: Authorizing `identity:get_group(group_id=1356126a7cff439c889af1c50c4d89b3)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:38.305409 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fb5b5c-5e82-44e8-9c01-148307a4ffea None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:38.307077 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 219/448] 10.222.0.40 () {56 vars in 1180 bytes} [Thu Jul 14 09:24:38 2022] GET /identity/v3/groups/1356126a7cff439c889af1c50c4d89b3 => generated 226 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:24:38.307834 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fb5b5c-5e82-44e8-9c01-148307a4ffea None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:38.400333 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cb8b59-5bd5-4e56-92c7-c08ec0ae1776 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:38.415524 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fb5b5c-5e82-44e8-9c01-148307a4ffea None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:38.436095 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ef83e2-128f-451f-870a-8a4f963a5cf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:38.436969 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ef83e2-128f-451f-870a-8a4f963a5cf3 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:38.437287 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ef83e2-128f-451f-870a-8a4f963a5cf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:38.437540 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ef83e2-128f-451f-870a-8a4f963a5cf3 None admin] PATH_INFO: `/v3/projects/37e686c883dc4b19bd52b4543bcb33e2` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:38.438772 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ef83e2-128f-451f-870a-8a4f963a5cf3 None admin] RBAC: Authorizing `identity:get_project(project_id=37e686c883dc4b19bd52b4543bcb33e2)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:38.440221 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ef83e2-128f-451f-870a-8a4f963a5cf3 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:38.441926 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 230/449] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jul 14 09:24:38 2022] GET /identity/v3/projects/37e686c883dc4b19bd52b4543bcb33e2 => generated 302 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:24:38.442881 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ef83e2-128f-451f-870a-8a4f963a5cf3 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:38.456736 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729661e9-5514-48a7-8260-e0fde01a9987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:38.457600 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729661e9-5514-48a7-8260-e0fde01a9987 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:38.457883 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729661e9-5514-48a7-8260-e0fde01a9987 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:38.458164 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729661e9-5514-48a7-8260-e0fde01a9987 None admin] PATH_INFO: `/v3/projects/fc045bacae334916a4c6d8daadbcb707` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:38.459372 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729661e9-5514-48a7-8260-e0fde01a9987 None admin] RBAC: Authorizing `identity:get_project(project_id=fc045bacae334916a4c6d8daadbcb707)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:38.461301 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729661e9-5514-48a7-8260-e0fde01a9987 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:38.463013 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 220/450] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jul 14 09:24:38 2022] GET /identity/v3/projects/fc045bacae334916a4c6d8daadbcb707 => generated 344 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:24:38.463762 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729661e9-5514-48a7-8260-e0fde01a9987 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:38.480498 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:38.515391 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:38.551809 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ef83e2-128f-451f-870a-8a4f963a5cf3 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:38.567974 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729661e9-5514-48a7-8260-e0fde01a9987 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:38.586723 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9245c70c-814f-4a06-9924-e13fe82b1280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:38.587379 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9245c70c-814f-4a06-9924-e13fe82b1280 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:38.587665 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9245c70c-814f-4a06-9924-e13fe82b1280 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:38.587944 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9245c70c-814f-4a06-9924-e13fe82b1280 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:38.588773 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9245c70c-814f-4a06-9924-e13fe82b1280 None admin] RBAC: Adding query filter params (group.id=1356126a7cff439c889af1c50c4d89b3, role.id=17dfac38a2e540fea229af7de99911bb, scope.project.id=37e686c883dc4b19bd52b4543bcb33e2) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:24:38.589096 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9245c70c-814f-4a06-9924-e13fe82b1280 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:38.590538 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9245c70c-814f-4a06-9924-e13fe82b1280 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:38.596413 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 231/451] 10.222.0.40 () {56 vars in 1376 bytes} [Thu Jul 14 09:24:38 2022] GET /identity/v3/role_assignments?group.id=1356126a7cff439c889af1c50c4d89b3&scope.project.id=37e686c883dc4b19bd52b4543bcb33e2&role.id=17dfac38a2e540fea229af7de99911bb => generated 611 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:24:38.597192 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9245c70c-814f-4a06-9924-e13fe82b1280 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:38.604226 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638eaa55-2337-473e-bfd8-bf396cca35f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:38.605111 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638eaa55-2337-473e-bfd8-bf396cca35f6 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:38.605394 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638eaa55-2337-473e-bfd8-bf396cca35f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:38.605669 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638eaa55-2337-473e-bfd8-bf396cca35f6 None admin] PATH_INFO: `/v3/groups/1356126a7cff439c889af1c50c4d89b3` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:38.607504 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638eaa55-2337-473e-bfd8-bf396cca35f6 None admin] RBAC: Authorizing `identity:get_group(group_id=1356126a7cff439c889af1c50c4d89b3)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:38.609270 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638eaa55-2337-473e-bfd8-bf396cca35f6 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:38.611177 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 221/452] 10.222.0.40 () {56 vars in 1180 bytes} [Thu Jul 14 09:24:38 2022] GET /identity/v3/groups/1356126a7cff439c889af1c50c4d89b3 => generated 226 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:24:38.617193 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638eaa55-2337-473e-bfd8-bf396cca35f6 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:38.714907 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:38.719838 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9245c70c-814f-4a06-9924-e13fe82b1280 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:38.738405 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638eaa55-2337-473e-bfd8-bf396cca35f6 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:38.757211 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:38.773113 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4134c2-e65a-46d7-a68d-0c30a14c0b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:38.774408 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4134c2-e65a-46d7-a68d-0c30a14c0b14 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:38.774650 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4134c2-e65a-46d7-a68d-0c30a14c0b14 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:38.774929 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4134c2-e65a-46d7-a68d-0c30a14c0b14 None admin] PATH_INFO: `/v3/groups/7bb579e6b4ed4ca7bbd1fcbefd8dab5d` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:38.776140 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4134c2-e65a-46d7-a68d-0c30a14c0b14 None admin] RBAC: Authorizing `identity:get_group(group_id=7bb579e6b4ed4ca7bbd1fcbefd8dab5d)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:38.777585 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4134c2-e65a-46d7-a68d-0c30a14c0b14 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:38.779410 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 232/453] 10.222.0.40 () {56 vars in 1180 bytes} [Thu Jul 14 09:24:38 2022] GET /identity/v3/groups/7bb579e6b4ed4ca7bbd1fcbefd8dab5d => generated 229 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:24:38.779602 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9a2539-db0f-4382-8823-68e833a3d9e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:38.781828 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9a2539-db0f-4382-8823-68e833a3d9e8 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:38.781828 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9a2539-db0f-4382-8823-68e833a3d9e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:38.781828 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9a2539-db0f-4382-8823-68e833a3d9e8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:38.781828 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9a2539-db0f-4382-8823-68e833a3d9e8 None admin] RBAC: Adding query filter params (group.id=1356126a7cff439c889af1c50c4d89b3, role.id=f755c764373f47bababa1e942a53c2e1, scope.project.id=37e686c883dc4b19bd52b4543bcb33e2) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:24:38.782117 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9a2539-db0f-4382-8823-68e833a3d9e8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:38.783724 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9a2539-db0f-4382-8823-68e833a3d9e8 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:38.785185 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4134c2-e65a-46d7-a68d-0c30a14c0b14 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:38.791914 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 222/454] 10.222.0.40 () {56 vars in 1376 bytes} [Thu Jul 14 09:24:38 2022] GET /identity/v3/role_assignments?group.id=1356126a7cff439c889af1c50c4d89b3&scope.project.id=37e686c883dc4b19bd52b4543bcb33e2&role.id=f755c764373f47bababa1e942a53c2e1 => generated 611 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:24:38.909663 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4134c2-e65a-46d7-a68d-0c30a14c0b14 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:38.950010 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057286fe-e463-407c-98e5-bd11a2c5dede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:38.950762 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057286fe-e463-407c-98e5-bd11a2c5dede None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:38.951051 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057286fe-e463-407c-98e5-bd11a2c5dede None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:38.951382 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057286fe-e463-407c-98e5-bd11a2c5dede None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:38.952236 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057286fe-e463-407c-98e5-bd11a2c5dede None admin] RBAC: Adding query filter params (group.id=7bb579e6b4ed4ca7bbd1fcbefd8dab5d, role.id=e3965bd0d5f1427a86a313c0c90bfef3, scope.project.id=fc045bacae334916a4c6d8daadbcb707) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:24:38.952551 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057286fe-e463-407c-98e5-bd11a2c5dede None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:38.954012 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057286fe-e463-407c-98e5-bd11a2c5dede None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:38.961866 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 233/455] 10.222.0.40 () {56 vars in 1376 bytes} [Thu Jul 14 09:24:38 2022] GET /identity/v3/role_assignments?group.id=7bb579e6b4ed4ca7bbd1fcbefd8dab5d&scope.project.id=fc045bacae334916a4c6d8daadbcb707&role.id=e3965bd0d5f1427a86a313c0c90bfef3 => generated 611 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:24:41.380443 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac1286f-7528-4ef0-b73e-b2193ea49549 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:41.380955 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac1286f-7528-4ef0-b73e-b2193ea49549 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:41.381069 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac1286f-7528-4ef0-b73e-b2193ea49549 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:41.383148 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 223/456] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:24:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:24:41.388864 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6e38cb-2f28-4ce1-8c3b-3ddfd0388a0c None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:41.389770 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6e38cb-2f28-4ce1-8c3b-3ddfd0388a0c None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:41.390282 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6e38cb-2f28-4ce1-8c3b-3ddfd0388a0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:41.415213 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-9e6e38cb-2f28-4ce1-8c3b-3ddfd0388a0c None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:24:41.416752 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-9e6e38cb-2f28-4ce1-8c3b-3ddfd0388a0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:24:41.454020 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:41.512402 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 234/457] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:24:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 09:24:41.553884 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac1286f-7528-4ef0-b73e-b2193ea49549 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:41.688996 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64e8bd5-de31-497b-a2a1-d99d61a6479a None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:41.689303 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac1286f-7528-4ef0-b73e-b2193ea49549 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:41.689682 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64e8bd5-de31-497b-a2a1-d99d61a6479a None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:41.690092 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64e8bd5-de31-497b-a2a1-d99d61a6479a None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:41.691728 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 235/458] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:24:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:24:41.697248 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba04160-a323-4593-a3dc-f1206fcf9574 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:41.697809 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba04160-a323-4593-a3dc-f1206fcf9574 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:41.698318 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba04160-a323-4593-a3dc-f1206fcf9574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:41.731709 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-2ba04160-a323-4593-a3dc-f1206fcf9574 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:24:41.732920 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-2ba04160-a323-4593-a3dc-f1206fcf9574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:24:41.759902 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5899e2f9-a657-4212-b829-21051415c74d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:41.760709 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5899e2f9-a657-4212-b829-21051415c74d None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:41.760991 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5899e2f9-a657-4212-b829-21051415c74d None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:41.761265 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5899e2f9-a657-4212-b829-21051415c74d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:41.783070 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5899e2f9-a657-4212-b829-21051415c74d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:41.784540 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5899e2f9-a657-4212-b829-21051415c74d None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:41.822403 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-5899e2f9-a657-4212-b829-21051415c74d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:24:41.822403 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:24:41.822403 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:24:41.822403 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:24:41.822403 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:24:41.822403 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:24:41.822403 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:24:41.822403 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:24:41.822403 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:24:41.822403 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:24:41.822403 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:24:41.822403 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:24:41.822403 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 09:24:41.822403 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 09:24:41.822403 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 09:24:41.823312 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 09:24:41.823312 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:24:41.823312 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:24:41.823312 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:24:41.823312 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:24:41.823312 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:24:41.823312 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:24:41.823312 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:24:41.823312 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( Jul 14 09:24:41.823312 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:24:41.823312 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:24:41.823312 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:24:41.823312 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:24:41.823312 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:24:41.823312 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:24:41.823312 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:24:41.823312 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:24:41.824169 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 09:24:41.824169 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 09:24:41.824169 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:24:41.824169 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:24:41.824169 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 224/459] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 09:24:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:24:41.830637 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5899e2f9-a657-4212-b829-21051415c74d None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:41.876488 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 236/460] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:24:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 09:24:41.886612 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:41.936442 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba04160-a323-4593-a3dc-f1206fcf9574 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:41.988439 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5899e2f9-a657-4212-b829-21051415c74d None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:42.036028 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543ebc08-ced3-4931-b039-b8d790cc91fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:42.036710 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543ebc08-ced3-4931-b039-b8d790cc91fb None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:42.037053 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543ebc08-ced3-4931-b039-b8d790cc91fb None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:42.037337 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543ebc08-ced3-4931-b039-b8d790cc91fb None admin] PATH_INFO: `/v3/domains` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:42.038677 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543ebc08-ced3-4931-b039-b8d790cc91fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:24:42.039532 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543ebc08-ced3-4931-b039-b8d790cc91fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:42.041223 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543ebc08-ced3-4931-b039-b8d790cc91fb None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:42.042471 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:42.053064 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba04160-a323-4593-a3dc-f1206fcf9574 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:42.068643 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 225/461] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 14 09:24:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:24:42.068643 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6e9ed0-810b-4aee-b184-eb53c4f447ec None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:42.068643 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6e9ed0-810b-4aee-b184-eb53c4f447ec None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:42.068643 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6e9ed0-810b-4aee-b184-eb53c4f447ec None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:42.070319 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 226/462] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:24:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:24:42.071276 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6e9ed0-810b-4aee-b184-eb53c4f447ec None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:42.104704 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1c7a6d-266e-4ea5-919a-b8be764a8e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:42.105823 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1c7a6d-266e-4ea5-919a-b8be764a8e02 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:42.106123 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1c7a6d-266e-4ea5-919a-b8be764a8e02 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:42.106437 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1c7a6d-266e-4ea5-919a-b8be764a8e02 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:42.118841 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1c7a6d-266e-4ea5-919a-b8be764a8e02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:42.120681 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1c7a6d-266e-4ea5-919a-b8be764a8e02 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:42.143327 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-9f1c7a6d-266e-4ea5-919a-b8be764a8e02 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:24:42.143327 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:24:42.143327 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:24:42.143327 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:24:42.143327 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:24:42.143327 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:24:42.143327 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:24:42.143327 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:24:42.143327 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:24:42.143327 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:24:42.143327 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:24:42.143327 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:24:42.143327 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 09:24:42.143327 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 09:24:42.143327 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 09:24:42.144218 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 09:24:42.144218 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:24:42.144218 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:24:42.144218 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:24:42.144218 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:24:42.144218 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:24:42.144218 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:24:42.144218 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:24:42.144218 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( Jul 14 09:24:42.144218 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:24:42.144218 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:24:42.144218 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:24:42.144218 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:24:42.144218 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:24:42.144218 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:24:42.144218 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:24:42.144218 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:24:42.145047 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 09:24:42.145047 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 09:24:42.145047 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:24:42.145047 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Jul 14 09:24:42.152300 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 237/463] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 09:24:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 09:24:42.153819 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba45f64d-27d9-4578-94a9-7f94ec70071f None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:42.154465 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba45f64d-27d9-4578-94a9-7f94ec70071f None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:42.154966 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba45f64d-27d9-4578-94a9-7f94ec70071f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:42.173921 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-ba45f64d-27d9-4578-94a9-7f94ec70071f None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:24:42.175485 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-ba45f64d-27d9-4578-94a9-7f94ec70071f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:24:42.242999 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:42.254102 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 238/464] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:24:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 09:24:42.255191 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba45f64d-27d9-4578-94a9-7f94ec70071f None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:42.262726 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6e9ed0-810b-4aee-b184-eb53c4f447ec None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:42.339727 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2b2097-71af-4f53-95ad-acb9e39300db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:42.340871 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2b2097-71af-4f53-95ad-acb9e39300db None admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:42.341360 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2b2097-71af-4f53-95ad-acb9e39300db None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:42.341855 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2b2097-71af-4f53-95ad-acb9e39300db None admin] PATH_INFO: `/v3/users` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:42.343188 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2b2097-71af-4f53-95ad-acb9e39300db None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:42.345960 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2b2097-71af-4f53-95ad-acb9e39300db None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:42.384529 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 227/465] 10.222.0.40 () {60 vars in 1132 bytes} [Thu Jul 14 09:24:42 2022] POST /identity/v3/users => generated 246 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:24:42.384529 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2b2097-71af-4f53-95ad-acb9e39300db None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:42.402125 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:42.444316 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba45f64d-27d9-4578-94a9-7f94ec70071f None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:42.493418 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f12dad-d68f-42e7-ab5f-ebd0e87c35de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:42.494026 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f12dad-d68f-42e7-ab5f-ebd0e87c35de None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:42.494345 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f12dad-d68f-42e7-ab5f-ebd0e87c35de None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:42.494630 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f12dad-d68f-42e7-ab5f-ebd0e87c35de None admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:42.495664 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f12dad-d68f-42e7-ab5f-ebd0e87c35de None admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:24:42.495976 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f12dad-d68f-42e7-ab5f-ebd0e87c35de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:42.497658 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f12dad-d68f-42e7-ab5f-ebd0e87c35de None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:42.513921 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 239/466] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 14 09:24:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:24:42.515493 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9906bc9d-dd86-4ef2-b547-9cf75ae439cf None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:42.515793 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9906bc9d-dd86-4ef2-b547-9cf75ae439cf None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:42.516072 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9906bc9d-dd86-4ef2-b547-9cf75ae439cf None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:42.517754 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 240/467] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:24:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:24:42.521264 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9906bc9d-dd86-4ef2-b547-9cf75ae439cf None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:42.591305 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2b2097-71af-4f53-95ad-acb9e39300db None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:42.640987 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9418cf35-1421-4500-864a-a63e61bc09ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:42.642257 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9418cf35-1421-4500-864a-a63e61bc09ed None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:42.642742 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9418cf35-1421-4500-864a-a63e61bc09ed None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:42.643212 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9418cf35-1421-4500-864a-a63e61bc09ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:42.657702 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9418cf35-1421-4500-864a-a63e61bc09ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:42.659216 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9418cf35-1421-4500-864a-a63e61bc09ed None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:42.669296 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:42.682993 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-9418cf35-1421-4500-864a-a63e61bc09ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:24:42.682993 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:24:42.682993 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:24:42.682993 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:24:42.682993 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:24:42.682993 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:24:42.682993 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:24:42.682993 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:24:42.682993 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:24:42.682993 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:24:42.682993 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:24:42.682993 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:24:42.682993 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 09:24:42.682993 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 09:24:42.682993 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 09:24:42.683923 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 09:24:42.683923 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:24:42.683923 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:24:42.683923 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:24:42.683923 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:24:42.683923 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:24:42.683923 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:24:42.683923 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:24:42.683923 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( Jul 14 09:24:42.683923 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:24:42.683923 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:24:42.683923 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:24:42.683923 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:24:42.683923 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:24:42.683923 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:24:42.683923 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:24:42.683923 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:24:42.684741 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 09:24:42.684741 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 09:24:42.684741 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:24:42.684741 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:24:42.685357 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 228/468] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 09:24:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:24:42.686535 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40648e16-9e6c-477b-aa49-ad096dabd8a4 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:42.687177 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40648e16-9e6c-477b-aa49-ad096dabd8a4 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:42.687177 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40648e16-9e6c-477b-aa49-ad096dabd8a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:42.691854 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9906bc9d-dd86-4ef2-b547-9cf75ae439cf None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:42.708401 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-40648e16-9e6c-477b-aa49-ad096dabd8a4 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:24:42.709866 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-40648e16-9e6c-477b-aa49-ad096dabd8a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:24:42.734602 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:42.739136 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56194265-b002-468b-8fd3-51ac58e16286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:42.739970 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56194265-b002-468b-8fd3-51ac58e16286 None admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:42.740313 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56194265-b002-468b-8fd3-51ac58e16286 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:42.740597 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56194265-b002-468b-8fd3-51ac58e16286 None admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:42.741605 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56194265-b002-468b-8fd3-51ac58e16286 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:42.744221 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56194265-b002-468b-8fd3-51ac58e16286 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:42.776007 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 241/469] 10.222.0.40 () {60 vars in 1132 bytes} [Thu Jul 14 09:24:42 2022] POST /identity/v3/users => generated 248 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 09:24:42.777239 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56194265-b002-468b-8fd3-51ac58e16286 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:42.793250 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 229/470] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:24:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 09:24:42.830818 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40648e16-9e6c-477b-aa49-ad096dabd8a4 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:42.906712 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56194265-b002-468b-8fd3-51ac58e16286 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:42.948384 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f449d19d-4516-463a-b748-85b02ed4dd24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:42.949297 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f449d19d-4516-463a-b748-85b02ed4dd24 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:42.949588 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f449d19d-4516-463a-b748-85b02ed4dd24 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:42.950277 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f449d19d-4516-463a-b748-85b02ed4dd24 None admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:42.951042 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f449d19d-4516-463a-b748-85b02ed4dd24 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:24:42.951355 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f449d19d-4516-463a-b748-85b02ed4dd24 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:42.952851 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f449d19d-4516-463a-b748-85b02ed4dd24 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:42.973023 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 242/471] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 14 09:24:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:24:42.974650 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f449d19d-4516-463a-b748-85b02ed4dd24 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:43.035248 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:43.052550 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40648e16-9e6c-477b-aa49-ad096dabd8a4 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:43.090794 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:43.100098 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca721ae0-3786-441d-b0b3-f18050e292b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:43.100985 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca721ae0-3786-441d-b0b3-f18050e292b8 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:43.101303 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca721ae0-3786-441d-b0b3-f18050e292b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:43.101581 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca721ae0-3786-441d-b0b3-f18050e292b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:43.108949 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f449d19d-4516-463a-b748-85b02ed4dd24 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:43.120822 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca721ae0-3786-441d-b0b3-f18050e292b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:43.122365 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca721ae0-3786-441d-b0b3-f18050e292b8 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:43.143822 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-ca721ae0-3786-441d-b0b3-f18050e292b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:24:43.143822 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:24:43.143822 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:24:43.143822 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:24:43.143822 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:24:43.143822 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:24:43.143822 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:24:43.143822 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:24:43.143822 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:24:43.143822 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:24:43.143822 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:24:43.143822 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:24:43.143822 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 09:24:43.143822 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 09:24:43.143822 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 09:24:43.144745 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 09:24:43.144745 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:24:43.144745 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:24:43.144745 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:24:43.144745 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:24:43.144745 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:24:43.144745 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:24:43.144745 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:24:43.144745 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( Jul 14 09:24:43.144745 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:24:43.144745 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:24:43.144745 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:24:43.144745 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:24:43.144745 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:24:43.144745 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:24:43.144745 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:24:43.144745 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:24:43.145584 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 09:24:43.145584 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 09:24:43.145584 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:24:43.145584 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:24:43.145584 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 230/472] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 09:24:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:24:43.151257 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa527ae-2087-405d-b177-7fafbb788b56 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:43.151829 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa527ae-2087-405d-b177-7fafbb788b56 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:43.152288 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa527ae-2087-405d-b177-7fafbb788b56 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:43.154182 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 231/473] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:24:43 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:24:43.154647 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b57de77-df0b-4e4c-81e2-1ab036f6b69b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:43.155546 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa527ae-2087-405d-b177-7fafbb788b56 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:43.155806 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b57de77-df0b-4e4c-81e2-1ab036f6b69b None admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:43.156102 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b57de77-df0b-4e4c-81e2-1ab036f6b69b None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:43.156390 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b57de77-df0b-4e4c-81e2-1ab036f6b69b None admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:43.159551 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b57de77-df0b-4e4c-81e2-1ab036f6b69b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:43.159551 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b57de77-df0b-4e4c-81e2-1ab036f6b69b None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:43.186473 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 243/474] 10.222.0.40 () {60 vars in 1132 bytes} [Thu Jul 14 09:24:42 2022] POST /identity/v3/users => generated 248 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 09:24:43.193167 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9fb490-1fce-4f16-a561-daac8c08acd6 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:43.193513 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9fb490-1fce-4f16-a561-daac8c08acd6 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:43.194048 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9fb490-1fce-4f16-a561-daac8c08acd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:43.233367 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-cf9fb490-1fce-4f16-a561-daac8c08acd6 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:24:43.234770 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-cf9fb490-1fce-4f16-a561-daac8c08acd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:24:43.385208 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa527ae-2087-405d-b177-7fafbb788b56 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:43.388308 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 244/475] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:24:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 09:24:43.414759 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9fb490-1fce-4f16-a561-daac8c08acd6 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:43.431280 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf121d14-0584-4c73-b64a-b94e043f4fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:43.431959 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf121d14-0584-4c73-b64a-b94e043f4fc3 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:43.432246 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf121d14-0584-4c73-b64a-b94e043f4fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:43.432577 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf121d14-0584-4c73-b64a-b94e043f4fc3 None admin] PATH_INFO: `/v3/domains` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:43.433327 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf121d14-0584-4c73-b64a-b94e043f4fc3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:24:43.433637 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf121d14-0584-4c73-b64a-b94e043f4fc3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:43.435068 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf121d14-0584-4c73-b64a-b94e043f4fc3 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:43.447852 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 232/476] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 14 09:24:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:24:43.452297 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:43.455860 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf121d14-0584-4c73-b64a-b94e043f4fc3 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:43.519058 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:43.556610 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9fb490-1fce-4f16-a561-daac8c08acd6 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:43.605331 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf121d14-0584-4c73-b64a-b94e043f4fc3 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:43.605664 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05f9c29-c0cf-4f55-b30a-71d9b015c61e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:43.606603 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05f9c29-c0cf-4f55-b30a-71d9b015c61e None admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:43.607124 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05f9c29-c0cf-4f55-b30a-71d9b015c61e None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:43.607590 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05f9c29-c0cf-4f55-b30a-71d9b015c61e None admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:43.608534 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05f9c29-c0cf-4f55-b30a-71d9b015c61e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:43.610109 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05f9c29-c0cf-4f55-b30a-71d9b015c61e None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:43.620636 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.sql.core [None req-d05f9c29-c0cf-4f55-b30a-71d9b015c61e None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 14 09:24:43.620636 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 14 09:24:43.620636 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [parameters: {'id': '0944ba7a17c942c4a06d1d7261d977db', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 14 09:24:43.620636 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80198) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 14 09:24:43.642180 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-d05f9c29-c0cf-4f55-b30a-71d9b015c61e None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 14 09:24:43.642180 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:24:43.642180 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 14 09:24:43.642180 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 14 09:24:43.642180 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 14 09:24:43.642180 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 14 09:24:43.642180 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 14 09:24:43.642180 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application result = self._query(query) Jul 14 09:24:43.642180 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 14 09:24:43.642180 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application conn.query(q) Jul 14 09:24:43.642180 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 14 09:24:43.642180 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 14 09:24:43.642180 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 14 09:24:43.642180 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application result.read() Jul 14 09:24:43.642180 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 14 09:24:43.643126 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 14 09:24:43.643126 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 14 09:24:43.643126 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 14 09:24:43.643126 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 14 09:24:43.643126 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 14 09:24:43.643126 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 14 09:24:43.643126 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 14 09:24:43.643126 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 14 09:24:43.643126 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Jul 14 09:24:43.643126 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 14 09:24:43.643126 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Jul 14 09:24:43.643126 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:24:43.643126 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 14 09:24:43.643126 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 14 09:24:43.643126 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 14 09:24:43.643126 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return ref.to_dict() Jul 14 09:24:43.643126 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 14 09:24:43.643126 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application next(self.gen) Jul 14 09:24:43.644006 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 14 09:24:43.644006 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application yield resource Jul 14 09:24:43.644006 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 14 09:24:43.644006 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application next(self.gen) Jul 14 09:24:43.644006 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 14 09:24:43.644006 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application self.session.rollback() Jul 14 09:24:43.644006 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 14 09:24:43.644006 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application self.force_reraise() Jul 14 09:24:43.644006 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 14 09:24:43.644006 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise self.value Jul 14 09:24:43.644006 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 14 09:24:43.644006 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 14 09:24:43.644006 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 14 09:24:43.644006 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application session.commit() Jul 14 09:24:43.644006 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 14 09:24:43.644006 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 14 09:24:43.644006 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 14 09:24:43.644916 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application self._prepare_impl() Jul 14 09:24:43.644916 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 14 09:24:43.644916 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application self.session.flush() Jul 14 09:24:43.644916 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 14 09:24:43.644916 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application self._flush(objects) Jul 14 09:24:43.644916 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 14 09:24:43.644916 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 14 09:24:43.644916 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 14 09:24:43.644916 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application compat.raise_( Jul 14 09:24:43.644916 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 14 09:24:43.644916 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception Jul 14 09:24:43.644916 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 14 09:24:43.644916 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application flush_context.execute() Jul 14 09:24:43.644916 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 14 09:24:43.644916 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application rec.execute(self) Jul 14 09:24:43.644916 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 14 09:24:43.644916 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 14 09:24:43.646672 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 14 09:24:43.646672 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 14 09:24:43.646672 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 14 09:24:43.646672 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 14 09:24:43.646672 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 14 09:24:43.646672 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 14 09:24:43.646672 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 14 09:24:43.646672 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 14 09:24:43.646672 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 14 09:24:43.646672 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 14 09:24:43.646672 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 14 09:24:43.646672 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 14 09:24:43.646672 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 14 09:24:43.646672 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 14 09:24:43.646672 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 14 09:24:43.646672 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception Jul 14 09:24:43.649215 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 14 09:24:43.649215 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 14 09:24:43.649215 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 14 09:24:43.649215 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 14 09:24:43.649215 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 14 09:24:43.649215 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application result = self._query(query) Jul 14 09:24:43.649215 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 14 09:24:43.649215 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application conn.query(q) Jul 14 09:24:43.649215 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 14 09:24:43.649215 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 14 09:24:43.649215 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 14 09:24:43.649215 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application result.read() Jul 14 09:24:43.649215 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 14 09:24:43.649215 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 14 09:24:43.649215 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 14 09:24:43.649215 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 14 09:24:43.651507 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 14 09:24:43.651507 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 14 09:24:43.651507 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 14 09:24:43.651507 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 14 09:24:43.651507 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 14 09:24:43.651507 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 14 09:24:43.651507 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application [parameters: {'id': '0944ba7a17c942c4a06d1d7261d977db', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 14 09:24:43.651507 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 14 09:24:43.651507 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Jul 14 09:24:43.651507 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 09:24:43.651507 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Jul 14 09:24:43.651507 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:24:43.651507 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:24:43.651507 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:24:43.651507 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:24:43.651507 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:24:43.653186 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:24:43.653186 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:24:43.653186 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:24:43.653186 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:24:43.653186 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:24:43.653186 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:24:43.653186 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 14 09:24:43.653186 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 14 09:24:43.653186 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:24:43.653186 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:24:43.653186 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 14 09:24:43.653186 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 14 09:24:43.653186 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 14 09:24:43.653186 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 14 09:24:43.653186 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 14 09:24:43.653186 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Jul 14 09:24:43.656433 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf71a80d-f358-48ed-be51-98f96a60ef9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:43.656433 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf71a80d-f358-48ed-be51-98f96a60ef9f None admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:43.656433 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf71a80d-f358-48ed-be51-98f96a60ef9f None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:43.656433 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf71a80d-f358-48ed-be51-98f96a60ef9f None admin] PATH_INFO: `/v3/users` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:43.656911 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf71a80d-f358-48ed-be51-98f96a60ef9f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:43.656911 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf71a80d-f358-48ed-be51-98f96a60ef9f None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:43.657148 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 245/477] 10.222.0.40 () {60 vars in 1131 bytes} [Thu Jul 14 09:24:43 2022] POST /identity/v3/roles => generated 144 bytes in 241 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:24:43.666355 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05f9c29-c0cf-4f55-b30a-71d9b015c61e None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:43.690492 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 233/478] 10.222.0.40 () {60 vars in 1132 bytes} [Thu Jul 14 09:24:43 2022] POST /identity/v3/users => generated 249 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:24:43.821554 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:43.831298 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05f9c29-c0cf-4f55-b30a-71d9b015c61e None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:43.895179 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd471ec3-fde2-40a5-b9a2-5490e39fd8a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:43.895948 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd471ec3-fde2-40a5-b9a2-5490e39fd8a0 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:43.896238 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd471ec3-fde2-40a5-b9a2-5490e39fd8a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:43.896522 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd471ec3-fde2-40a5-b9a2-5490e39fd8a0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:43.918925 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd471ec3-fde2-40a5-b9a2-5490e39fd8a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:24:43.927323 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-bd471ec3-fde2-40a5-b9a2-5490e39fd8a0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 09:24:43.927323 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:24:43.927323 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:24:43.927323 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:24:43.927323 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:24:43.927323 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:24:43.927323 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:24:43.927323 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:24:43.927323 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:24:43.927323 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:24:43.927323 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:24:43.927323 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:24:43.927323 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:24:43.927323 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:24:43.927323 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:24:43.927323 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:24:43.928284 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:24:43.928284 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:24:43.928284 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:24:43.928284 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:24:43.928284 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:24:43.928284 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:24:43.928284 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:24:43.928284 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:24:43.928284 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:24:43.928284 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:24:43.928284 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:24:43.928284 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( Jul 14 09:24:43.928284 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:24:43.928284 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:24:43.928284 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:24:43.928284 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:24:43.929300 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:24:43.929300 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:24:43.929300 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:24:43.929300 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:24:43.929300 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:24:43.929300 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:24:43.929300 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:24:43.929300 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:24:43.929300 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:24:43.929300 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:24:43.929300 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 09:24:43.929300 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Jul 14 09:24:43.933070 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 246/479] 10.222.0.40 () {56 vars in 1114 bytes} [Thu Jul 14 09:24:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:24:43.934434 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf71a80d-f358-48ed-be51-98f96a60ef9f None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:44.099194 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:44.106508 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf71a80d-f358-48ed-be51-98f96a60ef9f None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:44.150619 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73347d2-1ce5-4e60-a2be-ade6b4dddf96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:44.151241 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73347d2-1ce5-4e60-a2be-ade6b4dddf96 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:44.151508 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73347d2-1ce5-4e60-a2be-ade6b4dddf96 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:44.151788 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73347d2-1ce5-4e60-a2be-ade6b4dddf96 None admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:44.152556 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73347d2-1ce5-4e60-a2be-ade6b4dddf96 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:24:44.152867 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73347d2-1ce5-4e60-a2be-ade6b4dddf96 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:44.154381 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73347d2-1ce5-4e60-a2be-ade6b4dddf96 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:44.165373 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 234/480] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jul 14 09:24:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:24:44.732000 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2bb2b4-1603-471d-a467-ded74a7d9789 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:44.732701 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2bb2b4-1603-471d-a467-ded74a7d9789 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:44.732701 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2bb2b4-1603-471d-a467-ded74a7d9789 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:44.734380 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 247/481] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:24:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:24:44.739708 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6563bfbd-5302-453e-b831-e7f9960e6eb1 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:44.740250 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6563bfbd-5302-453e-b831-e7f9960e6eb1 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:44.740250 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6563bfbd-5302-453e-b831-e7f9960e6eb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:44.762716 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-6563bfbd-5302-453e-b831-e7f9960e6eb1 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:24:44.763963 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-6563bfbd-5302-453e-b831-e7f9960e6eb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:24:44.859587 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 235/482] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:24:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 09:24:44.895243 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2bb2b4-1603-471d-a467-ded74a7d9789 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:45.079228 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2bb2b4-1603-471d-a467-ded74a7d9789 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:45.146951 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be73773a-e199-4dd1-accc-9b8d87fd2582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:45.148712 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be73773a-e199-4dd1-accc-9b8d87fd2582 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:45.149181 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be73773a-e199-4dd1-accc-9b8d87fd2582 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:45.149652 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be73773a-e199-4dd1-accc-9b8d87fd2582 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:45.171345 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be73773a-e199-4dd1-accc-9b8d87fd2582 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:24:45.184023 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-be73773a-e199-4dd1-accc-9b8d87fd2582 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 09:24:45.184023 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:24:45.184023 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:24:45.184023 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:24:45.184023 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:24:45.184023 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:24:45.184023 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:24:45.184023 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:24:45.184023 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:24:45.184023 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:24:45.184023 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:24:45.184023 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:24:45.184023 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:24:45.184023 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:24:45.184023 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:24:45.184023 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:24:45.184905 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:24:45.184905 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:24:45.184905 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:24:45.184905 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:24:45.184905 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:24:45.184905 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:24:45.184905 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:24:45.184905 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:24:45.184905 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:24:45.184905 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:24:45.184905 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:24:45.184905 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( Jul 14 09:24:45.184905 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:24:45.184905 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:24:45.184905 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:24:45.184905 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:24:45.185687 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:24:45.185687 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:24:45.185687 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:24:45.185687 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:24:45.185687 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:24:45.185687 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:24:45.185687 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:24:45.185687 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:24:45.185687 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:24:45.185687 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:24:45.185687 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 09:24:45.185687 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Jul 14 09:24:45.185687 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 248/483] 10.222.0.40 () {56 vars in 1102 bytes} [Thu Jul 14 09:24:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:24:45.193226 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6563bfbd-5302-453e-b831-e7f9960e6eb1 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:45.324863 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3765cfe1-304d-4a3f-bd8b-69a4f9a390f8 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:45.325208 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3765cfe1-304d-4a3f-bd8b-69a4f9a390f8 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:45.325425 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3765cfe1-304d-4a3f-bd8b-69a4f9a390f8 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:45.327065 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 249/484] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:24:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:24:45.332409 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99916c4-4888-4ceb-ade3-2865eebe286b None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:45.332702 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99916c4-4888-4ceb-ade3-2865eebe286b None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:45.332987 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99916c4-4888-4ceb-ade3-2865eebe286b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:45.333927 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:45.357732 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6563bfbd-5302-453e-b831-e7f9960e6eb1 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:45.375420 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-d99916c4-4888-4ceb-ade3-2865eebe286b None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:24:45.377054 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-d99916c4-4888-4ceb-ade3-2865eebe286b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:24:45.406533 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1c7c40-79c5-44b3-8a51-4107b04f4b18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:45.406976 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:45.407150 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1c7c40-79c5-44b3-8a51-4107b04f4b18 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:45.407424 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1c7c40-79c5-44b3-8a51-4107b04f4b18 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:45.407698 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1c7c40-79c5-44b3-8a51-4107b04f4b18 None admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:45.408478 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1c7c40-79c5-44b3-8a51-4107b04f4b18 None admin] RBAC: Adding query filter params (name=service) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:24:45.408791 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1c7c40-79c5-44b3-8a51-4107b04f4b18 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:45.410231 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1c7c40-79c5-44b3-8a51-4107b04f4b18 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:45.427969 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 236/485] 10.222.0.40 () {56 vars in 1103 bytes} [Thu Jul 14 09:24:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:24:45.439264 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1c7c40-79c5-44b3-8a51-4107b04f4b18 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:45.510705 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 250/486] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:24:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 09:24:45.546040 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99916c4-4888-4ceb-ade3-2865eebe286b None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:45.643837 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1c7c40-79c5-44b3-8a51-4107b04f4b18 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:45.730318 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63760798-529c-4328-bfaf-d3f9ede3121e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:45.731146 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63760798-529c-4328-bfaf-d3f9ede3121e None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:45.731653 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63760798-529c-4328-bfaf-d3f9ede3121e None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:45.731949 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63760798-529c-4328-bfaf-d3f9ede3121e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:45.748831 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63760798-529c-4328-bfaf-d3f9ede3121e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:45.750740 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63760798-529c-4328-bfaf-d3f9ede3121e None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:45.764725 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99916c4-4888-4ceb-ade3-2865eebe286b None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:45.772305 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-63760798-529c-4328-bfaf-d3f9ede3121e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:24:45.772305 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:24:45.772305 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:24:45.772305 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:24:45.772305 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:24:45.772305 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:24:45.772305 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:24:45.772305 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:24:45.772305 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:24:45.772305 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:24:45.772305 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:24:45.772305 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:24:45.772305 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 09:24:45.772305 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 09:24:45.772305 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 09:24:45.773994 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 09:24:45.773994 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:24:45.773994 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:24:45.773994 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:24:45.773994 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:24:45.773994 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:24:45.773994 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:24:45.773994 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:24:45.773994 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( Jul 14 09:24:45.773994 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:24:45.773994 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:24:45.773994 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:24:45.773994 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:24:45.773994 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:24:45.773994 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:24:45.773994 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:24:45.773994 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:24:45.774936 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 09:24:45.774936 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 09:24:45.774936 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:24:45.774936 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:24:45.774936 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 237/487] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 09:24:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:24:45.787493 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63760798-529c-4328-bfaf-d3f9ede3121e None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:45.799810 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:45.814666 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f64184-bc5b-42e3-b6d9-59f674f102f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:45.819209 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f64184-bc5b-42e3-b6d9-59f674f102f7 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:45.820337 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f64184-bc5b-42e3-b6d9-59f674f102f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:45.820819 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f64184-bc5b-42e3-b6d9-59f674f102f7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:45.847279 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f64184-bc5b-42e3-b6d9-59f674f102f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:24:45.856167 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-34f64184-bc5b-42e3-b6d9-59f674f102f7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 09:24:45.856167 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:24:45.856167 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:24:45.856167 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:24:45.856167 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:24:45.856167 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:24:45.856167 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:24:45.856167 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:24:45.856167 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:24:45.856167 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:24:45.856167 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:24:45.856167 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:24:45.856167 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:24:45.856167 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:24:45.856167 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:24:45.856167 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:24:45.857101 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:24:45.857101 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:24:45.857101 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:24:45.857101 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:24:45.857101 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:24:45.857101 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:24:45.857101 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:24:45.857101 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:24:45.857101 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:24:45.857101 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:24:45.857101 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:24:45.857101 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( Jul 14 09:24:45.857101 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:24:45.857101 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:24:45.857101 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:24:45.857101 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:24:45.858224 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:24:45.858224 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:24:45.858224 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:24:45.858224 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:24:45.858224 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:24:45.858224 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:24:45.858224 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:24:45.858224 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:24:45.858224 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:24:45.858224 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:24:45.858224 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 09:24:45.858224 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Jul 14 09:24:45.858224 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 251/488] 10.222.0.40 () {56 vars in 1102 bytes} [Thu Jul 14 09:24:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 09:24:45.864563 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f64184-bc5b-42e3-b6d9-59f674f102f7 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:45.882004 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:45.985541 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63760798-529c-4328-bfaf-d3f9ede3121e None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:46.030240 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83848b22-9ca0-4445-905d-e475acef6f0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:46.032355 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83848b22-9ca0-4445-905d-e475acef6f0f None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:46.032647 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83848b22-9ca0-4445-905d-e475acef6f0f None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:46.032926 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83848b22-9ca0-4445-905d-e475acef6f0f None admin] PATH_INFO: `/v3/domains` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:46.033683 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83848b22-9ca0-4445-905d-e475acef6f0f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:24:46.033993 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83848b22-9ca0-4445-905d-e475acef6f0f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:46.037451 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83848b22-9ca0-4445-905d-e475acef6f0f None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:46.054800 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 238/489] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 14 09:24:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:24:46.056246 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550ad9d2-88ca-46e1-9f04-6c98883d63a4 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:46.056549 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550ad9d2-88ca-46e1-9f04-6c98883d63a4 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:46.056825 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550ad9d2-88ca-46e1-9f04-6c98883d63a4 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:46.058510 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 239/490] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:24:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:24:46.060374 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550ad9d2-88ca-46e1-9f04-6c98883d63a4 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:46.068896 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f64184-bc5b-42e3-b6d9-59f674f102f7 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:46.112263 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7f042b-8983-4b36-9510-5d9a97cec879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:46.113152 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7f042b-8983-4b36-9510-5d9a97cec879 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:46.113559 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7f042b-8983-4b36-9510-5d9a97cec879 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:46.113959 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7f042b-8983-4b36-9510-5d9a97cec879 None admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:46.115578 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7f042b-8983-4b36-9510-5d9a97cec879 None admin] RBAC: Adding query filter params (name=service) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:24:46.115578 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7f042b-8983-4b36-9510-5d9a97cec879 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:46.117451 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7f042b-8983-4b36-9510-5d9a97cec879 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:46.127522 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 252/491] 10.222.0.40 () {56 vars in 1103 bytes} [Thu Jul 14 09:24:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:24:46.129165 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae89a76-3933-45aa-80fc-1041f9ddc08e None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:46.129563 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae89a76-3933-45aa-80fc-1041f9ddc08e None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:46.129973 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae89a76-3933-45aa-80fc-1041f9ddc08e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:46.149465 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:46.155400 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-4ae89a76-3933-45aa-80fc-1041f9ddc08e None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:24:46.157218 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-4ae89a76-3933-45aa-80fc-1041f9ddc08e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:24:46.220498 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550ad9d2-88ca-46e1-9f04-6c98883d63a4 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:46.247438 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:46.254728 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 253/492] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:24:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 09:24:46.255991 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae89a76-3933-45aa-80fc-1041f9ddc08e None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:46.327466 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0829cd98-bf99-473e-bced-55319c92cdcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:46.329032 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0829cd98-bf99-473e-bced-55319c92cdcf None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:46.330014 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0829cd98-bf99-473e-bced-55319c92cdcf None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:46.330237 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0829cd98-bf99-473e-bced-55319c92cdcf None admin] PATH_INFO: `/v3/users/nova` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:46.351492 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0829cd98-bf99-473e-bced-55319c92cdcf None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:46.354548 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0829cd98-bf99-473e-bced-55319c92cdcf None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:46.368255 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae89a76-3933-45aa-80fc-1041f9ddc08e None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:46.388835 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-0829cd98-bf99-473e-bced-55319c92cdcf None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 14 09:24:46.388835 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:24:46.388835 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:24:46.388835 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:24:46.388835 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:24:46.388835 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:24:46.388835 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:24:46.388835 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:24:46.388835 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:24:46.388835 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:24:46.388835 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:24:46.388835 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:24:46.388835 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 09:24:46.388835 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 09:24:46.388835 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 09:24:46.388835 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 09:24:46.389807 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:24:46.389807 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:24:46.389807 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 09:24:46.389807 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 09:24:46.389807 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 09:24:46.389807 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 09:24:46.389807 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:24:46.389807 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:24:46.389807 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:24:46.389807 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:24:46.389807 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:24:46.389807 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( Jul 14 09:24:46.389807 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:24:46.389807 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:24:46.389807 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:24:46.389807 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:24:46.389807 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:24:46.389807 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:24:46.390707 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:24:46.390707 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:24:46.390707 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 09:24:46.390707 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 09:24:46.390707 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 09:24:46.390707 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 09:24:46.390707 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 09:24:46.390707 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 09:24:46.390707 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 14 09:24:46.390707 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:24:46.392090 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 240/493] 10.222.0.40 () {56 vars in 1093 bytes} [Thu Jul 14 09:24:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:24:46.393028 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0829cd98-bf99-473e-bced-55319c92cdcf None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:46.410575 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078af333-d0db-4ddc-8704-91435a14f03a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:46.411890 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078af333-d0db-4ddc-8704-91435a14f03a None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:46.412375 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078af333-d0db-4ddc-8704-91435a14f03a None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:46.412875 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078af333-d0db-4ddc-8704-91435a14f03a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:46.424791 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078af333-d0db-4ddc-8704-91435a14f03a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:46.426610 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078af333-d0db-4ddc-8704-91435a14f03a None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:46.446579 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-078af333-d0db-4ddc-8704-91435a14f03a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:24:46.446579 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:24:46.446579 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:24:46.446579 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:24:46.446579 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:24:46.446579 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:24:46.446579 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:24:46.446579 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:24:46.446579 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:24:46.446579 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:24:46.446579 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:24:46.446579 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:24:46.446579 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 09:24:46.446579 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 09:24:46.446579 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 09:24:46.447482 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 09:24:46.447482 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:24:46.447482 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:24:46.447482 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:24:46.447482 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:24:46.447482 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:24:46.447482 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:24:46.447482 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:24:46.447482 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( Jul 14 09:24:46.447482 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:24:46.447482 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:24:46.447482 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:24:46.447482 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:24:46.447482 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:24:46.447482 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:24:46.447482 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:24:46.447482 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:24:46.448314 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 09:24:46.448314 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 09:24:46.448314 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:24:46.448314 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Jul 14 09:24:46.450399 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 254/494] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 09:24:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:24:46.451584 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078af333-d0db-4ddc-8704-91435a14f03a None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:46.511322 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:46.564415 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078af333-d0db-4ddc-8704-91435a14f03a None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:46.591267 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0829cd98-bf99-473e-bced-55319c92cdcf None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:46.602222 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e7fbae-6dc4-461a-b273-a3bc7f96dbfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:46.603234 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e7fbae-6dc4-461a-b273-a3bc7f96dbfd None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:46.603720 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e7fbae-6dc4-461a-b273-a3bc7f96dbfd None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:46.604197 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e7fbae-6dc4-461a-b273-a3bc7f96dbfd None admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:46.605262 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e7fbae-6dc4-461a-b273-a3bc7f96dbfd None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:24:46.605798 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e7fbae-6dc4-461a-b273-a3bc7f96dbfd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:46.607533 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e7fbae-6dc4-461a-b273-a3bc7f96dbfd None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:46.645077 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:46.659424 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70f04c3-f9d9-4c98-b4a4-42afb8966366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:46.659948 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 255/495] 10.222.0.40 () {56 vars in 1133 bytes} [Thu Jul 14 09:24:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:24:46.660116 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70f04c3-f9d9-4c98-b4a4-42afb8966366 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:46.660357 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70f04c3-f9d9-4c98-b4a4-42afb8966366 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:46.660613 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70f04c3-f9d9-4c98-b4a4-42afb8966366 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:46.662681 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e7fbae-6dc4-461a-b273-a3bc7f96dbfd None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:46.672791 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70f04c3-f9d9-4c98-b4a4-42afb8966366 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:24:46.681607 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-f70f04c3-f9d9-4c98-b4a4-42afb8966366 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 09:24:46.681607 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:24:46.681607 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:24:46.681607 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:24:46.681607 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:24:46.681607 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:24:46.681607 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:24:46.681607 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:24:46.681607 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:24:46.681607 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:24:46.681607 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:24:46.681607 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:24:46.681607 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:24:46.681607 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:24:46.681607 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:24:46.681607 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:24:46.682549 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:24:46.682549 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:24:46.682549 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:24:46.682549 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:24:46.682549 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:24:46.682549 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:24:46.682549 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:24:46.682549 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:24:46.682549 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:24:46.682549 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:24:46.682549 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:24:46.682549 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( Jul 14 09:24:46.682549 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:24:46.682549 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:24:46.682549 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:24:46.682549 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:24:46.683772 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:24:46.683772 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:24:46.683772 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:24:46.683772 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:24:46.683772 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:24:46.683772 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:24:46.683772 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:24:46.683772 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:24:46.683772 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:24:46.683772 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:24:46.683772 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 09:24:46.683772 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:24:46.687845 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 241/496] 10.222.0.40 () {56 vars in 1102 bytes} [Thu Jul 14 09:24:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:24:46.688789 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70f04c3-f9d9-4c98-b4a4-42afb8966366 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:46.790305 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e7fbae-6dc4-461a-b273-a3bc7f96dbfd None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:46.803507 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:46.811391 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70f04c3-f9d9-4c98-b4a4-42afb8966366 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:46.829526 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4023835-37bd-46c5-bdfe-ee2f212e2cf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:46.830226 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4023835-37bd-46c5-bdfe-ee2f212e2cf2 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:46.830516 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4023835-37bd-46c5-bdfe-ee2f212e2cf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:46.830799 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4023835-37bd-46c5-bdfe-ee2f212e2cf2 None admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:46.831542 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4023835-37bd-46c5-bdfe-ee2f212e2cf2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:24:46.831853 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4023835-37bd-46c5-bdfe-ee2f212e2cf2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:46.833256 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4023835-37bd-46c5-bdfe-ee2f212e2cf2 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:46.847766 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b06a7b-cdc5-4c01-b491-b02349558d94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:46.850392 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 256/497] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 14 09:24:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:24:46.850557 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b06a7b-cdc5-4c01-b491-b02349558d94 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:46.850557 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b06a7b-cdc5-4c01-b491-b02349558d94 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:46.850557 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b06a7b-cdc5-4c01-b491-b02349558d94 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:46.850812 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4023835-37bd-46c5-bdfe-ee2f212e2cf2 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:46.910963 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:46.930852 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b06a7b-cdc5-4c01-b491-b02349558d94 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:46.932322 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b06a7b-cdc5-4c01-b491-b02349558d94 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:46.963697 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4023835-37bd-46c5-bdfe-ee2f212e2cf2 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:46.998700 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4a5b84-f1cb-4a0f-be4a-9e4812cbd9c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:46.999374 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4a5b84-f1cb-4a0f-be4a-9e4812cbd9c7 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:46.999662 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4a5b84-f1cb-4a0f-be4a-9e4812cbd9c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:46.999938 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4a5b84-f1cb-4a0f-be4a-9e4812cbd9c7 None admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:47.000690 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4a5b84-f1cb-4a0f-be4a-9e4812cbd9c7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:24:47.001002 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4a5b84-f1cb-4a0f-be4a-9e4812cbd9c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:47.002467 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4a5b84-f1cb-4a0f-be4a-9e4812cbd9c7 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:47.010933 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 257/498] 10.222.0.40 () {56 vars in 1103 bytes} [Thu Jul 14 09:24:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:24:47.012250 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23faa59d-eff6-4e9b-86f5-9213db998b7b None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:47.013024 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23faa59d-eff6-4e9b-86f5-9213db998b7b None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:47.013024 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23faa59d-eff6-4e9b-86f5-9213db998b7b None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:47.014426 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 258/499] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:24:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:24:47.017314 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23faa59d-eff6-4e9b-86f5-9213db998b7b None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:47.039364 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 242/500] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 14 09:24:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 09:24:47.040789 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78175d47-6fbf-424e-8678-bdd2342f13f6 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:47.041030 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78175d47-6fbf-424e-8678-bdd2342f13f6 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:47.041307 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78175d47-6fbf-424e-8678-bdd2342f13f6 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:47.042612 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 243/501] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:24:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:24:47.043318 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78175d47-6fbf-424e-8678-bdd2342f13f6 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:47.055585 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:47.126863 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23faa59d-eff6-4e9b-86f5-9213db998b7b None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:47.129952 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:47.147390 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78175d47-6fbf-424e-8678-bdd2342f13f6 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:47.162255 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6869c9f-c480-4cc9-8073-7de85dfde360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:47.163103 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6869c9f-c480-4cc9-8073-7de85dfde360 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:47.163904 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6869c9f-c480-4cc9-8073-7de85dfde360 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:47.164189 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6869c9f-c480-4cc9-8073-7de85dfde360 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:47.171489 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6869c9f-c480-4cc9-8073-7de85dfde360 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:47.172950 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6869c9f-c480-4cc9-8073-7de85dfde360 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:47.183504 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce807be-e2f3-4b4d-b919-3010a6696cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:47.184302 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce807be-e2f3-4b4d-b919-3010a6696cce None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:47.184588 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce807be-e2f3-4b4d-b919-3010a6696cce None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:47.184868 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce807be-e2f3-4b4d-b919-3010a6696cce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:47.189340 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-e6869c9f-c480-4cc9-8073-7de85dfde360 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 14 09:24:47.189340 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:24:47.189340 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:24:47.189340 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:24:47.189340 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:24:47.189340 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:24:47.189340 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:24:47.189340 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:24:47.189340 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:24:47.189340 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:24:47.189340 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:24:47.189340 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:24:47.189340 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 09:24:47.189340 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 09:24:47.189340 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 09:24:47.189340 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 09:24:47.190261 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:24:47.190261 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:24:47.190261 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 09:24:47.190261 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 09:24:47.190261 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 09:24:47.190261 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 09:24:47.190261 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:24:47.190261 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:24:47.190261 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:24:47.190261 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:24:47.190261 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:24:47.190261 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( Jul 14 09:24:47.190261 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:24:47.190261 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:24:47.190261 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:24:47.190261 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:24:47.190261 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:24:47.190261 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:24:47.191147 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:24:47.191147 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:24:47.191147 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 09:24:47.191147 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 09:24:47.191147 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 09:24:47.191147 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 09:24:47.191147 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 09:24:47.191147 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 09:24:47.191147 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 14 09:24:47.191147 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Jul 14 09:24:47.191147 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 259/502] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 14 09:24:47 2022] GET /identity/v3/users/glance => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:24:47.191795 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5bbad6-e87e-49d6-ac2b-7b3785122afd None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:47.192075 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5bbad6-e87e-49d6-ac2b-7b3785122afd None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:47.192714 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5bbad6-e87e-49d6-ac2b-7b3785122afd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:47.200982 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce807be-e2f3-4b4d-b919-3010a6696cce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:47.202510 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce807be-e2f3-4b4d-b919-3010a6696cce None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:47.214925 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-2c5bbad6-e87e-49d6-ac2b-7b3785122afd None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:24:47.216136 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-2c5bbad6-e87e-49d6-ac2b-7b3785122afd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:24:47.220500 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-cce807be-e2f3-4b4d-b919-3010a6696cce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:24:47.220500 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:24:47.220500 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:24:47.220500 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:24:47.220500 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:24:47.220500 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:24:47.220500 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:24:47.220500 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:24:47.220500 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:24:47.220500 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:24:47.220500 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:24:47.220500 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:24:47.220500 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 09:24:47.220500 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 09:24:47.220500 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 09:24:47.221351 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 09:24:47.221351 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:24:47.221351 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:24:47.221351 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:24:47.221351 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:24:47.221351 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:24:47.221351 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:24:47.221351 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:24:47.221351 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( Jul 14 09:24:47.221351 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:24:47.221351 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:24:47.221351 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:24:47.221351 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:24:47.221351 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:24:47.221351 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:24:47.221351 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:24:47.221351 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:24:47.222204 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 09:24:47.222204 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 09:24:47.222204 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:24:47.222204 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:24:47.222418 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 244/503] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 09:24:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:24:47.223297 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce807be-e2f3-4b4d-b919-3010a6696cce None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:47.286284 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 260/504] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:24:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 09:24:47.287754 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7ac1e5-9383-435b-a518-30be5b9f23bd None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:47.288053 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7ac1e5-9383-435b-a518-30be5b9f23bd None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:47.288338 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7ac1e5-9383-435b-a518-30be5b9f23bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:47.313919 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-bf7ac1e5-9383-435b-a518-30be5b9f23bd None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:24:47.315073 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-bf7ac1e5-9383-435b-a518-30be5b9f23bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:24:47.324559 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce807be-e2f3-4b4d-b919-3010a6696cce None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:47.332892 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:47.360664 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8a90e6-55fc-4435-a7b2-0c818a01bcd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:47.361465 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8a90e6-55fc-4435-a7b2-0c818a01bcd8 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:47.361749 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8a90e6-55fc-4435-a7b2-0c818a01bcd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:47.362027 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8a90e6-55fc-4435-a7b2-0c818a01bcd8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:47.364784 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:47.373671 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8a90e6-55fc-4435-a7b2-0c818a01bcd8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:47.375184 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8a90e6-55fc-4435-a7b2-0c818a01bcd8 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:47.384711 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 261/505] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:24:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 09:24:47.385845 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7ac1e5-9383-435b-a518-30be5b9f23bd None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:47.393078 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-da8a90e6-55fc-4435-a7b2-0c818a01bcd8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:24:47.393078 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:24:47.393078 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:24:47.393078 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:24:47.393078 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:24:47.393078 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:24:47.393078 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:24:47.393078 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:24:47.393078 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:24:47.393078 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:24:47.393078 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:24:47.393078 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:24:47.393078 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 09:24:47.393078 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 09:24:47.393078 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 09:24:47.393918 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 09:24:47.393918 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:24:47.393918 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:24:47.393918 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:24:47.393918 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:24:47.393918 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:24:47.393918 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:24:47.393918 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:24:47.393918 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( Jul 14 09:24:47.393918 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:24:47.393918 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:24:47.393918 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:24:47.393918 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:24:47.393918 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:24:47.393918 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:24:47.393918 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:24:47.393918 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:24:47.394858 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 09:24:47.394858 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 09:24:47.394858 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:24:47.394858 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:24:47.394858 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 245/506] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 09:24:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:24:47.395110 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8a90e6-55fc-4435-a7b2-0c818a01bcd8 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:47.497001 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7ac1e5-9383-435b-a518-30be5b9f23bd None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:47.499137 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8a90e6-55fc-4435-a7b2-0c818a01bcd8 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:47.535943 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e7e51b-d3f4-4275-aa97-ce1e94db5ce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:47.536949 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e7e51b-d3f4-4275-aa97-ce1e94db5ce6 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:47.537232 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e7e51b-d3f4-4275-aa97-ce1e94db5ce6 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:47.537507 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e7e51b-d3f4-4275-aa97-ce1e94db5ce6 None admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:47.538427 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e7e51b-d3f4-4275-aa97-ce1e94db5ce6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:24:47.539277 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e7e51b-d3f4-4275-aa97-ce1e94db5ce6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:47.540727 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e7e51b-d3f4-4275-aa97-ce1e94db5ce6 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:47.544531 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bd92dc-27dd-4166-95b3-e18acd424d63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:47.545209 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bd92dc-27dd-4166-95b3-e18acd424d63 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:47.545503 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bd92dc-27dd-4166-95b3-e18acd424d63 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:47.545891 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bd92dc-27dd-4166-95b3-e18acd424d63 None admin] PATH_INFO: `/v3/domains` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:47.546574 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bd92dc-27dd-4166-95b3-e18acd424d63 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:24:47.546886 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bd92dc-27dd-4166-95b3-e18acd424d63 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:47.548269 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bd92dc-27dd-4166-95b3-e18acd424d63 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:47.560274 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 262/507] 10.222.0.40 () {56 vars in 1137 bytes} [Thu Jul 14 09:24:47 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:24:47.560472 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 246/508] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 14 09:24:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:24:47.561151 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e7e51b-d3f4-4275-aa97-ce1e94db5ce6 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:47.561279 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bd92dc-27dd-4166-95b3-e18acd424d63 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:47.577839 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:47.623714 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:47.670912 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e7e51b-d3f4-4275-aa97-ce1e94db5ce6 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:47.676016 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bd92dc-27dd-4166-95b3-e18acd424d63 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:47.704810 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d91a8ce-68da-4653-ba15-c7366ffccdf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:47.705607 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d91a8ce-68da-4653-ba15-c7366ffccdf7 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:47.705889 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d91a8ce-68da-4653-ba15-c7366ffccdf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:47.706166 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d91a8ce-68da-4653-ba15-c7366ffccdf7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:47.709772 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b199f70-72b2-48ff-976f-2a7bfaac3512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:47.711095 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b199f70-72b2-48ff-976f-2a7bfaac3512 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:47.711379 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b199f70-72b2-48ff-976f-2a7bfaac3512 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:47.711687 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b199f70-72b2-48ff-976f-2a7bfaac3512 None admin] PATH_INFO: `/v3/domains` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:47.712427 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b199f70-72b2-48ff-976f-2a7bfaac3512 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:24:47.712735 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b199f70-72b2-48ff-976f-2a7bfaac3512 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:47.714144 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b199f70-72b2-48ff-976f-2a7bfaac3512 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:47.719077 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d91a8ce-68da-4653-ba15-c7366ffccdf7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:24:47.726871 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-9d91a8ce-68da-4653-ba15-c7366ffccdf7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 09:24:47.726871 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:24:47.726871 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:24:47.726871 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:24:47.726871 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:24:47.726871 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:24:47.726871 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:24:47.726871 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:24:47.726871 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:24:47.726871 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:24:47.726871 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:24:47.726871 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:24:47.726871 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:24:47.726871 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:24:47.726871 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:24:47.726871 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:24:47.727771 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:24:47.727771 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:24:47.727771 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:24:47.727771 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:24:47.727771 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:24:47.727771 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:24:47.727771 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:24:47.727771 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:24:47.727771 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:24:47.727771 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:24:47.727771 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:24:47.727771 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( Jul 14 09:24:47.727771 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:24:47.727771 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:24:47.727771 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:24:47.727771 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:24:47.728548 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:24:47.728548 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:24:47.728548 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:24:47.728548 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:24:47.728548 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:24:47.728548 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:24:47.728548 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:24:47.728548 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:24:47.728548 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:24:47.728548 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:24:47.728548 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 09:24:47.728548 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Jul 14 09:24:47.729140 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 247/509] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 14 09:24:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:24:47.729140 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b199f70-72b2-48ff-976f-2a7bfaac3512 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:47.729267 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 263/510] 10.222.0.40 () {56 vars in 1102 bytes} [Thu Jul 14 09:24:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:24:47.729267 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d91a8ce-68da-4653-ba15-c7366ffccdf7 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:47.810653 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:47.830879 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b199f70-72b2-48ff-976f-2a7bfaac3512 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:47.840949 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:47.851059 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d91a8ce-68da-4653-ba15-c7366ffccdf7 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:47.866290 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8c683d-55f3-440c-8024-e44edc19a648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:47.867179 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8c683d-55f3-440c-8024-e44edc19a648 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:47.867432 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8c683d-55f3-440c-8024-e44edc19a648 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:47.868127 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8c683d-55f3-440c-8024-e44edc19a648 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:47.878736 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8c683d-55f3-440c-8024-e44edc19a648 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:47.880193 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8c683d-55f3-440c-8024-e44edc19a648 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:47.893915 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b112f678-2f67-48a4-9d9c-5db3c4a08b3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:47.894622 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b112f678-2f67-48a4-9d9c-5db3c4a08b3f None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:47.894909 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b112f678-2f67-48a4-9d9c-5db3c4a08b3f None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:47.895461 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b112f678-2f67-48a4-9d9c-5db3c4a08b3f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:47.899440 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-1f8c683d-55f3-440c-8024-e44edc19a648 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:24:47.899440 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:24:47.899440 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:24:47.899440 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:24:47.899440 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:24:47.899440 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:24:47.899440 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:24:47.899440 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:24:47.899440 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:24:47.899440 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:24:47.899440 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:24:47.899440 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:24:47.899440 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 09:24:47.899440 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 09:24:47.899440 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 09:24:47.900477 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 09:24:47.900477 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:24:47.900477 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:24:47.900477 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:24:47.900477 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:24:47.900477 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:24:47.900477 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:24:47.900477 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:24:47.900477 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( Jul 14 09:24:47.900477 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:24:47.900477 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:24:47.900477 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:24:47.900477 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:24:47.900477 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:24:47.900477 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:24:47.900477 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:24:47.900477 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:24:47.901340 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 09:24:47.901340 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 09:24:47.901340 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:24:47.901340 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:24:47.901340 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 248/511] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 09:24:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:24:47.901872 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8c683d-55f3-440c-8024-e44edc19a648 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:47.970920 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b112f678-2f67-48a4-9d9c-5db3c4a08b3f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:47.972402 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b112f678-2f67-48a4-9d9c-5db3c4a08b3f None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:48.013039 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8c683d-55f3-440c-8024-e44edc19a648 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:48.047330 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:48.048034 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1077729c-bccb-4db7-bcc6-f0eb07641ff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:48.048846 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1077729c-bccb-4db7-bcc6-f0eb07641ff2 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:48.049185 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1077729c-bccb-4db7-bcc6-f0eb07641ff2 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:48.049464 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1077729c-bccb-4db7-bcc6-f0eb07641ff2 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:48.057566 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1077729c-bccb-4db7-bcc6-f0eb07641ff2 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:48.059067 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1077729c-bccb-4db7-bcc6-f0eb07641ff2 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:48.078162 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-1077729c-bccb-4db7-bcc6-f0eb07641ff2 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 14 09:24:48.078162 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:24:48.078162 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:24:48.078162 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:24:48.078162 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:24:48.078162 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:24:48.078162 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:24:48.078162 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:24:48.078162 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:24:48.078162 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:24:48.078162 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:24:48.078162 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:24:48.078162 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 09:24:48.078162 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 09:24:48.078162 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 09:24:48.078162 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 09:24:48.079174 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:24:48.079174 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:24:48.079174 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 09:24:48.079174 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 09:24:48.079174 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 09:24:48.079174 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 09:24:48.079174 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:24:48.079174 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:24:48.079174 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:24:48.079174 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:24:48.079174 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:24:48.079174 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( Jul 14 09:24:48.079174 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:24:48.079174 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:24:48.079174 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:24:48.079174 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:24:48.079174 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:24:48.079174 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:24:48.080034 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:24:48.080034 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:24:48.080034 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 09:24:48.080034 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 09:24:48.080034 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 09:24:48.080034 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 09:24:48.080034 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 09:24:48.080034 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 09:24:48.080034 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 14 09:24:48.080034 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:24:48.080034 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 249/512] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 14 09:24:47 2022] GET /identity/v3/users/cinder => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:24:48.080569 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1077729c-bccb-4db7-bcc6-f0eb07641ff2 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:48.092957 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 264/513] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 14 09:24:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 09:24:48.092957 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b112f678-2f67-48a4-9d9c-5db3c4a08b3f None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:48.103984 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:48.192975 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1077729c-bccb-4db7-bcc6-f0eb07641ff2 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:48.205493 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b112f678-2f67-48a4-9d9c-5db3c4a08b3f None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:48.243727 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2314e2-3347-4d74-aed3-4876e54a7c48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:48.244827 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2314e2-3347-4d74-aed3-4876e54a7c48 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:48.245328 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2314e2-3347-4d74-aed3-4876e54a7c48 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:48.245822 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2314e2-3347-4d74-aed3-4876e54a7c48 None admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:48.247263 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2314e2-3347-4d74-aed3-4876e54a7c48 None admin] RBAC: Adding query filter params (name=service) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:24:48.247672 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2314e2-3347-4d74-aed3-4876e54a7c48 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:48.250106 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2314e2-3347-4d74-aed3-4876e54a7c48 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:48.251412 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df5cbbc-ff36-4462-a814-50226aeecdc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:48.252750 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df5cbbc-ff36-4462-a814-50226aeecdc4 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:48.253225 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df5cbbc-ff36-4462-a814-50226aeecdc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:48.253702 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df5cbbc-ff36-4462-a814-50226aeecdc4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:48.259592 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 265/514] 10.222.0.40 () {56 vars in 1103 bytes} [Thu Jul 14 09:24:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:24:48.260443 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2314e2-3347-4d74-aed3-4876e54a7c48 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:48.262865 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df5cbbc-ff36-4462-a814-50226aeecdc4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:48.264476 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df5cbbc-ff36-4462-a814-50226aeecdc4 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:48.280097 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-7df5cbbc-ff36-4462-a814-50226aeecdc4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 09:24:48.280097 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:24:48.280097 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:24:48.280097 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:24:48.280097 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:24:48.280097 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:24:48.280097 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:24:48.280097 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:24:48.280097 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:24:48.280097 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:24:48.280097 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:24:48.280097 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:24:48.280097 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 09:24:48.280097 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 09:24:48.280097 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 09:24:48.281172 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 09:24:48.281172 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:24:48.281172 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:24:48.281172 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:24:48.281172 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:24:48.281172 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:24:48.281172 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:24:48.281172 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:24:48.281172 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( Jul 14 09:24:48.281172 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:24:48.281172 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:24:48.281172 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:24:48.281172 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:24:48.281172 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:24:48.281172 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:24:48.281172 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:24:48.281172 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:24:48.282044 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 09:24:48.282044 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 09:24:48.282044 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 09:24:48.282044 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 09:24:48.282044 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 09:24:48.282044 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 09:24:48.282044 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 09:24:48.282044 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:24:48.282044 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 250/515] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jul 14 09:24:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:24:48.282556 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df5cbbc-ff36-4462-a814-50226aeecdc4 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:48.294696 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:48.367957 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2314e2-3347-4d74-aed3-4876e54a7c48 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:48.369741 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:48.389710 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df5cbbc-ff36-4462-a814-50226aeecdc4 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:48.403145 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97f1b47-b42a-4717-a53d-f30ee0d1f4c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:48.403820 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97f1b47-b42a-4717-a53d-f30ee0d1f4c6 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:48.404101 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97f1b47-b42a-4717-a53d-f30ee0d1f4c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:48.404374 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97f1b47-b42a-4717-a53d-f30ee0d1f4c6 None admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:48.405102 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97f1b47-b42a-4717-a53d-f30ee0d1f4c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:24:48.405413 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97f1b47-b42a-4717-a53d-f30ee0d1f4c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:48.406918 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97f1b47-b42a-4717-a53d-f30ee0d1f4c6 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:48.419587 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 266/516] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 14 09:24:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:24:48.420857 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97f1b47-b42a-4717-a53d-f30ee0d1f4c6 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:48.428221 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ccf27a-eb27-4e09-b509-f13f79f6c6d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:48.428904 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ccf27a-eb27-4e09-b509-f13f79f6c6d6 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:48.429790 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ccf27a-eb27-4e09-b509-f13f79f6c6d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:48.430070 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ccf27a-eb27-4e09-b509-f13f79f6c6d6 None admin] PATH_INFO: `/v3/users` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:48.431001 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ccf27a-eb27-4e09-b509-f13f79f6c6d6 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:24:48.431278 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ccf27a-eb27-4e09-b509-f13f79f6c6d6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:48.432734 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ccf27a-eb27-4e09-b509-f13f79f6c6d6 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:48.470781 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 251/517] 10.222.0.40 () {56 vars in 1137 bytes} [Thu Jul 14 09:24:48 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:24:48.471695 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ccf27a-eb27-4e09-b509-f13f79f6c6d6 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:48.528868 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:48.541260 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97f1b47-b42a-4717-a53d-f30ee0d1f4c6 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:48.575881 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ccf27a-eb27-4e09-b509-f13f79f6c6d6 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:48.579151 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcc632e-2e97-4666-8d35-1c76c7a778ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:48.579945 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcc632e-2e97-4666-8d35-1c76c7a778ae None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:48.580229 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcc632e-2e97-4666-8d35-1c76c7a778ae None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:48.580506 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcc632e-2e97-4666-8d35-1c76c7a778ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:48.590335 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcc632e-2e97-4666-8d35-1c76c7a778ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:48.591781 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcc632e-2e97-4666-8d35-1c76c7a778ae None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:48.609036 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f51e78-5cf0-41ce-ac99-7b250d715781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:48.609197 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-6bcc632e-2e97-4666-8d35-1c76c7a778ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:24:48.609197 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:24:48.609197 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:24:48.609197 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:24:48.609197 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:24:48.609197 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:24:48.609197 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:24:48.609197 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:24:48.609197 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:24:48.609197 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:24:48.609197 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:24:48.609197 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:24:48.609197 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 09:24:48.609197 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 09:24:48.609197 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 09:24:48.609988 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 09:24:48.609988 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:24:48.609988 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:24:48.609988 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:24:48.609988 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:24:48.609988 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:24:48.609988 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:24:48.609988 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:24:48.609988 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( Jul 14 09:24:48.609988 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:24:48.609988 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:24:48.609988 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:24:48.609988 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:24:48.609988 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:24:48.609988 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:24:48.609988 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:24:48.609988 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:24:48.610889 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 09:24:48.610889 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 09:24:48.610889 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:24:48.610889 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Jul 14 09:24:48.611095 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f51e78-5cf0-41ce-ac99-7b250d715781 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:48.611095 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f51e78-5cf0-41ce-ac99-7b250d715781 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:48.611229 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 267/518] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 09:24:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:24:48.611605 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f51e78-5cf0-41ce-ac99-7b250d715781 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:48.611677 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcc632e-2e97-4666-8d35-1c76c7a778ae None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:48.619093 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:48.622918 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f51e78-5cf0-41ce-ac99-7b250d715781 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:48.624737 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f51e78-5cf0-41ce-ac99-7b250d715781 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:48.642569 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-c4f51e78-5cf0-41ce-ac99-7b250d715781 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:24:48.642569 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:24:48.642569 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:24:48.642569 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:24:48.642569 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:24:48.642569 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:24:48.642569 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:24:48.642569 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:24:48.642569 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:24:48.642569 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:24:48.642569 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:24:48.642569 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:24:48.642569 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 09:24:48.642569 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 09:24:48.642569 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 09:24:48.643455 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 09:24:48.643455 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:24:48.643455 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:24:48.643455 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:24:48.643455 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:24:48.643455 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:24:48.643455 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:24:48.643455 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:24:48.643455 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( Jul 14 09:24:48.643455 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:24:48.643455 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:24:48.643455 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:24:48.643455 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:24:48.643455 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:24:48.643455 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:24:48.643455 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:24:48.643455 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:24:48.644292 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 09:24:48.644292 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 09:24:48.644292 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:24:48.644292 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:24:48.644292 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 252/519] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 09:24:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:24:48.644568 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f51e78-5cf0-41ce-ac99-7b250d715781 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:48.716437 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcc632e-2e97-4666-8d35-1c76c7a778ae None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:48.745090 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f51e78-5cf0-41ce-ac99-7b250d715781 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:48.752552 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f5ce89-aeb5-488e-826b-dd2598a6f23b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:48.753221 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f5ce89-aeb5-488e-826b-dd2598a6f23b None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:48.753507 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f5ce89-aeb5-488e-826b-dd2598a6f23b None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:48.753784 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f5ce89-aeb5-488e-826b-dd2598a6f23b None admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:48.754607 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f5ce89-aeb5-488e-826b-dd2598a6f23b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:24:48.754921 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f5ce89-aeb5-488e-826b-dd2598a6f23b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:48.756356 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f5ce89-aeb5-488e-826b-dd2598a6f23b None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:48.774295 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 268/520] 10.222.0.40 () {56 vars in 1148 bytes} [Thu Jul 14 09:24:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:24:48.774295 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f5ce89-aeb5-488e-826b-dd2598a6f23b None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:48.779266 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:48.782705 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e736f28d-fc4c-4735-94fb-183218b5fa14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:48.783382 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e736f28d-fc4c-4735-94fb-183218b5fa14 None admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:48.783664 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e736f28d-fc4c-4735-94fb-183218b5fa14 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:48.783938 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e736f28d-fc4c-4735-94fb-183218b5fa14 None admin] PATH_INFO: `/v3/users` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:48.784635 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e736f28d-fc4c-4735-94fb-183218b5fa14 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:48.786063 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e736f28d-fc4c-4735-94fb-183218b5fa14 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:48.805245 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 253/521] 10.222.0.40 () {60 vars in 1132 bytes} [Thu Jul 14 09:24:48 2022] POST /identity/v3/users => generated 247 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:24:48.806031 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e736f28d-fc4c-4735-94fb-183218b5fa14 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:48.858547 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:48.900079 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f5ce89-aeb5-488e-826b-dd2598a6f23b None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:48.926119 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e736f28d-fc4c-4735-94fb-183218b5fa14 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:48.937776 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddb7846-8d83-45ef-8d52-b7d3a6769526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:48.938491 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddb7846-8d83-45ef-8d52-b7d3a6769526 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:48.938783 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddb7846-8d83-45ef-8d52-b7d3a6769526 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:48.939065 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddb7846-8d83-45ef-8d52-b7d3a6769526 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:48.970075 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dd3c59-1968-4e6b-83b3-00886e826802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:48.970871 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dd3c59-1968-4e6b-83b3-00886e826802 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:48.971361 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dd3c59-1968-4e6b-83b3-00886e826802 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:48.971496 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dd3c59-1968-4e6b-83b3-00886e826802 None admin] PATH_INFO: `/v3/domains` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:48.972269 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dd3c59-1968-4e6b-83b3-00886e826802 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:24:48.972451 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dd3c59-1968-4e6b-83b3-00886e826802 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:48.973824 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dd3c59-1968-4e6b-83b3-00886e826802 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:48.986970 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 254/522] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 14 09:24:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:24:48.988339 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dd3c59-1968-4e6b-83b3-00886e826802 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:49.023855 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddb7846-8d83-45ef-8d52-b7d3a6769526 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:49.025625 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddb7846-8d83-45ef-8d52-b7d3a6769526 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:49.029320 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:49.097303 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dd3c59-1968-4e6b-83b3-00886e826802 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:49.105651 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:49.140947 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 269/523] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 14 09:24:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 09:24:49.142406 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddb7846-8d83-45ef-8d52-b7d3a6769526 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:49.142845 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0afcc79-07d5-41a7-95a5-bc2ebdb09edc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:49.143564 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0afcc79-07d5-41a7-95a5-bc2ebdb09edc None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:49.143988 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0afcc79-07d5-41a7-95a5-bc2ebdb09edc None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:49.144272 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0afcc79-07d5-41a7-95a5-bc2ebdb09edc None admin] PATH_INFO: `/v3/domains` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:49.145022 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0afcc79-07d5-41a7-95a5-bc2ebdb09edc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:24:49.145336 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0afcc79-07d5-41a7-95a5-bc2ebdb09edc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:49.147030 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0afcc79-07d5-41a7-95a5-bc2ebdb09edc None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:49.161619 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 255/524] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 14 09:24:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:24:49.168255 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0afcc79-07d5-41a7-95a5-bc2ebdb09edc None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:49.271741 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddb7846-8d83-45ef-8d52-b7d3a6769526 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:49.275216 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:49.318247 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0afcc79-07d5-41a7-95a5-bc2ebdb09edc None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:49.322453 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5232d46e-eb64-46b4-a58e-c66e12b47937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:49.323273 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5232d46e-eb64-46b4-a58e-c66e12b47937 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:49.323743 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5232d46e-eb64-46b4-a58e-c66e12b47937 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:49.324220 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5232d46e-eb64-46b4-a58e-c66e12b47937 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:49.325732 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5232d46e-eb64-46b4-a58e-c66e12b47937 None admin] RBAC: Adding query filter params (role.id=c12236aebd8048ba991da4671b44935f, scope.project.id=a478e76f04dd413f89ddfba7b0cdc9cc, user.id=1f6962106dfa4c4c9af551053f8095e9) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:24:49.326285 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5232d46e-eb64-46b4-a58e-c66e12b47937 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:49.328793 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5232d46e-eb64-46b4-a58e-c66e12b47937 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:49.337812 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 270/525] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jul 14 09:24:49 2022] GET /identity/v3/role_assignments?user.id=1f6962106dfa4c4c9af551053f8095e9&scope.project.id=a478e76f04dd413f89ddfba7b0cdc9cc&role.id=c12236aebd8048ba991da4671b44935f => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:24:49.338989 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5232d46e-eb64-46b4-a58e-c66e12b47937 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:49.383456 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c543d661-e6d8-4195-9b6d-52d006050fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:49.385307 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c543d661-e6d8-4195-9b6d-52d006050fc5 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:49.385835 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c543d661-e6d8-4195-9b6d-52d006050fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:49.386359 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c543d661-e6d8-4195-9b6d-52d006050fc5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:49.402144 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c543d661-e6d8-4195-9b6d-52d006050fc5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:49.403804 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c543d661-e6d8-4195-9b6d-52d006050fc5 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:49.427270 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-c543d661-e6d8-4195-9b6d-52d006050fc5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 09:24:49.427270 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:24:49.427270 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:24:49.427270 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:24:49.427270 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:24:49.427270 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:24:49.427270 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:24:49.427270 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:24:49.427270 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:24:49.427270 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:24:49.427270 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:24:49.427270 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:24:49.427270 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 09:24:49.427270 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 09:24:49.427270 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 09:24:49.428168 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 09:24:49.428168 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:24:49.428168 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:24:49.428168 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:24:49.428168 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:24:49.428168 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:24:49.428168 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:24:49.428168 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:24:49.428168 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( Jul 14 09:24:49.428168 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:24:49.428168 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:24:49.428168 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:24:49.428168 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:24:49.428168 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:24:49.428168 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:24:49.428168 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:24:49.428168 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:24:49.430295 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 09:24:49.430295 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 09:24:49.430295 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 09:24:49.430295 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 09:24:49.430295 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 09:24:49.430295 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 09:24:49.430295 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 09:24:49.430295 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:24:49.430295 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 256/526] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jul 14 09:24:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:24:49.430785 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c543d661-e6d8-4195-9b6d-52d006050fc5 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:49.460760 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:49.497126 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5232d46e-eb64-46b4-a58e-c66e12b47937 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:49.545111 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c543d661-e6d8-4195-9b6d-52d006050fc5 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:49.545492 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b703e72e-6952-4e9a-a2a1-91ff6886ee42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:49.546675 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b703e72e-6952-4e9a-a2a1-91ff6886ee42 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:49.547225 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b703e72e-6952-4e9a-a2a1-91ff6886ee42 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:49.547692 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b703e72e-6952-4e9a-a2a1-91ff6886ee42 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:49.560344 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b703e72e-6952-4e9a-a2a1-91ff6886ee42 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:49.562277 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b703e72e-6952-4e9a-a2a1-91ff6886ee42 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:49.581471 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-b703e72e-6952-4e9a-a2a1-91ff6886ee42 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:24:49.581471 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:24:49.581471 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:24:49.581471 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:24:49.581471 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:24:49.581471 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:24:49.581471 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:24:49.581471 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:24:49.581471 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:24:49.581471 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:24:49.581471 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:24:49.581471 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:24:49.581471 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 09:24:49.581471 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 09:24:49.581471 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 09:24:49.582424 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 09:24:49.582424 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:24:49.582424 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:24:49.582424 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:24:49.582424 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:24:49.582424 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:24:49.582424 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:24:49.582424 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:24:49.582424 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( Jul 14 09:24:49.582424 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:24:49.582424 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:24:49.582424 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:24:49.582424 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:24:49.582424 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:24:49.582424 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:24:49.582424 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:24:49.582424 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:24:49.583242 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 09:24:49.583242 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 09:24:49.583242 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:24:49.583242 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Jul 14 09:24:49.583549 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbe7530-4a86-4c28-84f0-bae01cdb7b27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:49.583549 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbe7530-4a86-4c28-84f0-bae01cdb7b27 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:49.583549 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbe7530-4a86-4c28-84f0-bae01cdb7b27 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:49.583549 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbe7530-4a86-4c28-84f0-bae01cdb7b27 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:49.586604 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 271/527] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 09:24:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:24:49.587913 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b703e72e-6952-4e9a-a2a1-91ff6886ee42 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:49.596810 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbe7530-4a86-4c28-84f0-bae01cdb7b27 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:49.598785 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbe7530-4a86-4c28-84f0-bae01cdb7b27 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:49.614832 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-fcbe7530-4a86-4c28-84f0-bae01cdb7b27 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 14 09:24:49.614832 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:24:49.614832 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:24:49.614832 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:24:49.614832 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:24:49.614832 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:24:49.614832 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:24:49.614832 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:24:49.614832 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:24:49.614832 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:24:49.614832 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:24:49.614832 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:24:49.614832 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 09:24:49.614832 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 09:24:49.614832 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 09:24:49.614832 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 09:24:49.615795 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:24:49.615795 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:24:49.615795 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 09:24:49.615795 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 09:24:49.615795 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 09:24:49.615795 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 09:24:49.615795 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:24:49.615795 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:24:49.615795 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:24:49.615795 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:24:49.615795 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:24:49.615795 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( Jul 14 09:24:49.615795 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:24:49.615795 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:24:49.615795 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:24:49.615795 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:24:49.615795 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:24:49.615795 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:24:49.616733 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:24:49.616733 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:24:49.616733 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 09:24:49.616733 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 09:24:49.616733 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 09:24:49.616733 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 09:24:49.616733 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 09:24:49.616733 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 09:24:49.616733 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 14 09:24:49.616733 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:24:49.621082 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 257/528] 10.222.0.40 () {56 vars in 1102 bytes} [Thu Jul 14 09:24:49 2022] GET /identity/v3/users/neutron => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:24:49.622036 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbe7530-4a86-4c28-84f0-bae01cdb7b27 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:49.625008 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:49.703804 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b703e72e-6952-4e9a-a2a1-91ff6886ee42 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:49.720291 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:49.737538 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbe7530-4a86-4c28-84f0-bae01cdb7b27 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:49.746660 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365e213f-5d13-4690-a845-8e0778a96dd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:49.747852 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365e213f-5d13-4690-a845-8e0778a96dd0 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:49.748394 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365e213f-5d13-4690-a845-8e0778a96dd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:49.748898 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365e213f-5d13-4690-a845-8e0778a96dd0 None admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:49.749989 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365e213f-5d13-4690-a845-8e0778a96dd0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:24:49.750519 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365e213f-5d13-4690-a845-8e0778a96dd0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:49.752526 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365e213f-5d13-4690-a845-8e0778a96dd0 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:49.766761 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 272/529] 10.222.0.40 () {56 vars in 1148 bytes} [Thu Jul 14 09:24:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:24:49.767955 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365e213f-5d13-4690-a845-8e0778a96dd0 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:49.779757 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44c3ee2-073c-4e8e-988b-5ab80a62045f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:49.780503 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44c3ee2-073c-4e8e-988b-5ab80a62045f None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:49.780792 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44c3ee2-073c-4e8e-988b-5ab80a62045f None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:49.781074 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44c3ee2-073c-4e8e-988b-5ab80a62045f None admin] PATH_INFO: `/v3/domains` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:49.781961 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44c3ee2-073c-4e8e-988b-5ab80a62045f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:24:49.782161 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44c3ee2-073c-4e8e-988b-5ab80a62045f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:49.783744 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44c3ee2-073c-4e8e-988b-5ab80a62045f None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:49.796674 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 258/530] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 14 09:24:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:24:49.797521 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44c3ee2-073c-4e8e-988b-5ab80a62045f None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:49.859713 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:49.883731 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365e213f-5d13-4690-a845-8e0778a96dd0 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:49.923249 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adfd1c9-e72a-484a-9d01-fd8f7308c395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:49.924011 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adfd1c9-e72a-484a-9d01-fd8f7308c395 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:49.924221 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adfd1c9-e72a-484a-9d01-fd8f7308c395 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:49.924506 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adfd1c9-e72a-484a-9d01-fd8f7308c395 None admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:49.925362 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adfd1c9-e72a-484a-9d01-fd8f7308c395 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:24:49.925663 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adfd1c9-e72a-484a-9d01-fd8f7308c395 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:49.927138 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adfd1c9-e72a-484a-9d01-fd8f7308c395 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:49.931511 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44c3ee2-073c-4e8e-988b-5ab80a62045f None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:49.949795 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 273/531] 10.222.0.40 () {56 vars in 1139 bytes} [Thu Jul 14 09:24:49 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:24:49.951072 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adfd1c9-e72a-484a-9d01-fd8f7308c395 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:49.977731 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f07f7b2-8839-41a8-8772-0581bad07518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:49.978370 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f07f7b2-8839-41a8-8772-0581bad07518 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:49.978723 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f07f7b2-8839-41a8-8772-0581bad07518 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:49.979010 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f07f7b2-8839-41a8-8772-0581bad07518 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:49.980059 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f07f7b2-8839-41a8-8772-0581bad07518 None admin] RBAC: Adding query filter params (role.id=c12236aebd8048ba991da4671b44935f, scope.project.id=a478e76f04dd413f89ddfba7b0cdc9cc, user.id=7ba461800d6845e6a767c83777ae5213) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:24:49.980235 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f07f7b2-8839-41a8-8772-0581bad07518 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:49.981725 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f07f7b2-8839-41a8-8772-0581bad07518 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:49.988111 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 259/532] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jul 14 09:24:49 2022] GET /identity/v3/role_assignments?user.id=7ba461800d6845e6a767c83777ae5213&scope.project.id=a478e76f04dd413f89ddfba7b0cdc9cc&role.id=c12236aebd8048ba991da4671b44935f => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:24:49.988761 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f07f7b2-8839-41a8-8772-0581bad07518 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:50.016333 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:50.075164 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adfd1c9-e72a-484a-9d01-fd8f7308c395 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:50.114693 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b381112-d1ad-4049-b185-b535af331021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:50.115887 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b381112-d1ad-4049-b185-b535af331021 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:50.116429 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b381112-d1ad-4049-b185-b535af331021 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:50.117440 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b381112-d1ad-4049-b185-b535af331021 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:50.125997 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b381112-d1ad-4049-b185-b535af331021 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:50.127982 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b381112-d1ad-4049-b185-b535af331021 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:50.130466 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:50.146522 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-8b381112-d1ad-4049-b185-b535af331021 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 09:24:50.146522 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:24:50.146522 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:24:50.146522 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:24:50.146522 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:24:50.146522 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:24:50.146522 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:24:50.146522 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:24:50.146522 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:24:50.146522 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:24:50.146522 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:24:50.146522 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:24:50.146522 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 09:24:50.146522 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 09:24:50.146522 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 09:24:50.147444 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 09:24:50.147444 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:24:50.147444 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:24:50.147444 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:24:50.147444 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:24:50.147444 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:24:50.147444 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:24:50.147444 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:24:50.147444 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( Jul 14 09:24:50.147444 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:24:50.147444 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:24:50.147444 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:24:50.147444 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:24:50.147444 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:24:50.147444 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:24:50.147444 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:24:50.147444 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:24:50.148350 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 09:24:50.148350 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 09:24:50.148350 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 09:24:50.148350 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 09:24:50.148350 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 09:24:50.148350 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 09:24:50.148350 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 09:24:50.148350 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Jul 14 09:24:50.151107 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 274/533] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jul 14 09:24:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:24:50.159524 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b381112-d1ad-4049-b185-b535af331021 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:50.173873 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f07f7b2-8839-41a8-8772-0581bad07518 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:50.216476 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b682d3c0-3052-4fed-ac0b-bb494538e5b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:50.217153 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b682d3c0-3052-4fed-ac0b-bb494538e5b6 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:50.217439 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b682d3c0-3052-4fed-ac0b-bb494538e5b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:50.217720 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b682d3c0-3052-4fed-ac0b-bb494538e5b6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:50.320507 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b381112-d1ad-4049-b185-b535af331021 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:50.349309 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b682d3c0-3052-4fed-ac0b-bb494538e5b6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:50.351421 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b682d3c0-3052-4fed-ac0b-bb494538e5b6 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:50.362428 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce213e92-ee2d-401f-8944-59e03b42b0bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:50.363122 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce213e92-ee2d-401f-8944-59e03b42b0bc None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:50.363407 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce213e92-ee2d-401f-8944-59e03b42b0bc None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:50.363684 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce213e92-ee2d-401f-8944-59e03b42b0bc None admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:50.364487 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce213e92-ee2d-401f-8944-59e03b42b0bc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:24:50.364852 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce213e92-ee2d-401f-8944-59e03b42b0bc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:50.367016 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce213e92-ee2d-401f-8944-59e03b42b0bc None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:50.377109 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:50.382132 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 275/534] 10.222.0.40 () {56 vars in 1148 bytes} [Thu Jul 14 09:24:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:24:50.388012 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce213e92-ee2d-401f-8944-59e03b42b0bc None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:50.504684 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:50.516628 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 260/535] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 14 09:24:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 528 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 09:24:50.522066 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b682d3c0-3052-4fed-ac0b-bb494538e5b6 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:50.588783 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce213e92-ee2d-401f-8944-59e03b42b0bc None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:50.656473 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c0da8b-675a-4186-bd88-5ed1cc3b8861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:50.658662 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c0da8b-675a-4186-bd88-5ed1cc3b8861 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:50.659371 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c0da8b-675a-4186-bd88-5ed1cc3b8861 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:50.660517 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c0da8b-675a-4186-bd88-5ed1cc3b8861 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:50.661639 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c0da8b-675a-4186-bd88-5ed1cc3b8861 None admin] RBAC: Adding query filter params (role.id=c12236aebd8048ba991da4671b44935f, scope.project.id=a478e76f04dd413f89ddfba7b0cdc9cc, user.id=25048b29787d482783ebc944f1a7df65) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:24:50.664044 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c0da8b-675a-4186-bd88-5ed1cc3b8861 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:50.668068 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c0da8b-675a-4186-bd88-5ed1cc3b8861 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:50.680470 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 276/536] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jul 14 09:24:50 2022] GET /identity/v3/role_assignments?user.id=25048b29787d482783ebc944f1a7df65&scope.project.id=a478e76f04dd413f89ddfba7b0cdc9cc&role.id=c12236aebd8048ba991da4671b44935f => generated 259 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:24:50.691732 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b682d3c0-3052-4fed-ac0b-bb494538e5b6 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:50.704257 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:50.739232 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff634653-8641-4c66-969e-99932752e632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:50.740405 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff634653-8641-4c66-969e-99932752e632 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:50.740917 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff634653-8641-4c66-969e-99932752e632 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:50.741465 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff634653-8641-4c66-969e-99932752e632 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:50.768395 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff634653-8641-4c66-969e-99932752e632 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:50.770538 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff634653-8641-4c66-969e-99932752e632 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:50.813992 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-ff634653-8641-4c66-969e-99932752e632 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:24:50.813992 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:24:50.813992 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:24:50.813992 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:24:50.813992 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:24:50.813992 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:24:50.813992 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:24:50.813992 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:24:50.813992 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:24:50.813992 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:24:50.813992 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:24:50.813992 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:24:50.813992 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 09:24:50.813992 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 09:24:50.813992 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 09:24:50.815148 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 09:24:50.815148 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:24:50.815148 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:24:50.815148 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:24:50.815148 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:24:50.815148 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:24:50.815148 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:24:50.815148 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:24:50.815148 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( Jul 14 09:24:50.815148 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:24:50.815148 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:24:50.815148 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:24:50.815148 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:24:50.815148 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:24:50.815148 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:24:50.815148 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:24:50.815148 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:24:50.816055 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 09:24:50.816055 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 09:24:50.816055 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:24:50.816055 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:24:50.818520 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 261/537] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 09:24:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 09:24:50.831371 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c0da8b-675a-4186-bd88-5ed1cc3b8861 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:50.956890 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c0da8b-675a-4186-bd88-5ed1cc3b8861 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:50.971751 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6338fc59-fc77-44a1-bb82-536e3c11e35f None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:50.972714 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6338fc59-fc77-44a1-bb82-536e3c11e35f None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:50.973193 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6338fc59-fc77-44a1-bb82-536e3c11e35f None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:50.975204 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 262/538] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:24:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:24:50.981105 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ee0903-afc0-4527-adb8-7577ea895c57 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:50.981629 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:50.981905 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ee0903-afc0-4527-adb8-7577ea895c57 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:50.982399 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ee0903-afc0-4527-adb8-7577ea895c57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:51.004652 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e49ccb9-6346-4d0c-986f-ff2468c89adf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:51.005722 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e49ccb9-6346-4d0c-986f-ff2468c89adf None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:51.006308 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e49ccb9-6346-4d0c-986f-ff2468c89adf None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:51.006818 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e49ccb9-6346-4d0c-986f-ff2468c89adf None admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:51.007797 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e49ccb9-6346-4d0c-986f-ff2468c89adf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:24:51.008308 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e49ccb9-6346-4d0c-986f-ff2468c89adf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:51.009904 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e49ccb9-6346-4d0c-986f-ff2468c89adf None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:51.016772 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-78ee0903-afc0-4527-adb8-7577ea895c57 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:24:51.023715 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-78ee0903-afc0-4527-adb8-7577ea895c57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:24:51.034232 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 277/539] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 14 09:24:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:24:51.036125 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e49ccb9-6346-4d0c-986f-ff2468c89adf None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:51.137168 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 263/540] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:24:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 09:24:51.167031 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e49ccb9-6346-4d0c-986f-ff2468c89adf None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:51.175748 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ee0903-afc0-4527-adb8-7577ea895c57 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:51.214027 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a7518e-a6c7-4459-b7c9-90537d8887cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:51.214778 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a7518e-a6c7-4459-b7c9-90537d8887cd None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:51.215066 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a7518e-a6c7-4459-b7c9-90537d8887cd None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:51.215338 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a7518e-a6c7-4459-b7c9-90537d8887cd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:51.225191 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a7518e-a6c7-4459-b7c9-90537d8887cd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:51.227312 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a7518e-a6c7-4459-b7c9-90537d8887cd None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:51.242080 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-83a7518e-a6c7-4459-b7c9-90537d8887cd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 09:24:51.242080 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:24:51.242080 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:24:51.242080 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:24:51.242080 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:24:51.242080 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:24:51.242080 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:24:51.242080 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:24:51.242080 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:24:51.242080 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:24:51.242080 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:24:51.242080 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:24:51.242080 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 09:24:51.242080 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 09:24:51.242080 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 09:24:51.243251 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 09:24:51.243251 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:24:51.243251 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:24:51.243251 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:24:51.243251 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:24:51.243251 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:24:51.243251 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:24:51.243251 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:24:51.243251 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( Jul 14 09:24:51.243251 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:24:51.243251 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:24:51.243251 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:24:51.243251 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:24:51.243251 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:24:51.243251 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:24:51.243251 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:24:51.243251 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:24:51.244067 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 09:24:51.244067 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 09:24:51.244067 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 09:24:51.244067 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 09:24:51.244067 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 09:24:51.244067 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 09:24:51.244067 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 09:24:51.244067 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Jul 14 09:24:51.244067 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 278/541] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jul 14 09:24:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 09:24:51.249839 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a7518e-a6c7-4459-b7c9-90537d8887cd None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:51.299156 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:51.365081 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a7518e-a6c7-4459-b7c9-90537d8887cd None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:51.396601 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:51.421647 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ee0903-afc0-4527-adb8-7577ea895c57 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:51.444205 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cf296c-7bb3-4c6b-bd4e-e8bd0de064de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:51.445444 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cf296c-7bb3-4c6b-bd4e-e8bd0de064de None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:51.445731 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cf296c-7bb3-4c6b-bd4e-e8bd0de064de None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:51.446010 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cf296c-7bb3-4c6b-bd4e-e8bd0de064de None admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:51.446845 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cf296c-7bb3-4c6b-bd4e-e8bd0de064de None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:24:51.447161 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cf296c-7bb3-4c6b-bd4e-e8bd0de064de None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:51.448607 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cf296c-7bb3-4c6b-bd4e-e8bd0de064de None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:51.470533 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 279/542] 10.222.0.40 () {56 vars in 1148 bytes} [Thu Jul 14 09:24:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:24:51.476225 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cf296c-7bb3-4c6b-bd4e-e8bd0de064de None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:51.503865 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85be1798-8cf0-43d7-975c-86822d465673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:51.505008 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85be1798-8cf0-43d7-975c-86822d465673 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:51.505518 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85be1798-8cf0-43d7-975c-86822d465673 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:51.505978 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85be1798-8cf0-43d7-975c-86822d465673 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:51.530220 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85be1798-8cf0-43d7-975c-86822d465673 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:24:51.549121 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-85be1798-8cf0-43d7-975c-86822d465673 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 09:24:51.549121 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:24:51.549121 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:24:51.549121 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:24:51.549121 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:24:51.549121 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:24:51.549121 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:24:51.549121 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:24:51.549121 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:24:51.549121 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:24:51.549121 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:24:51.549121 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:24:51.549121 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:24:51.549121 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:24:51.549121 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:24:51.549121 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:24:51.550070 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:24:51.550070 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:24:51.550070 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:24:51.550070 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:24:51.550070 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:24:51.550070 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:24:51.550070 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:24:51.550070 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:24:51.550070 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:24:51.550070 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:24:51.550070 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:24:51.550070 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( Jul 14 09:24:51.550070 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:24:51.550070 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:24:51.550070 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:24:51.550070 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:24:51.550893 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:24:51.550893 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:24:51.550893 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:24:51.550893 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:24:51.550893 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:24:51.550893 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:24:51.550893 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:24:51.550893 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:24:51.550893 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:24:51.550893 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:24:51.550893 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 09:24:51.550893 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:24:51.550893 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 264/543] 10.222.0.40 () {56 vars in 1102 bytes} [Thu Jul 14 09:24:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 375 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 09:24:51.558964 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85be1798-8cf0-43d7-975c-86822d465673 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:51.652466 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cf296c-7bb3-4c6b-bd4e-e8bd0de064de None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:51.654421 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:51.719397 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6796a6a-962e-4c35-90ed-afd73665e6d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:51.719813 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6796a6a-962e-4c35-90ed-afd73665e6d4 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:51.720100 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6796a6a-962e-4c35-90ed-afd73665e6d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:51.720380 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6796a6a-962e-4c35-90ed-afd73665e6d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:51.721290 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6796a6a-962e-4c35-90ed-afd73665e6d4 None admin] RBAC: Adding query filter params (role.id=c12236aebd8048ba991da4671b44935f, scope.project.id=a478e76f04dd413f89ddfba7b0cdc9cc, user.id=65e4a5a8965e4802a9055d332179b7a8) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:24:51.721553 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6796a6a-962e-4c35-90ed-afd73665e6d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:51.723023 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6796a6a-962e-4c35-90ed-afd73665e6d4 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:51.729730 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 280/544] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jul 14 09:24:51 2022] GET /identity/v3/role_assignments?user.id=65e4a5a8965e4802a9055d332179b7a8&scope.project.id=a478e76f04dd413f89ddfba7b0cdc9cc&role.id=c12236aebd8048ba991da4671b44935f => generated 259 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:24:51.735361 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc75568-59f9-4bd0-b2a6-c23c28248ff2 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:51.735757 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc75568-59f9-4bd0-b2a6-c23c28248ff2 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:51.736048 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc75568-59f9-4bd0-b2a6-c23c28248ff2 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:51.737800 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 281/545] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:24:51 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:24:51.744377 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6d25f0-aea4-4613-84c9-ce4c4c2f2046 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:51.744687 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6d25f0-aea4-4613-84c9-ce4c4c2f2046 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:51.744944 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6d25f0-aea4-4613-84c9-ce4c4c2f2046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:51.747160 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85be1798-8cf0-43d7-975c-86822d465673 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:51.771000 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-ae6d25f0-aea4-4613-84c9-ce4c4c2f2046 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:24:51.778907 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-ae6d25f0-aea4-4613-84c9-ce4c4c2f2046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:24:51.784581 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fa05cc-a195-4919-ab46-6f6b5428218b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:51.785441 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fa05cc-a195-4919-ab46-6f6b5428218b None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:51.785870 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fa05cc-a195-4919-ab46-6f6b5428218b None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:51.786321 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fa05cc-a195-4919-ab46-6f6b5428218b None admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:51.787249 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fa05cc-a195-4919-ab46-6f6b5428218b None admin] RBAC: Adding query filter params (name=service) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:24:51.787802 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fa05cc-a195-4919-ab46-6f6b5428218b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:51.789377 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fa05cc-a195-4919-ab46-6f6b5428218b None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:51.798864 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 265/546] 10.222.0.40 () {56 vars in 1103 bytes} [Thu Jul 14 09:24:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:24:51.806615 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fa05cc-a195-4919-ab46-6f6b5428218b None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:51.845298 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:51.927263 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 282/547] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:24:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 09:24:51.954823 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6d25f0-aea4-4613-84c9-ce4c4c2f2046 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:51.982131 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fa05cc-a195-4919-ab46-6f6b5428218b None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:52.027506 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41632328-01fb-4dd5-a4ce-c6f5afec3fe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:52.028320 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41632328-01fb-4dd5-a4ce-c6f5afec3fe3 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:52.028603 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41632328-01fb-4dd5-a4ce-c6f5afec3fe3 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:52.028881 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41632328-01fb-4dd5-a4ce-c6f5afec3fe3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:52.061229 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6d25f0-aea4-4613-84c9-ce4c4c2f2046 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:52.064840 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41632328-01fb-4dd5-a4ce-c6f5afec3fe3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:52.065891 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41632328-01fb-4dd5-a4ce-c6f5afec3fe3 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:52.066413 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:52.093785 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-41632328-01fb-4dd5-a4ce-c6f5afec3fe3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:24:52.093785 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:24:52.093785 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:24:52.093785 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:24:52.093785 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:24:52.093785 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:24:52.093785 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:24:52.093785 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:24:52.093785 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:24:52.093785 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:24:52.093785 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:24:52.093785 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:24:52.093785 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 09:24:52.093785 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 09:24:52.093785 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 09:24:52.094733 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 09:24:52.094733 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:24:52.094733 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:24:52.094733 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:24:52.094733 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:24:52.094733 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:24:52.094733 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:24:52.094733 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:24:52.094733 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( Jul 14 09:24:52.094733 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:24:52.094733 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:24:52.094733 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:24:52.094733 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:24:52.094733 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:24:52.094733 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:24:52.094733 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:24:52.094733 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:24:52.095558 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 09:24:52.095558 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 09:24:52.095558 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:24:52.095558 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:24:52.096438 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 266/548] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 09:24:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:24:52.102418 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41632328-01fb-4dd5-a4ce-c6f5afec3fe3 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:52.130675 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d28893-c43d-4ec6-b419-fe536c7f2bc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:52.131495 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d28893-c43d-4ec6-b419-fe536c7f2bc0 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:52.131778 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d28893-c43d-4ec6-b419-fe536c7f2bc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:52.132698 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d28893-c43d-4ec6-b419-fe536c7f2bc0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:52.152958 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d28893-c43d-4ec6-b419-fe536c7f2bc0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:24:52.161034 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-64d28893-c43d-4ec6-b419-fe536c7f2bc0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 09:24:52.161034 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:24:52.161034 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:24:52.161034 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:24:52.161034 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:24:52.161034 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:24:52.161034 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:24:52.161034 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:24:52.161034 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:24:52.161034 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:24:52.161034 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:24:52.161034 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:24:52.161034 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:24:52.161034 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:24:52.161034 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:24:52.161034 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:24:52.161925 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:24:52.161925 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:24:52.161925 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:24:52.161925 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:24:52.161925 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:24:52.161925 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:24:52.161925 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:24:52.161925 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:24:52.161925 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:24:52.161925 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:24:52.161925 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:24:52.161925 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( Jul 14 09:24:52.161925 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:24:52.161925 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:24:52.161925 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:24:52.161925 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:24:52.163836 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:24:52.163836 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:24:52.163836 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:24:52.163836 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:24:52.163836 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:24:52.163836 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:24:52.163836 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:24:52.163836 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:24:52.163836 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:24:52.163836 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:24:52.163836 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 09:24:52.163836 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Jul 14 09:24:52.164620 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 283/549] 10.222.0.40 () {56 vars in 1102 bytes} [Thu Jul 14 09:24:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 09:24:52.173838 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d28893-c43d-4ec6-b419-fe536c7f2bc0 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:52.228031 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:52.293881 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41632328-01fb-4dd5-a4ce-c6f5afec3fe3 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:52.353761 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8787e1f4-7ea9-4169-95c1-7ba40a5a10a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:52.355468 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8787e1f4-7ea9-4169-95c1-7ba40a5a10a1 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:52.355783 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8787e1f4-7ea9-4169-95c1-7ba40a5a10a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:52.356238 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8787e1f4-7ea9-4169-95c1-7ba40a5a10a1 None admin] PATH_INFO: `/v3/domains` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:52.360955 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8787e1f4-7ea9-4169-95c1-7ba40a5a10a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:24:52.360955 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8787e1f4-7ea9-4169-95c1-7ba40a5a10a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:52.360955 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8787e1f4-7ea9-4169-95c1-7ba40a5a10a1 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:52.363891 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d28893-c43d-4ec6-b419-fe536c7f2bc0 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:52.382214 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 267/550] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 14 09:24:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:24:52.383315 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8787e1f4-7ea9-4169-95c1-7ba40a5a10a1 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:52.451078 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176db633-dcc2-487e-92b1-4a6da62766c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:52.451968 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176db633-dcc2-487e-92b1-4a6da62766c8 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:52.452262 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176db633-dcc2-487e-92b1-4a6da62766c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:52.452541 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176db633-dcc2-487e-92b1-4a6da62766c8 None admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:52.453325 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176db633-dcc2-487e-92b1-4a6da62766c8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:24:52.453637 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176db633-dcc2-487e-92b1-4a6da62766c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:52.455133 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176db633-dcc2-487e-92b1-4a6da62766c8 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:52.478981 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 284/551] 10.222.0.40 () {56 vars in 1103 bytes} [Thu Jul 14 09:24:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:24:52.484255 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176db633-dcc2-487e-92b1-4a6da62766c8 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:52.515771 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:52.586905 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8787e1f4-7ea9-4169-95c1-7ba40a5a10a1 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:52.620036 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:52.642448 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8cf053-cefb-4560-bb38-8a54657fc17d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:52.643371 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8cf053-cefb-4560-bb38-8a54657fc17d None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:52.643665 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8cf053-cefb-4560-bb38-8a54657fc17d None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:52.643946 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8cf053-cefb-4560-bb38-8a54657fc17d None admin] PATH_INFO: `/v3/users/swift` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:52.662304 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8cf053-cefb-4560-bb38-8a54657fc17d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:52.664354 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8cf053-cefb-4560-bb38-8a54657fc17d None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:52.691927 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176db633-dcc2-487e-92b1-4a6da62766c8 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:52.699640 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-3c8cf053-cefb-4560-bb38-8a54657fc17d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 14 09:24:52.699640 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:24:52.699640 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:24:52.699640 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:24:52.699640 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:24:52.699640 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:24:52.699640 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:24:52.699640 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:24:52.699640 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:24:52.699640 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:24:52.699640 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:24:52.699640 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:24:52.699640 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 09:24:52.699640 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 09:24:52.699640 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 09:24:52.699640 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 09:24:52.700588 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:24:52.700588 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:24:52.700588 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 09:24:52.700588 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 09:24:52.700588 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 09:24:52.700588 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 09:24:52.700588 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:24:52.700588 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:24:52.700588 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:24:52.700588 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:24:52.700588 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:24:52.700588 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( Jul 14 09:24:52.700588 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:24:52.700588 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:24:52.700588 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:24:52.700588 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:24:52.700588 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:24:52.700588 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:24:52.701581 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:24:52.701581 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:24:52.701581 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 09:24:52.701581 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 09:24:52.701581 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 09:24:52.701581 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 09:24:52.701581 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 09:24:52.701581 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 09:24:52.701581 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 14 09:24:52.701581 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:24:52.702591 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 268/552] 10.222.0.40 () {56 vars in 1096 bytes} [Thu Jul 14 09:24:52 2022] GET /identity/v3/users/swift => generated 83 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:24:52.709344 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8cf053-cefb-4560-bb38-8a54657fc17d None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:52.739487 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228f41ae-e1df-41ab-adf3-445f8b19a799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:52.740433 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228f41ae-e1df-41ab-adf3-445f8b19a799 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:52.740881 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228f41ae-e1df-41ab-adf3-445f8b19a799 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:52.741164 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228f41ae-e1df-41ab-adf3-445f8b19a799 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:52.756212 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228f41ae-e1df-41ab-adf3-445f8b19a799 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:52.758002 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228f41ae-e1df-41ab-adf3-445f8b19a799 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:52.781580 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-228f41ae-e1df-41ab-adf3-445f8b19a799 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:24:52.781580 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:24:52.781580 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:24:52.781580 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:24:52.781580 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:24:52.781580 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:24:52.781580 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:24:52.781580 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:24:52.781580 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:24:52.781580 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:24:52.781580 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:24:52.781580 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:24:52.781580 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 09:24:52.781580 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 09:24:52.781580 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 09:24:52.782821 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 09:24:52.782821 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:24:52.782821 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:24:52.782821 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:24:52.782821 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:24:52.782821 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:24:52.782821 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:24:52.782821 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:24:52.782821 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( Jul 14 09:24:52.782821 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:24:52.782821 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:24:52.782821 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:24:52.782821 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:24:52.782821 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:24:52.782821 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:24:52.782821 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:24:52.782821 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:24:52.783798 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 09:24:52.783798 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 09:24:52.783798 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:24:52.783798 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Jul 14 09:24:52.786576 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 285/553] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 09:24:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:24:52.792958 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98ffa16-bf66-4044-80ae-e40c14f56fd4 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:52.792958 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98ffa16-bf66-4044-80ae-e40c14f56fd4 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:52.792958 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98ffa16-bf66-4044-80ae-e40c14f56fd4 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:52.794314 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 286/554] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:24:52 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:24:52.795411 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98ffa16-bf66-4044-80ae-e40c14f56fd4 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:52.830391 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8cf053-cefb-4560-bb38-8a54657fc17d None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:52.868601 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1128b4bc-aa74-4ff9-943a-8d34a6a6af48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:52.869601 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1128b4bc-aa74-4ff9-943a-8d34a6a6af48 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:52.870066 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1128b4bc-aa74-4ff9-943a-8d34a6a6af48 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:52.870589 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1128b4bc-aa74-4ff9-943a-8d34a6a6af48 None admin] PATH_INFO: `/v3/users` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:52.871631 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1128b4bc-aa74-4ff9-943a-8d34a6a6af48 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:24:52.872163 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1128b4bc-aa74-4ff9-943a-8d34a6a6af48 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:52.873806 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1128b4bc-aa74-4ff9-943a-8d34a6a6af48 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:52.889203 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:52.899951 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 269/555] 10.222.0.40 () {56 vars in 1135 bytes} [Thu Jul 14 09:24:52 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:24:52.901719 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323f928a-b1bb-4adb-bdea-8adffa801f69 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:52.902251 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323f928a-b1bb-4adb-bdea-8adffa801f69 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:52.902736 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323f928a-b1bb-4adb-bdea-8adffa801f69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:52.919756 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-323f928a-b1bb-4adb-bdea-8adffa801f69 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:24:52.921266 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-323f928a-b1bb-4adb-bdea-8adffa801f69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:24:52.928454 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98ffa16-bf66-4044-80ae-e40c14f56fd4 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:52.971514 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed4606b-1251-49f7-b6e5-b57f46c5c60a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:52.972589 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed4606b-1251-49f7-b6e5-b57f46c5c60a None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:52.973080 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed4606b-1251-49f7-b6e5-b57f46c5c60a None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:52.973557 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed4606b-1251-49f7-b6e5-b57f46c5c60a None admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:52.974610 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed4606b-1251-49f7-b6e5-b57f46c5c60a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:24:52.975124 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed4606b-1251-49f7-b6e5-b57f46c5c60a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:52.975604 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:52.978005 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed4606b-1251-49f7-b6e5-b57f46c5c60a None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:52.992994 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 287/556] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 14 09:24:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:24:52.994326 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed4606b-1251-49f7-b6e5-b57f46c5c60a None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:53.013587 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 270/557] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:24:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 09:24:53.014485 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323f928a-b1bb-4adb-bdea-8adffa801f69 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:53.154571 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed4606b-1251-49f7-b6e5-b57f46c5c60a None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:53.157152 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323f928a-b1bb-4adb-bdea-8adffa801f69 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:53.204629 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b411ecb-ac1a-4088-bcf6-bb9d46d42c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:53.205808 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b411ecb-ac1a-4088-bcf6-bb9d46d42c3b None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:53.206425 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b411ecb-ac1a-4088-bcf6-bb9d46d42c3b None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:53.206806 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b411ecb-ac1a-4088-bcf6-bb9d46d42c3b None admin] PATH_INFO: `/v3/users/nova` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:53.209949 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:53.217337 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d542ba84-8438-40c2-baca-5f932b9288d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:53.217773 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b411ecb-ac1a-4088-bcf6-bb9d46d42c3b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:53.217994 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d542ba84-8438-40c2-baca-5f932b9288d1 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:53.218304 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d542ba84-8438-40c2-baca-5f932b9288d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:53.218580 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d542ba84-8438-40c2-baca-5f932b9288d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:53.219556 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b411ecb-ac1a-4088-bcf6-bb9d46d42c3b None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:53.237473 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-0b411ecb-ac1a-4088-bcf6-bb9d46d42c3b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 14 09:24:53.237473 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:24:53.237473 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:24:53.237473 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:24:53.237473 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:24:53.237473 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:24:53.237473 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:24:53.237473 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:24:53.237473 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:24:53.237473 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:24:53.237473 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:24:53.237473 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:24:53.237473 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 09:24:53.237473 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 09:24:53.237473 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 09:24:53.237473 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 09:24:53.239043 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:24:53.239043 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:24:53.239043 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 09:24:53.239043 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 09:24:53.239043 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 09:24:53.239043 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 09:24:53.239043 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:24:53.239043 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:24:53.239043 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:24:53.239043 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:24:53.239043 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:24:53.239043 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( Jul 14 09:24:53.239043 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:24:53.239043 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:24:53.239043 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:24:53.239043 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:24:53.239043 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:24:53.239043 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:24:53.239978 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:24:53.239978 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:24:53.239978 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 09:24:53.239978 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 09:24:53.239978 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 09:24:53.239978 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 09:24:53.239978 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 09:24:53.239978 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 09:24:53.239978 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 14 09:24:53.239978 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:24:53.239978 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 271/558] 10.222.0.40 () {56 vars in 1093 bytes} [Thu Jul 14 09:24:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:24:53.239978 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b411ecb-ac1a-4088-bcf6-bb9d46d42c3b None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:53.293802 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:53.318428 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d542ba84-8438-40c2-baca-5f932b9288d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:53.320578 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d542ba84-8438-40c2-baca-5f932b9288d1 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:53.385703 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b411ecb-ac1a-4088-bcf6-bb9d46d42c3b None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:53.436287 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 288/559] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 14 09:24:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 09:24:53.437773 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d8b8f7-adcd-411b-be90-371baae1e443 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:53.438137 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d8b8f7-adcd-411b-be90-371baae1e443 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:53.438512 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d8b8f7-adcd-411b-be90-371baae1e443 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:53.441401 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 289/560] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:24:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:24:53.441401 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d8b8f7-adcd-411b-be90-371baae1e443 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:53.443554 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69597bbf-6b2d-4e22-bd1e-ada87ecfc4dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:53.446784 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69597bbf-6b2d-4e22-bd1e-ada87ecfc4dd None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:53.448281 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69597bbf-6b2d-4e22-bd1e-ada87ecfc4dd None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:53.448281 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69597bbf-6b2d-4e22-bd1e-ada87ecfc4dd None admin] PATH_INFO: `/v3/roles/service` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:53.464089 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69597bbf-6b2d-4e22-bd1e-ada87ecfc4dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:24:53.474576 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-69597bbf-6b2d-4e22-bd1e-ada87ecfc4dd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 09:24:53.474576 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:24:53.474576 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:24:53.474576 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:24:53.474576 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:24:53.474576 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:24:53.474576 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:24:53.474576 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:24:53.474576 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:24:53.474576 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:24:53.474576 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:24:53.474576 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:24:53.474576 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:24:53.474576 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:24:53.474576 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:24:53.474576 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:24:53.475608 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:24:53.475608 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:24:53.475608 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:24:53.475608 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:24:53.475608 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:24:53.475608 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:24:53.475608 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:24:53.475608 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:24:53.475608 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:24:53.475608 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:24:53.475608 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:24:53.475608 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( Jul 14 09:24:53.475608 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:24:53.475608 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:24:53.475608 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:24:53.475608 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:24:53.476420 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:24:53.476420 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:24:53.476420 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:24:53.476420 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:24:53.476420 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:24:53.476420 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:24:53.476420 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:24:53.476420 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:24:53.476420 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:24:53.476420 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:24:53.476420 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 09:24:53.476420 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:24:53.477049 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 272/561] 10.222.0.40 () {56 vars in 1102 bytes} [Thu Jul 14 09:24:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:24:53.477889 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69597bbf-6b2d-4e22-bd1e-ada87ecfc4dd None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:53.483149 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:53.593817 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d8b8f7-adcd-411b-be90-371baae1e443 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:53.609488 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:53.618919 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69597bbf-6b2d-4e22-bd1e-ada87ecfc4dd None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:53.630462 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa3646c-d068-402b-901c-ffa53c23cc5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:53.631149 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa3646c-d068-402b-901c-ffa53c23cc5d None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:53.631432 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa3646c-d068-402b-901c-ffa53c23cc5d None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:53.631705 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa3646c-d068-402b-901c-ffa53c23cc5d None admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:53.633215 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa3646c-d068-402b-901c-ffa53c23cc5d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:24:53.633525 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa3646c-d068-402b-901c-ffa53c23cc5d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:53.634995 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa3646c-d068-402b-901c-ffa53c23cc5d None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:53.653793 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 290/562] 10.222.0.40 () {56 vars in 1133 bytes} [Thu Jul 14 09:24:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:24:53.655114 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd8b2a7-ae07-4de1-b7b2-19c92617cbf8 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:53.655440 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd8b2a7-ae07-4de1-b7b2-19c92617cbf8 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:53.655680 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd8b2a7-ae07-4de1-b7b2-19c92617cbf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:53.662873 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99bdf33-1ece-40fc-a096-25fe116db53b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:53.664226 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99bdf33-1ece-40fc-a096-25fe116db53b None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:53.664586 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99bdf33-1ece-40fc-a096-25fe116db53b None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:53.664871 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99bdf33-1ece-40fc-a096-25fe116db53b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:53.673618 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-2fd8b2a7-ae07-4de1-b7b2-19c92617cbf8 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:24:53.675361 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-2fd8b2a7-ae07-4de1-b7b2-19c92617cbf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:24:53.676412 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99bdf33-1ece-40fc-a096-25fe116db53b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:53.677871 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99bdf33-1ece-40fc-a096-25fe116db53b None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:53.696507 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-e99bdf33-1ece-40fc-a096-25fe116db53b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:24:53.696507 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:24:53.696507 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:24:53.696507 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:24:53.696507 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:24:53.696507 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:24:53.696507 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:24:53.696507 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:24:53.696507 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:24:53.696507 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:24:53.696507 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:24:53.696507 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:24:53.696507 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 09:24:53.696507 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 09:24:53.696507 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 09:24:53.697441 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 09:24:53.697441 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:24:53.697441 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:24:53.697441 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:24:53.697441 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:24:53.697441 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:24:53.697441 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:24:53.697441 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:24:53.697441 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( Jul 14 09:24:53.697441 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:24:53.697441 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:24:53.697441 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:24:53.697441 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:24:53.697441 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:24:53.697441 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:24:53.697441 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:24:53.697441 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:24:53.698774 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 09:24:53.698774 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 09:24:53.698774 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:24:53.698774 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:24:53.698774 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 273/563] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 09:24:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:24:53.698774 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99bdf33-1ece-40fc-a096-25fe116db53b None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:53.770611 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 291/564] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:24:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 09:24:53.772956 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd8b2a7-ae07-4de1-b7b2-19c92617cbf8 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:53.797221 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:53.826350 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99bdf33-1ece-40fc-a096-25fe116db53b None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:53.877521 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cd7c61-0f64-4881-a6cf-71a1e4701f31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:53.878236 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cd7c61-0f64-4881-a6cf-71a1e4701f31 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:53.878522 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cd7c61-0f64-4881-a6cf-71a1e4701f31 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:53.878772 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cd7c61-0f64-4881-a6cf-71a1e4701f31 None admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:53.879525 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cd7c61-0f64-4881-a6cf-71a1e4701f31 None admin] RBAC: Adding query filter params (name=service) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:24:53.879839 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cd7c61-0f64-4881-a6cf-71a1e4701f31 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:53.881215 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cd7c61-0f64-4881-a6cf-71a1e4701f31 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:53.897194 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 274/565] 10.222.0.40 () {56 vars in 1103 bytes} [Thu Jul 14 09:24:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:24:53.897194 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cd7c61-0f64-4881-a6cf-71a1e4701f31 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:53.908416 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:53.911679 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd8b2a7-ae07-4de1-b7b2-19c92617cbf8 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:53.949066 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b13625-a321-433b-92cb-0cffb22d9de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:53.949786 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b13625-a321-433b-92cb-0cffb22d9de3 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:53.950072 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b13625-a321-433b-92cb-0cffb22d9de3 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:53.950371 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b13625-a321-433b-92cb-0cffb22d9de3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:53.960337 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b13625-a321-433b-92cb-0cffb22d9de3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:53.961790 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b13625-a321-433b-92cb-0cffb22d9de3 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:53.979583 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-86b13625-a321-433b-92cb-0cffb22d9de3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:24:53.979583 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:24:53.979583 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:24:53.979583 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:24:53.979583 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:24:53.979583 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:24:53.979583 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:24:53.979583 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:24:53.979583 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:24:53.979583 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:24:53.979583 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:24:53.979583 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:24:53.979583 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 09:24:53.979583 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 09:24:53.979583 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 09:24:53.980493 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 09:24:53.980493 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:24:53.980493 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:24:53.980493 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:24:53.980493 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:24:53.980493 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:24:53.980493 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:24:53.980493 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:24:53.980493 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( Jul 14 09:24:53.980493 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:24:53.980493 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:24:53.980493 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:24:53.980493 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:24:53.980493 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:24:53.980493 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:24:53.980493 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:24:53.980493 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:24:53.981378 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 09:24:53.981378 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 09:24:53.981378 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:24:53.981378 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Jul 14 09:24:53.981378 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 292/566] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 09:24:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:24:53.981665 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b13625-a321-433b-92cb-0cffb22d9de3 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:54.010901 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cd7c61-0f64-4881-a6cf-71a1e4701f31 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:54.045858 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2826b1db-50d5-4d5d-a482-8d5849a1374e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:54.046678 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2826b1db-50d5-4d5d-a482-8d5849a1374e None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:54.046838 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2826b1db-50d5-4d5d-a482-8d5849a1374e None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:54.047118 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2826b1db-50d5-4d5d-a482-8d5849a1374e None admin] PATH_INFO: `/v3/domains` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:54.047836 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2826b1db-50d5-4d5d-a482-8d5849a1374e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:24:54.048141 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2826b1db-50d5-4d5d-a482-8d5849a1374e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:54.049510 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2826b1db-50d5-4d5d-a482-8d5849a1374e None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:54.053410 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:54.061066 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 275/567] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 14 09:24:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:24:54.061860 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2826b1db-50d5-4d5d-a482-8d5849a1374e None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:54.084734 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b13625-a321-433b-92cb-0cffb22d9de3 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:54.118134 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718af928-fe39-4bb5-91e2-1960305d65c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:54.118954 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718af928-fe39-4bb5-91e2-1960305d65c2 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:54.119235 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718af928-fe39-4bb5-91e2-1960305d65c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:54.119513 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718af928-fe39-4bb5-91e2-1960305d65c2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:54.125823 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:54.129767 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718af928-fe39-4bb5-91e2-1960305d65c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:24:54.137607 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-718af928-fe39-4bb5-91e2-1960305d65c2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 09:24:54.137607 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:24:54.137607 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:24:54.137607 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:24:54.137607 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:24:54.137607 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:24:54.137607 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:24:54.137607 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:24:54.137607 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:24:54.137607 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:24:54.137607 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:24:54.137607 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:24:54.137607 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:24:54.137607 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:24:54.137607 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:24:54.137607 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:24:54.138675 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:24:54.138675 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:24:54.138675 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:24:54.138675 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:24:54.138675 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:24:54.138675 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:24:54.138675 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:24:54.138675 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:24:54.138675 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:24:54.138675 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:24:54.138675 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:24:54.138675 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( Jul 14 09:24:54.138675 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:24:54.138675 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:24:54.138675 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:24:54.138675 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:24:54.139507 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:24:54.139507 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:24:54.139507 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:24:54.139507 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:24:54.139507 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:24:54.139507 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:24:54.139507 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:24:54.139507 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:24:54.139507 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:24:54.139507 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:24:54.139507 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 09:24:54.139507 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Jul 14 09:24:54.142470 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 293/568] 10.222.0.40 () {56 vars in 1102 bytes} [Thu Jul 14 09:24:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:24:54.143404 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718af928-fe39-4bb5-91e2-1960305d65c2 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:54.161089 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2826b1db-50d5-4d5d-a482-8d5849a1374e None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:54.194433 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237f7810-bbe7-44ef-af5c-91e0f4aa45d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:54.195228 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237f7810-bbe7-44ef-af5c-91e0f4aa45d9 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:54.195515 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237f7810-bbe7-44ef-af5c-91e0f4aa45d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:54.195791 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237f7810-bbe7-44ef-af5c-91e0f4aa45d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:54.207097 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237f7810-bbe7-44ef-af5c-91e0f4aa45d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:54.208472 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237f7810-bbe7-44ef-af5c-91e0f4aa45d9 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:54.228351 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-237f7810-bbe7-44ef-af5c-91e0f4aa45d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:24:54.228351 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:24:54.228351 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:24:54.228351 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:24:54.228351 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:24:54.228351 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:24:54.228351 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:24:54.228351 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:24:54.228351 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:24:54.228351 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:24:54.228351 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:24:54.228351 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:24:54.228351 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 09:24:54.228351 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 09:24:54.228351 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 09:24:54.229507 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 09:24:54.229507 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:24:54.229507 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:24:54.229507 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:24:54.229507 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:24:54.229507 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:24:54.229507 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:24:54.229507 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:24:54.229507 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( Jul 14 09:24:54.229507 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:24:54.229507 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:24:54.229507 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:24:54.229507 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:24:54.229507 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:24:54.229507 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:24:54.229507 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:24:54.229507 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:24:54.230803 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 09:24:54.230803 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 09:24:54.230803 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:24:54.230803 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:24:54.230803 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 276/569] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 09:24:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:24:54.231127 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292121f1-15e4-4f1b-9aa7-fec84139e7a4 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:54.231127 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292121f1-15e4-4f1b-9aa7-fec84139e7a4 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:54.231393 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292121f1-15e4-4f1b-9aa7-fec84139e7a4 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:54.232832 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 277/570] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:24:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:24:54.233339 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292121f1-15e4-4f1b-9aa7-fec84139e7a4 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:54.259381 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718af928-fe39-4bb5-91e2-1960305d65c2 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:54.291029 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:54.297829 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aee78a7-6cc0-48cc-a1c9-4a6d05e603ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:54.298536 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aee78a7-6cc0-48cc-a1c9-4a6d05e603ef None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:54.298944 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aee78a7-6cc0-48cc-a1c9-4a6d05e603ef None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:54.299229 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aee78a7-6cc0-48cc-a1c9-4a6d05e603ef None admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:54.299973 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aee78a7-6cc0-48cc-a1c9-4a6d05e603ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:24:54.300287 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aee78a7-6cc0-48cc-a1c9-4a6d05e603ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:54.301669 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aee78a7-6cc0-48cc-a1c9-4a6d05e603ef None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:54.316687 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 294/571] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 14 09:24:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:24:54.317536 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aee78a7-6cc0-48cc-a1c9-4a6d05e603ef None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:54.344145 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292121f1-15e4-4f1b-9aa7-fec84139e7a4 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:54.370419 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:54.392502 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548c3246-7617-4afa-b5d3-86c66835645e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:54.393812 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548c3246-7617-4afa-b5d3-86c66835645e None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:54.394352 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548c3246-7617-4afa-b5d3-86c66835645e None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:54.394857 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548c3246-7617-4afa-b5d3-86c66835645e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:54.407718 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548c3246-7617-4afa-b5d3-86c66835645e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:54.410474 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548c3246-7617-4afa-b5d3-86c66835645e None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:54.426917 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-548c3246-7617-4afa-b5d3-86c66835645e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 09:24:54.426917 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:24:54.426917 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:24:54.426917 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:24:54.426917 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:24:54.426917 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:24:54.426917 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:24:54.426917 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:24:54.426917 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:24:54.426917 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:24:54.426917 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:24:54.426917 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:24:54.426917 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 09:24:54.426917 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 09:24:54.426917 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 09:24:54.428214 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 09:24:54.428214 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:24:54.428214 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:24:54.428214 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:24:54.428214 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:24:54.428214 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:24:54.428214 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:24:54.428214 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:24:54.428214 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( Jul 14 09:24:54.428214 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:24:54.428214 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:24:54.428214 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:24:54.428214 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:24:54.428214 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:24:54.428214 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:24:54.428214 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:24:54.428214 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:24:54.429143 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 09:24:54.429143 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 09:24:54.429143 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 09:24:54.429143 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 09:24:54.429143 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 09:24:54.429143 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 09:24:54.429143 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 09:24:54.429143 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:24:54.429143 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 278/572] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jul 14 09:24:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:24:54.429143 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548c3246-7617-4afa-b5d3-86c66835645e None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:54.429688 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aee78a7-6cc0-48cc-a1c9-4a6d05e603ef None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:54.472725 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6a3048-543f-475b-ba5c-d6c166905dbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:54.473311 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6a3048-543f-475b-ba5c-d6c166905dbe None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:54.473590 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6a3048-543f-475b-ba5c-d6c166905dbe None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:54.473861 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6a3048-543f-475b-ba5c-d6c166905dbe None admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:54.474714 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6a3048-543f-475b-ba5c-d6c166905dbe None admin] RBAC: Adding query filter params (name=service) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:24:54.474954 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6a3048-543f-475b-ba5c-d6c166905dbe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:54.476381 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6a3048-543f-475b-ba5c-d6c166905dbe None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:54.484673 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 295/573] 10.222.0.40 () {56 vars in 1103 bytes} [Thu Jul 14 09:24:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:24:54.485951 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702a60fd-3acf-46b0-868e-697b23ee53fd None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:54.486272 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702a60fd-3acf-46b0-868e-697b23ee53fd None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:54.486548 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702a60fd-3acf-46b0-868e-697b23ee53fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:54.504527 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-702a60fd-3acf-46b0-868e-697b23ee53fd None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:24:54.505727 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-702a60fd-3acf-46b0-868e-697b23ee53fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:24:54.540246 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548c3246-7617-4afa-b5d3-86c66835645e None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:54.557133 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:54.579143 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 296/574] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:24:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 09:24:54.580003 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702a60fd-3acf-46b0-868e-697b23ee53fd None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:54.580976 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79351f4-8f24-41af-8919-6ebee4fab453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:54.581650 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79351f4-8f24-41af-8919-6ebee4fab453 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:54.581940 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79351f4-8f24-41af-8919-6ebee4fab453 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:54.582255 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79351f4-8f24-41af-8919-6ebee4fab453 None admin] PATH_INFO: `/v3/domains` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:54.582995 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79351f4-8f24-41af-8919-6ebee4fab453 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:24:54.583313 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79351f4-8f24-41af-8919-6ebee4fab453 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:54.584691 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79351f4-8f24-41af-8919-6ebee4fab453 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:54.600860 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 279/575] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 14 09:24:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:24:54.601548 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79351f4-8f24-41af-8919-6ebee4fab453 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:54.643111 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:54.686289 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702a60fd-3acf-46b0-868e-697b23ee53fd None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:54.702169 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79351f4-8f24-41af-8919-6ebee4fab453 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:54.723013 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1b4486-b85a-4744-9b5d-7c3aef4b7b4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:54.724117 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1b4486-b85a-4744-9b5d-7c3aef4b7b4f None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:54.724399 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1b4486-b85a-4744-9b5d-7c3aef4b7b4f None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:54.724676 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1b4486-b85a-4744-9b5d-7c3aef4b7b4f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:54.732831 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1b4486-b85a-4744-9b5d-7c3aef4b7b4f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:54.734355 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1b4486-b85a-4744-9b5d-7c3aef4b7b4f None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:54.737055 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ae0ba8-611c-400b-b8ed-ffd13e39a501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:54.737716 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ae0ba8-611c-400b-b8ed-ffd13e39a501 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:54.737995 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ae0ba8-611c-400b-b8ed-ffd13e39a501 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:54.738292 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ae0ba8-611c-400b-b8ed-ffd13e39a501 None admin] PATH_INFO: `/v3/projects` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:54.739115 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ae0ba8-611c-400b-b8ed-ffd13e39a501 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:24:54.739425 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ae0ba8-611c-400b-b8ed-ffd13e39a501 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:54.740842 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ae0ba8-611c-400b-b8ed-ffd13e39a501 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:54.748545 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-8f1b4486-b85a-4744-9b5d-7c3aef4b7b4f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 09:24:54.748545 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:24:54.748545 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:24:54.748545 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:24:54.748545 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:24:54.748545 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:24:54.748545 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:24:54.748545 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:24:54.748545 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:24:54.748545 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:24:54.748545 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:24:54.748545 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:24:54.748545 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 09:24:54.748545 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 09:24:54.748545 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 09:24:54.749530 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 09:24:54.749530 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:24:54.749530 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:24:54.749530 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:24:54.749530 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:24:54.749530 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:24:54.749530 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:24:54.749530 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:24:54.749530 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( Jul 14 09:24:54.749530 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:24:54.749530 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:24:54.749530 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:24:54.749530 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:24:54.749530 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:24:54.749530 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:24:54.749530 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:24:54.749530 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:24:54.750423 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 09:24:54.750423 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 09:24:54.750423 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 09:24:54.750423 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 09:24:54.750423 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 09:24:54.750423 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 09:24:54.750423 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 09:24:54.750423 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Jul 14 09:24:54.750423 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 297/576] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jul 14 09:24:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:24:54.750909 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1b4486-b85a-4744-9b5d-7c3aef4b7b4f None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:54.761159 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 280/577] 10.222.0.40 () {56 vars in 1148 bytes} [Thu Jul 14 09:24:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:24:54.762011 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ae0ba8-611c-400b-b8ed-ffd13e39a501 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:54.806660 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:54.868633 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1b4486-b85a-4744-9b5d-7c3aef4b7b4f None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:54.874582 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:54.877727 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ae0ba8-611c-400b-b8ed-ffd13e39a501 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:54.902631 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef524c3f-499d-46cb-bfb6-ef1a29e283b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:54.903425 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef524c3f-499d-46cb-bfb6-ef1a29e283b1 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:54.903708 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef524c3f-499d-46cb-bfb6-ef1a29e283b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:54.903983 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef524c3f-499d-46cb-bfb6-ef1a29e283b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:54.912340 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb0c8dd-c5f5-4fe8-8083-070815cb3612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:54.913246 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb0c8dd-c5f5-4fe8-8083-070815cb3612 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:54.913534 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb0c8dd-c5f5-4fe8-8083-070815cb3612 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:54.913811 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb0c8dd-c5f5-4fe8-8083-070815cb3612 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:54.914284 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef524c3f-499d-46cb-bfb6-ef1a29e283b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:54.915744 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef524c3f-499d-46cb-bfb6-ef1a29e283b1 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:54.921086 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb0c8dd-c5f5-4fe8-8083-070815cb3612 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:54.922568 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb0c8dd-c5f5-4fe8-8083-070815cb3612 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:54.932939 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-ef524c3f-499d-46cb-bfb6-ef1a29e283b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:24:54.932939 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:24:54.932939 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:24:54.932939 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:24:54.932939 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:24:54.932939 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:24:54.932939 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:24:54.932939 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:24:54.932939 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:24:54.932939 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:24:54.932939 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:24:54.932939 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:24:54.932939 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 09:24:54.932939 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 09:24:54.932939 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 09:24:54.933883 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 09:24:54.933883 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:24:54.933883 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:24:54.933883 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:24:54.933883 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:24:54.933883 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:24:54.933883 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:24:54.933883 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:24:54.933883 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( Jul 14 09:24:54.933883 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:24:54.933883 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:24:54.933883 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:24:54.933883 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:24:54.933883 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:24:54.933883 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:24:54.933883 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:24:54.933883 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:24:54.934782 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 09:24:54.934782 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 09:24:54.934782 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:24:54.934782 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Jul 14 09:24:54.934782 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 298/578] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 09:24:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:24:54.935062 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef524c3f-499d-46cb-bfb6-ef1a29e283b1 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:54.937549 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-bcb0c8dd-c5f5-4fe8-8083-070815cb3612 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 14 09:24:54.937549 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:24:54.937549 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:24:54.937549 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:24:54.937549 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:24:54.937549 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:24:54.937549 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:24:54.937549 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:24:54.937549 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:24:54.937549 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:24:54.937549 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:24:54.937549 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:24:54.937549 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 09:24:54.937549 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 09:24:54.937549 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 09:24:54.937549 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 09:24:54.938582 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:24:54.938582 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:24:54.938582 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 09:24:54.938582 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 09:24:54.938582 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 09:24:54.938582 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 09:24:54.938582 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:24:54.938582 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:24:54.938582 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:24:54.938582 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:24:54.938582 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:24:54.938582 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( Jul 14 09:24:54.938582 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:24:54.938582 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:24:54.938582 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:24:54.938582 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:24:54.938582 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:24:54.938582 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:24:54.939510 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:24:54.939510 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:24:54.939510 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 09:24:54.939510 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 09:24:54.939510 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 09:24:54.939510 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 09:24:54.939510 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 09:24:54.939510 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 09:24:54.939510 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 14 09:24:54.939510 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:24:54.939510 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 281/579] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 14 09:24:54 2022] GET /identity/v3/users/glance => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:24:54.940111 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb0c8dd-c5f5-4fe8-8083-070815cb3612 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:55.032141 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:55.038404 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb0c8dd-c5f5-4fe8-8083-070815cb3612 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:55.039402 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef524c3f-499d-46cb-bfb6-ef1a29e283b1 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:55.073525 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880f442f-e25b-4f72-91f7-02b2b36ab34c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:55.074114 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b561577-0bc2-4b77-a0ec-ee71e986fc5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:55.074240 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880f442f-e25b-4f72-91f7-02b2b36ab34c None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:55.074485 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880f442f-e25b-4f72-91f7-02b2b36ab34c None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:55.074577 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b561577-0bc2-4b77-a0ec-ee71e986fc5f None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:55.074760 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880f442f-e25b-4f72-91f7-02b2b36ab34c None admin] PATH_INFO: `/v3/projects` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:55.074856 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b561577-0bc2-4b77-a0ec-ee71e986fc5f None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:55.075068 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b561577-0bc2-4b77-a0ec-ee71e986fc5f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:55.075553 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880f442f-e25b-4f72-91f7-02b2b36ab34c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:24:55.075863 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880f442f-e25b-4f72-91f7-02b2b36ab34c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:55.077380 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880f442f-e25b-4f72-91f7-02b2b36ab34c None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:55.086632 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b561577-0bc2-4b77-a0ec-ee71e986fc5f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:24:55.089169 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 282/580] 10.222.0.40 () {56 vars in 1148 bytes} [Thu Jul 14 09:24:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:24:55.089994 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880f442f-e25b-4f72-91f7-02b2b36ab34c None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:55.094495 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-2b561577-0bc2-4b77-a0ec-ee71e986fc5f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 09:24:55.094495 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:24:55.094495 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:24:55.094495 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:24:55.094495 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:24:55.094495 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:24:55.094495 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:24:55.094495 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:24:55.094495 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:24:55.094495 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:24:55.094495 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:24:55.094495 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:24:55.094495 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:24:55.094495 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:24:55.094495 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:24:55.094495 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:24:55.095576 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:24:55.095576 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:24:55.095576 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:24:55.095576 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:24:55.095576 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:24:55.095576 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:24:55.095576 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:24:55.095576 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:24:55.095576 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:24:55.095576 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:24:55.095576 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:24:55.095576 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( Jul 14 09:24:55.095576 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:24:55.095576 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:24:55.095576 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:24:55.095576 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:24:55.096416 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:24:55.096416 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:24:55.096416 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:24:55.096416 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:24:55.096416 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:24:55.096416 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:24:55.096416 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:24:55.096416 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:24:55.096416 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:24:55.096416 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:24:55.096416 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 09:24:55.096416 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Jul 14 09:24:55.096416 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 299/581] 10.222.0.40 () {56 vars in 1102 bytes} [Thu Jul 14 09:24:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:24:55.097124 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b561577-0bc2-4b77-a0ec-ee71e986fc5f None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:55.119174 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:55.199111 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880f442f-e25b-4f72-91f7-02b2b36ab34c None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:55.203476 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b561577-0bc2-4b77-a0ec-ee71e986fc5f None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:55.236100 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68079c98-1c66-44c5-a41d-4cd5f17512c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:55.236754 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68079c98-1c66-44c5-a41d-4cd5f17512c9 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:55.237037 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68079c98-1c66-44c5-a41d-4cd5f17512c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:55.237206 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d04d60-2f5f-4cb1-a626-d662bdd8c843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:55.237329 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68079c98-1c66-44c5-a41d-4cd5f17512c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:55.237871 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d04d60-2f5f-4cb1-a626-d662bdd8c843 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:55.238138 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68079c98-1c66-44c5-a41d-4cd5f17512c9 None admin] RBAC: Adding query filter params (role.id=c12236aebd8048ba991da4671b44935f, scope.project.id=a478e76f04dd413f89ddfba7b0cdc9cc, user.id=302c0f7dd3bf4829aad0b29bd0c091a5) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:24:55.238267 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d04d60-2f5f-4cb1-a626-d662bdd8c843 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:55.238452 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d04d60-2f5f-4cb1-a626-d662bdd8c843 None admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:55.238555 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68079c98-1c66-44c5-a41d-4cd5f17512c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:55.239329 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d04d60-2f5f-4cb1-a626-d662bdd8c843 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:24:55.239639 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d04d60-2f5f-4cb1-a626-d662bdd8c843 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:55.239972 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68079c98-1c66-44c5-a41d-4cd5f17512c9 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:55.241000 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d04d60-2f5f-4cb1-a626-d662bdd8c843 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:55.246746 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 283/582] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jul 14 09:24:55 2022] GET /identity/v3/role_assignments?user.id=302c0f7dd3bf4829aad0b29bd0c091a5&scope.project.id=a478e76f04dd413f89ddfba7b0cdc9cc&role.id=c12236aebd8048ba991da4671b44935f => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:24:55.247639 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68079c98-1c66-44c5-a41d-4cd5f17512c9 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:55.265648 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 300/583] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 14 09:24:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:24:55.266348 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d04d60-2f5f-4cb1-a626-d662bdd8c843 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:55.288567 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:55.346935 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:55.366843 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68079c98-1c66-44c5-a41d-4cd5f17512c9 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:55.390587 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d04d60-2f5f-4cb1-a626-d662bdd8c843 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:55.408546 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8433a4a5-14cf-44e0-97f6-681ba2df761c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:55.409395 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8433a4a5-14cf-44e0-97f6-681ba2df761c None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:55.409687 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8433a4a5-14cf-44e0-97f6-681ba2df761c None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:55.409967 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8433a4a5-14cf-44e0-97f6-681ba2df761c None admin] PATH_INFO: `/v3/users` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:55.411161 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8433a4a5-14cf-44e0-97f6-681ba2df761c None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:24:55.411478 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8433a4a5-14cf-44e0-97f6-681ba2df761c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:55.413967 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8433a4a5-14cf-44e0-97f6-681ba2df761c None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:55.431465 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208b2f00-edde-45ae-a312-dae5b5af9d52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:55.432399 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208b2f00-edde-45ae-a312-dae5b5af9d52 None admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:55.432682 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208b2f00-edde-45ae-a312-dae5b5af9d52 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:55.432959 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208b2f00-edde-45ae-a312-dae5b5af9d52 None admin] PATH_INFO: `/v3/projects/a478e76f04dd413f89ddfba7b0cdc9cc/users/1f6962106dfa4c4c9af551053f8095e9/roles/c12236aebd8048ba991da4671b44935f` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:55.438647 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 284/584] 10.222.0.40 () {56 vars in 1137 bytes} [Thu Jul 14 09:24:55 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:24:55.438647 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8433a4a5-14cf-44e0-97f6-681ba2df761c None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:55.455860 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208b2f00-edde-45ae-a312-dae5b5af9d52 None admin] RBAC: Authorizing `identity:create_grant(project_id=a478e76f04dd413f89ddfba7b0cdc9cc, user_id=1f6962106dfa4c4c9af551053f8095e9, role_id=c12236aebd8048ba991da4671b44935f)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:55.457306 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208b2f00-edde-45ae-a312-dae5b5af9d52 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:55.482217 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 301/585] 10.222.0.40 () {58 vars in 1439 bytes} [Thu Jul 14 09:24:55 2022] PUT /identity/v3/projects/a478e76f04dd413f89ddfba7b0cdc9cc/users/1f6962106dfa4c4c9af551053f8095e9/roles/c12236aebd8048ba991da4671b44935f => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:24:55.482217 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208b2f00-edde-45ae-a312-dae5b5af9d52 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:55.557454 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:55.598017 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8433a4a5-14cf-44e0-97f6-681ba2df761c None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:55.619096 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208b2f00-edde-45ae-a312-dae5b5af9d52 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:55.643938 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a8122f-614c-4568-b0ba-6c8a74ff71a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:55.644468 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a8122f-614c-4568-b0ba-6c8a74ff71a3 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:55.644858 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a8122f-614c-4568-b0ba-6c8a74ff71a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:55.645246 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a8122f-614c-4568-b0ba-6c8a74ff71a3 None admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:55.646150 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a8122f-614c-4568-b0ba-6c8a74ff71a3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:24:55.646619 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a8122f-614c-4568-b0ba-6c8a74ff71a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:55.648863 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a8122f-614c-4568-b0ba-6c8a74ff71a3 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:55.661321 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 285/586] 10.222.0.40 () {56 vars in 1103 bytes} [Thu Jul 14 09:24:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:24:55.662107 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a8122f-614c-4568-b0ba-6c8a74ff71a3 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:55.662772 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ee5f65-e0f2-4994-a09c-95e5605ccb07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:55.664563 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ee5f65-e0f2-4994-a09c-95e5605ccb07 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:55.665067 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ee5f65-e0f2-4994-a09c-95e5605ccb07 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:55.665538 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ee5f65-e0f2-4994-a09c-95e5605ccb07 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:55.666889 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:55.678477 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ee5f65-e0f2-4994-a09c-95e5605ccb07 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:55.679990 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ee5f65-e0f2-4994-a09c-95e5605ccb07 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:55.697220 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-98ee5f65-e0f2-4994-a09c-95e5605ccb07 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 14 09:24:55.697220 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:24:55.697220 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:24:55.697220 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:24:55.697220 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:24:55.697220 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:24:55.697220 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:24:55.697220 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:24:55.697220 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:24:55.697220 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:24:55.697220 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:24:55.697220 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:24:55.697220 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 09:24:55.697220 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 09:24:55.697220 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 09:24:55.697220 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 09:24:55.698325 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:24:55.698325 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:24:55.698325 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 09:24:55.698325 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 09:24:55.698325 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 09:24:55.698325 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 09:24:55.698325 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:24:55.698325 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:24:55.698325 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:24:55.698325 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:24:55.698325 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:24:55.698325 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( Jul 14 09:24:55.698325 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:24:55.698325 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:24:55.698325 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:24:55.698325 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:24:55.698325 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:24:55.698325 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:24:55.699283 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:24:55.699283 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:24:55.699283 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 09:24:55.699283 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 09:24:55.699283 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 09:24:55.699283 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 09:24:55.699283 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 09:24:55.699283 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 09:24:55.699283 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 14 09:24:55.699283 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Jul 14 09:24:55.699283 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 302/587] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 14 09:24:55 2022] GET /identity/v3/users/cinder => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:24:55.699860 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ee5f65-e0f2-4994-a09c-95e5605ccb07 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:55.817203 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a8122f-614c-4568-b0ba-6c8a74ff71a3 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:55.837586 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ee5f65-e0f2-4994-a09c-95e5605ccb07 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:55.867123 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89142088-d526-468d-b793-321c63d8e09c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:55.868893 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89142088-d526-468d-b793-321c63d8e09c None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:55.869397 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89142088-d526-468d-b793-321c63d8e09c None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:55.870654 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:55.870886 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89142088-d526-468d-b793-321c63d8e09c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:55.886076 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6477cf8-8ddc-4850-a8ff-82338ba29e31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:55.886971 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6477cf8-8ddc-4850-a8ff-82338ba29e31 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:55.887193 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6477cf8-8ddc-4850-a8ff-82338ba29e31 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:55.887471 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6477cf8-8ddc-4850-a8ff-82338ba29e31 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:55.888444 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89142088-d526-468d-b793-321c63d8e09c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:55.890542 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89142088-d526-468d-b793-321c63d8e09c None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:55.900608 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6477cf8-8ddc-4850-a8ff-82338ba29e31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:55.901819 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6477cf8-8ddc-4850-a8ff-82338ba29e31 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:55.914758 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-89142088-d526-468d-b793-321c63d8e09c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:24:55.914758 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:24:55.914758 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:24:55.914758 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:24:55.914758 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:24:55.914758 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:24:55.914758 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:24:55.914758 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:24:55.914758 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:24:55.914758 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:24:55.914758 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:24:55.914758 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:24:55.914758 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 09:24:55.914758 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 09:24:55.914758 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 09:24:55.915708 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 09:24:55.915708 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:24:55.915708 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:24:55.915708 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:24:55.915708 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:24:55.915708 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:24:55.915708 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:24:55.915708 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:24:55.915708 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( Jul 14 09:24:55.915708 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:24:55.915708 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:24:55.915708 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:24:55.915708 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:24:55.915708 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:24:55.915708 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:24:55.915708 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:24:55.915708 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:24:55.916570 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 09:24:55.916570 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 09:24:55.916570 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:24:55.916570 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:24:55.918871 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 286/588] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 09:24:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:24:55.919916 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89142088-d526-468d-b793-321c63d8e09c None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:55.921334 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-d6477cf8-8ddc-4850-a8ff-82338ba29e31 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:24:55.921334 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:24:55.921334 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:24:55.921334 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:24:55.921334 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:24:55.921334 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:24:55.921334 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:24:55.921334 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:24:55.921334 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:24:55.921334 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:24:55.921334 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:24:55.921334 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:24:55.921334 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 09:24:55.921334 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 09:24:55.921334 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 09:24:55.922222 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 09:24:55.922222 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:24:55.922222 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:24:55.922222 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:24:55.922222 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:24:55.922222 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:24:55.922222 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:24:55.922222 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:24:55.922222 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( Jul 14 09:24:55.922222 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:24:55.922222 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:24:55.922222 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:24:55.922222 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:24:55.922222 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:24:55.922222 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:24:55.922222 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:24:55.922222 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:24:55.923138 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 09:24:55.923138 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 09:24:55.923138 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:24:55.923138 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Jul 14 09:24:55.923138 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 303/589] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 09:24:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:24:55.928403 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6477cf8-8ddc-4850-a8ff-82338ba29e31 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:56.002637 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:56.050055 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6477cf8-8ddc-4850-a8ff-82338ba29e31 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:56.062176 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89142088-d526-468d-b793-321c63d8e09c None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:56.086143 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96173198-3502-4a65-bb47-afe57a8e74a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:56.087098 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96173198-3502-4a65-bb47-afe57a8e74a9 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:56.087538 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96173198-3502-4a65-bb47-afe57a8e74a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:56.087957 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96173198-3502-4a65-bb47-afe57a8e74a9 None admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:56.088829 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96173198-3502-4a65-bb47-afe57a8e74a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:24:56.089300 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96173198-3502-4a65-bb47-afe57a8e74a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:56.090864 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96173198-3502-4a65-bb47-afe57a8e74a9 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:56.102336 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13451fdd-615d-4b6f-89dc-ba6767638776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:56.103027 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13451fdd-615d-4b6f-89dc-ba6767638776 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:56.103308 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13451fdd-615d-4b6f-89dc-ba6767638776 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:56.103585 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13451fdd-615d-4b6f-89dc-ba6767638776 None admin] PATH_INFO: `/v3/users` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:56.104443 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13451fdd-615d-4b6f-89dc-ba6767638776 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:24:56.104752 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13451fdd-615d-4b6f-89dc-ba6767638776 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:56.105560 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 304/590] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 14 09:24:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:24:56.106408 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13451fdd-615d-4b6f-89dc-ba6767638776 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:56.106764 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96173198-3502-4a65-bb47-afe57a8e74a9 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:56.131375 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 287/591] 10.222.0.40 () {56 vars in 1137 bytes} [Thu Jul 14 09:24:55 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:24:56.132412 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13451fdd-615d-4b6f-89dc-ba6767638776 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:56.143613 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:56.214686 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96173198-3502-4a65-bb47-afe57a8e74a9 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:56.246502 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13451fdd-615d-4b6f-89dc-ba6767638776 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:56.254241 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec5a599-3c02-4356-9b34-1faf0f258004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:56.255218 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec5a599-3c02-4356-9b34-1faf0f258004 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:56.255647 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec5a599-3c02-4356-9b34-1faf0f258004 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:56.256085 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec5a599-3c02-4356-9b34-1faf0f258004 None admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:56.257104 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec5a599-3c02-4356-9b34-1faf0f258004 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:24:56.257571 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec5a599-3c02-4356-9b34-1faf0f258004 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:56.259197 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec5a599-3c02-4356-9b34-1faf0f258004 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:56.262371 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:56.275823 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 305/592] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 14 09:24:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:24:56.277368 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec5a599-3c02-4356-9b34-1faf0f258004 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:56.287467 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acb2c12-b68a-4c94-ad39-cab357788f4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:56.289483 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acb2c12-b68a-4c94-ad39-cab357788f4c None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:56.289990 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acb2c12-b68a-4c94-ad39-cab357788f4c None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:56.290532 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acb2c12-b68a-4c94-ad39-cab357788f4c None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:56.305343 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acb2c12-b68a-4c94-ad39-cab357788f4c None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:56.308607 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acb2c12-b68a-4c94-ad39-cab357788f4c None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:56.339845 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-0acb2c12-b68a-4c94-ad39-cab357788f4c None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 14 09:24:56.339845 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:24:56.339845 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:24:56.339845 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:24:56.339845 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:24:56.339845 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:24:56.339845 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:24:56.339845 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:24:56.339845 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:24:56.339845 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:24:56.339845 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:24:56.339845 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:24:56.339845 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 09:24:56.339845 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 09:24:56.339845 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 09:24:56.339845 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 09:24:56.341126 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:24:56.341126 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:24:56.341126 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 09:24:56.341126 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 09:24:56.341126 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 09:24:56.341126 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 09:24:56.341126 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:24:56.341126 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:24:56.341126 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:24:56.341126 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:24:56.341126 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:24:56.341126 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( Jul 14 09:24:56.341126 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:24:56.341126 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:24:56.341126 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:24:56.341126 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:24:56.341126 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:24:56.341126 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:24:56.342289 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:24:56.342289 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:24:56.342289 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 09:24:56.342289 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 09:24:56.342289 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 09:24:56.342289 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 09:24:56.342289 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 09:24:56.342289 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 09:24:56.342289 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 14 09:24:56.342289 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:24:56.342820 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 288/593] 10.222.0.40 () {56 vars in 1102 bytes} [Thu Jul 14 09:24:56 2022] GET /identity/v3/users/neutron => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:24:56.343936 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acb2c12-b68a-4c94-ad39-cab357788f4c None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:56.383637 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:56.392475 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec5a599-3c02-4356-9b34-1faf0f258004 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:56.461369 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c590a2da-2c3d-41ce-8fcc-d8d56b4e5453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:56.463081 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c590a2da-2c3d-41ce-8fcc-d8d56b4e5453 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:56.463587 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c590a2da-2c3d-41ce-8fcc-d8d56b4e5453 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:56.464415 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c590a2da-2c3d-41ce-8fcc-d8d56b4e5453 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:56.480788 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c590a2da-2c3d-41ce-8fcc-d8d56b4e5453 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:56.482695 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c590a2da-2c3d-41ce-8fcc-d8d56b4e5453 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:56.489571 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acb2c12-b68a-4c94-ad39-cab357788f4c None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:56.501972 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-c590a2da-2c3d-41ce-8fcc-d8d56b4e5453 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:24:56.501972 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:24:56.501972 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:24:56.501972 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:24:56.501972 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:24:56.501972 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:24:56.501972 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:24:56.501972 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:24:56.501972 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:24:56.501972 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:24:56.501972 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:24:56.501972 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:24:56.501972 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 09:24:56.501972 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 09:24:56.501972 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 09:24:56.503076 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 09:24:56.503076 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:24:56.503076 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:24:56.503076 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:24:56.503076 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:24:56.503076 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:24:56.503076 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:24:56.503076 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:24:56.503076 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( Jul 14 09:24:56.503076 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:24:56.503076 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:24:56.503076 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:24:56.503076 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:24:56.503076 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:24:56.503076 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:24:56.503076 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:24:56.503076 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:24:56.504120 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 09:24:56.504120 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 09:24:56.504120 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:24:56.504120 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Jul 14 09:24:56.510461 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 306/594] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 09:24:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:24:56.511631 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c590a2da-2c3d-41ce-8fcc-d8d56b4e5453 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:56.526912 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cc154c-f414-4884-b7e8-3ecf56b331c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:56.527826 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cc154c-f414-4884-b7e8-3ecf56b331c3 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:56.528110 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cc154c-f414-4884-b7e8-3ecf56b331c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:56.528388 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cc154c-f414-4884-b7e8-3ecf56b331c3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:56.536317 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cc154c-f414-4884-b7e8-3ecf56b331c3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:56.538785 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cc154c-f414-4884-b7e8-3ecf56b331c3 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:56.555125 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-93cc154c-f414-4884-b7e8-3ecf56b331c3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 09:24:56.555125 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:24:56.555125 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:24:56.555125 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:24:56.555125 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:24:56.555125 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:24:56.555125 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:24:56.555125 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:24:56.555125 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:24:56.555125 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:24:56.555125 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:24:56.555125 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:24:56.555125 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 09:24:56.555125 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 09:24:56.555125 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 09:24:56.556238 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 09:24:56.556238 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:24:56.556238 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:24:56.556238 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:24:56.556238 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:24:56.556238 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:24:56.556238 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:24:56.556238 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:24:56.556238 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( Jul 14 09:24:56.556238 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:24:56.556238 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:24:56.556238 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:24:56.556238 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:24:56.556238 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:24:56.556238 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:24:56.556238 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:24:56.556238 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:24:56.557296 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 09:24:56.557296 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 09:24:56.557296 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 09:24:56.557296 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 09:24:56.557296 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 09:24:56.557296 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 09:24:56.557296 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 09:24:56.557296 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:24:56.558722 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 289/595] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jul 14 09:24:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:24:56.559693 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cc154c-f414-4884-b7e8-3ecf56b331c3 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:56.604785 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:56.633593 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c590a2da-2c3d-41ce-8fcc-d8d56b4e5453 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:56.675041 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247dc011-cd60-4898-a5d8-6a5c86527024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:56.675872 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247dc011-cd60-4898-a5d8-6a5c86527024 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:56.676261 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247dc011-cd60-4898-a5d8-6a5c86527024 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:56.676749 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247dc011-cd60-4898-a5d8-6a5c86527024 None admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:56.677742 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247dc011-cd60-4898-a5d8-6a5c86527024 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:24:56.682228 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247dc011-cd60-4898-a5d8-6a5c86527024 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:56.682228 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247dc011-cd60-4898-a5d8-6a5c86527024 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:56.695355 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cc154c-f414-4884-b7e8-3ecf56b331c3 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:56.701689 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 307/596] 10.222.0.40 () {56 vars in 1139 bytes} [Thu Jul 14 09:24:56 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:24:56.702916 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247dc011-cd60-4898-a5d8-6a5c86527024 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:56.715900 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:56.736925 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9661e6c7-3e1d-43e5-acf8-69f26c5a498f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:56.737612 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9661e6c7-3e1d-43e5-acf8-69f26c5a498f None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:56.737896 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9661e6c7-3e1d-43e5-acf8-69f26c5a498f None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:56.738172 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9661e6c7-3e1d-43e5-acf8-69f26c5a498f None admin] PATH_INFO: `/v3/domains` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:56.739104 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9661e6c7-3e1d-43e5-acf8-69f26c5a498f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:24:56.739415 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9661e6c7-3e1d-43e5-acf8-69f26c5a498f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:56.740959 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9661e6c7-3e1d-43e5-acf8-69f26c5a498f None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:56.755861 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 290/597] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 14 09:24:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:24:56.761788 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9661e6c7-3e1d-43e5-acf8-69f26c5a498f None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:56.841939 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247dc011-cd60-4898-a5d8-6a5c86527024 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:56.882998 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0234133f-94fe-4bca-9be9-7c2927f7e6b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:56.884016 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0234133f-94fe-4bca-9be9-7c2927f7e6b7 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:56.884506 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0234133f-94fe-4bca-9be9-7c2927f7e6b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:56.885013 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0234133f-94fe-4bca-9be9-7c2927f7e6b7 None admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:56.886003 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0234133f-94fe-4bca-9be9-7c2927f7e6b7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:24:56.886543 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0234133f-94fe-4bca-9be9-7c2927f7e6b7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:56.888735 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0234133f-94fe-4bca-9be9-7c2927f7e6b7 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:56.896719 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:56.907442 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 308/598] 10.222.0.40 () {56 vars in 1148 bytes} [Thu Jul 14 09:24:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:24:56.908679 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0234133f-94fe-4bca-9be9-7c2927f7e6b7 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:56.910311 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9661e6c7-3e1d-43e5-acf8-69f26c5a498f None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:56.976417 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f1edcd-4d78-4444-a5bf-7db4ffb902f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:56.977753 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f1edcd-4d78-4444-a5bf-7db4ffb902f3 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:56.978320 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f1edcd-4d78-4444-a5bf-7db4ffb902f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:56.978935 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f1edcd-4d78-4444-a5bf-7db4ffb902f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:56.993968 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:56.999895 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f1edcd-4d78-4444-a5bf-7db4ffb902f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:57.004003 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f1edcd-4d78-4444-a5bf-7db4ffb902f3 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:57.041327 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-40f1edcd-4d78-4444-a5bf-7db4ffb902f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:24:57.041327 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:24:57.041327 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:24:57.041327 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:24:57.041327 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:24:57.041327 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:24:57.041327 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:24:57.041327 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:24:57.041327 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:24:57.041327 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:24:57.041327 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:24:57.041327 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:24:57.041327 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 09:24:57.041327 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 09:24:57.041327 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 09:24:57.042310 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 09:24:57.042310 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:24:57.042310 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:24:57.042310 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:24:57.042310 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:24:57.042310 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:24:57.042310 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:24:57.042310 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:24:57.042310 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( Jul 14 09:24:57.042310 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:24:57.042310 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:24:57.042310 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:24:57.042310 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:24:57.042310 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:24:57.042310 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:24:57.042310 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:24:57.042310 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:24:57.043199 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 09:24:57.043199 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 09:24:57.043199 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:24:57.043199 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:24:57.043423 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0234133f-94fe-4bca-9be9-7c2927f7e6b7 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:57.043498 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 291/599] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 09:24:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:24:57.045054 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f1edcd-4d78-4444-a5bf-7db4ffb902f3 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:57.089452 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01536fc-4fbe-4bad-9667-95c27418ff5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:57.090919 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01536fc-4fbe-4bad-9667-95c27418ff5e None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:57.091211 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01536fc-4fbe-4bad-9667-95c27418ff5e None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:57.091495 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01536fc-4fbe-4bad-9667-95c27418ff5e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:57.101377 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01536fc-4fbe-4bad-9667-95c27418ff5e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:57.103127 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01536fc-4fbe-4bad-9667-95c27418ff5e None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:57.120112 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-f01536fc-4fbe-4bad-9667-95c27418ff5e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 09:24:57.120112 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:24:57.120112 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:24:57.120112 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:24:57.120112 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:24:57.120112 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:24:57.120112 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:24:57.120112 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:24:57.120112 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:24:57.120112 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:24:57.120112 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:24:57.120112 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:24:57.120112 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 09:24:57.120112 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 09:24:57.120112 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 09:24:57.122486 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 09:24:57.122486 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:24:57.122486 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:24:57.122486 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:24:57.122486 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:24:57.122486 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:24:57.122486 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:24:57.122486 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:24:57.122486 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( Jul 14 09:24:57.122486 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:24:57.122486 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:24:57.122486 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:24:57.122486 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:24:57.122486 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:24:57.122486 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:24:57.122486 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:24:57.122486 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:24:57.124199 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 09:24:57.124199 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 09:24:57.124199 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 09:24:57.124199 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 09:24:57.124199 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 09:24:57.124199 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 09:24:57.124199 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 09:24:57.124199 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Jul 14 09:24:57.124199 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 309/600] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jul 14 09:24:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:24:57.124199 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01536fc-4fbe-4bad-9667-95c27418ff5e None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:57.219992 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f1edcd-4d78-4444-a5bf-7db4ffb902f3 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:57.263189 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba99e471-5875-4a3a-9be6-89fa9ca5f999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:57.264261 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba99e471-5875-4a3a-9be6-89fa9ca5f999 None admin] REQUEST_METHOD: `PUT` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:57.264810 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba99e471-5875-4a3a-9be6-89fa9ca5f999 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:57.265217 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba99e471-5875-4a3a-9be6-89fa9ca5f999 None admin] PATH_INFO: `/v3/projects/a478e76f04dd413f89ddfba7b0cdc9cc/users/7ba461800d6845e6a767c83777ae5213/roles/c12236aebd8048ba991da4671b44935f` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:57.283997 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba99e471-5875-4a3a-9be6-89fa9ca5f999 None admin] RBAC: Authorizing `identity:create_grant(project_id=a478e76f04dd413f89ddfba7b0cdc9cc, user_id=7ba461800d6845e6a767c83777ae5213, role_id=c12236aebd8048ba991da4671b44935f)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:57.285805 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba99e471-5875-4a3a-9be6-89fa9ca5f999 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:57.289817 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:57.292091 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01536fc-4fbe-4bad-9667-95c27418ff5e None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:57.312182 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 292/601] 10.222.0.40 () {58 vars in 1439 bytes} [Thu Jul 14 09:24:57 2022] PUT /identity/v3/projects/a478e76f04dd413f89ddfba7b0cdc9cc/users/7ba461800d6845e6a767c83777ae5213/roles/c12236aebd8048ba991da4671b44935f => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:24:57.312807 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba99e471-5875-4a3a-9be6-89fa9ca5f999 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:57.381063 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:57.417108 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf74610-e23f-4dcb-a309-800df38200f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:57.418740 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf74610-e23f-4dcb-a309-800df38200f2 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:57.419230 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf74610-e23f-4dcb-a309-800df38200f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:57.421687 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf74610-e23f-4dcb-a309-800df38200f2 None admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:57.424641 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf74610-e23f-4dcb-a309-800df38200f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:24:57.425197 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf74610-e23f-4dcb-a309-800df38200f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:57.430157 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf74610-e23f-4dcb-a309-800df38200f2 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:57.458468 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 310/602] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 14 09:24:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:24:57.466506 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf74610-e23f-4dcb-a309-800df38200f2 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:57.584912 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba99e471-5875-4a3a-9be6-89fa9ca5f999 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:57.636775 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf74610-e23f-4dcb-a309-800df38200f2 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:57.653995 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258f1252-2e45-4632-a9d6-964c59b401d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:57.655516 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258f1252-2e45-4632-a9d6-964c59b401d1 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:57.656237 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258f1252-2e45-4632-a9d6-964c59b401d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:57.656948 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258f1252-2e45-4632-a9d6-964c59b401d1 None admin] PATH_INFO: `/v3/projects` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:57.659697 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258f1252-2e45-4632-a9d6-964c59b401d1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:24:57.660478 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258f1252-2e45-4632-a9d6-964c59b401d1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:57.664130 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258f1252-2e45-4632-a9d6-964c59b401d1 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:57.674537 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813e0004-d0ca-46dc-af11-63272172fa77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:57.675448 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813e0004-d0ca-46dc-af11-63272172fa77 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:57.675798 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813e0004-d0ca-46dc-af11-63272172fa77 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:57.676141 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813e0004-d0ca-46dc-af11-63272172fa77 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:57.684401 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813e0004-d0ca-46dc-af11-63272172fa77 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:57.685997 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813e0004-d0ca-46dc-af11-63272172fa77 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:57.690017 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 293/603] 10.222.0.40 () {56 vars in 1148 bytes} [Thu Jul 14 09:24:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 378 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:24:57.699195 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258f1252-2e45-4632-a9d6-964c59b401d1 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:57.709366 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-813e0004-d0ca-46dc-af11-63272172fa77 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 09:24:57.709366 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:24:57.709366 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:24:57.709366 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:24:57.709366 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:24:57.709366 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:24:57.709366 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:24:57.709366 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:24:57.709366 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:24:57.709366 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:24:57.709366 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:24:57.709366 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:24:57.709366 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 09:24:57.709366 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 09:24:57.709366 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 09:24:57.710543 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 09:24:57.710543 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:24:57.710543 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:24:57.710543 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:24:57.710543 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:24:57.710543 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:24:57.710543 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:24:57.710543 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:24:57.710543 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( Jul 14 09:24:57.710543 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:24:57.710543 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:24:57.710543 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:24:57.710543 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:24:57.710543 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:24:57.710543 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:24:57.710543 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:24:57.710543 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:24:57.711632 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 09:24:57.711632 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 09:24:57.711632 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 09:24:57.711632 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 09:24:57.711632 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 09:24:57.711632 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 09:24:57.711632 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 09:24:57.711632 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Jul 14 09:24:57.714915 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 311/604] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jul 14 09:24:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 09:24:57.717060 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2c4ab0-c866-406c-adeb-f00ca868e775 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:57.717494 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2c4ab0-c866-406c-adeb-f00ca868e775 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:57.717969 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2c4ab0-c866-406c-adeb-f00ca868e775 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:57.719831 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 312/605] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:24:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:24:57.720695 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2c4ab0-c866-406c-adeb-f00ca868e775 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:57.780166 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:57.784704 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:57.828729 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258f1252-2e45-4632-a9d6-964c59b401d1 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:57.843297 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2c4ab0-c866-406c-adeb-f00ca868e775 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:57.865269 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9703cd8d-36ab-4fbb-a998-ebd4510bd92b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:57.866217 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9703cd8d-36ab-4fbb-a998-ebd4510bd92b None admin] REQUEST_METHOD: `PUT` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:57.866568 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9703cd8d-36ab-4fbb-a998-ebd4510bd92b None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:57.866884 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9703cd8d-36ab-4fbb-a998-ebd4510bd92b None admin] PATH_INFO: `/v3/projects/a478e76f04dd413f89ddfba7b0cdc9cc/users/25048b29787d482783ebc944f1a7df65/roles/c12236aebd8048ba991da4671b44935f` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:57.881795 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd11261-68d5-41fe-ae6e-07c27ec420ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:57.882496 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd11261-68d5-41fe-ae6e-07c27ec420ee None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:57.882627 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9703cd8d-36ab-4fbb-a998-ebd4510bd92b None admin] RBAC: Authorizing `identity:create_grant(project_id=a478e76f04dd413f89ddfba7b0cdc9cc, user_id=25048b29787d482783ebc944f1a7df65, role_id=c12236aebd8048ba991da4671b44935f)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:57.882808 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd11261-68d5-41fe-ae6e-07c27ec420ee None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:57.883048 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd11261-68d5-41fe-ae6e-07c27ec420ee None admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:57.884013 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd11261-68d5-41fe-ae6e-07c27ec420ee None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:24:57.884113 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9703cd8d-36ab-4fbb-a998-ebd4510bd92b None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:57.884322 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd11261-68d5-41fe-ae6e-07c27ec420ee None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:57.885723 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd11261-68d5-41fe-ae6e-07c27ec420ee None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:57.899613 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 313/606] 10.222.0.40 () {56 vars in 1148 bytes} [Thu Jul 14 09:24:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:24:57.900702 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205edc22-ad43-41ee-bec7-76b7ed1a18b6 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:57.901012 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205edc22-ad43-41ee-bec7-76b7ed1a18b6 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:57.901278 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205edc22-ad43-41ee-bec7-76b7ed1a18b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:57.904413 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 294/607] 10.222.0.40 () {58 vars in 1439 bytes} [Thu Jul 14 09:24:57 2022] PUT /identity/v3/projects/a478e76f04dd413f89ddfba7b0cdc9cc/users/25048b29787d482783ebc944f1a7df65/roles/c12236aebd8048ba991da4671b44935f => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:24:57.905790 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c942e9e2-b903-4439-9f52-817edd523c9d None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:57.906213 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c942e9e2-b903-4439-9f52-817edd523c9d None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:57.906383 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c942e9e2-b903-4439-9f52-817edd523c9d None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:57.907731 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 295/608] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:24:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:24:57.908320 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c942e9e2-b903-4439-9f52-817edd523c9d None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:57.924306 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-205edc22-ad43-41ee-bec7-76b7ed1a18b6 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:24:57.925560 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-205edc22-ad43-41ee-bec7-76b7ed1a18b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:24:58.009482 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 314/609] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:24:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 09:24:58.010900 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15999725-0197-479f-a57a-09611a159c11 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:58.011193 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15999725-0197-479f-a57a-09611a159c11 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:58.011474 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15999725-0197-479f-a57a-09611a159c11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:58.030489 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-15999725-0197-479f-a57a-09611a159c11 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:24:58.031717 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-15999725-0197-479f-a57a-09611a159c11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:24:58.072419 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:58.082900 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c942e9e2-b903-4439-9f52-817edd523c9d None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:58.094785 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:58.127328 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 315/610] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:24:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 09:24:58.128401 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15999725-0197-479f-a57a-09611a159c11 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:58.148533 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f84cc9-8487-421b-9883-f1d7d651818d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:58.149865 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f84cc9-8487-421b-9883-f1d7d651818d None admin] REQUEST_METHOD: `PUT` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:58.150251 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f84cc9-8487-421b-9883-f1d7d651818d None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:58.150542 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f84cc9-8487-421b-9883-f1d7d651818d None admin] PATH_INFO: `/v3/projects/a478e76f04dd413f89ddfba7b0cdc9cc/users/65e4a5a8965e4802a9055d332179b7a8/roles/c12236aebd8048ba991da4671b44935f` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:58.174429 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f84cc9-8487-421b-9883-f1d7d651818d None admin] RBAC: Authorizing `identity:create_grant(project_id=a478e76f04dd413f89ddfba7b0cdc9cc, user_id=65e4a5a8965e4802a9055d332179b7a8, role_id=c12236aebd8048ba991da4671b44935f)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:58.175945 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f84cc9-8487-421b-9883-f1d7d651818d None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:58.202202 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 296/611] 10.222.0.40 () {58 vars in 1439 bytes} [Thu Jul 14 09:24:57 2022] PUT /identity/v3/projects/a478e76f04dd413f89ddfba7b0cdc9cc/users/65e4a5a8965e4802a9055d332179b7a8/roles/c12236aebd8048ba991da4671b44935f => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:24:58.204070 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f84cc9-8487-421b-9883-f1d7d651818d None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:58.254814 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15999725-0197-479f-a57a-09611a159c11 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:58.296654 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f47867-6afb-4d7c-94de-b4fc167a3d8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:58.297575 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f47867-6afb-4d7c-94de-b4fc167a3d8b None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:58.297864 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f47867-6afb-4d7c-94de-b4fc167a3d8b None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:58.298140 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f47867-6afb-4d7c-94de-b4fc167a3d8b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:58.311112 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f47867-6afb-4d7c-94de-b4fc167a3d8b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:24:58.320064 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-03f47867-6afb-4d7c-94de-b4fc167a3d8b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 09:24:58.320064 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:24:58.320064 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:24:58.320064 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:24:58.320064 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:24:58.320064 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:24:58.320064 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:24:58.320064 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:24:58.320064 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:24:58.320064 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:24:58.320064 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:24:58.320064 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:24:58.320064 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:24:58.320064 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:24:58.320064 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:24:58.320064 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:24:58.321007 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:24:58.321007 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:24:58.321007 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:24:58.321007 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:24:58.321007 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:24:58.321007 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:24:58.321007 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:24:58.321007 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:24:58.321007 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:24:58.321007 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:24:58.321007 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:24:58.321007 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( Jul 14 09:24:58.321007 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:24:58.321007 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:24:58.321007 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:24:58.321007 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:24:58.321804 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:24:58.321804 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:24:58.321804 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:24:58.321804 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:24:58.321804 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:24:58.321804 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:24:58.321804 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:24:58.321804 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:24:58.321804 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:24:58.321804 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:24:58.321804 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 09:24:58.321804 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Jul 14 09:24:58.321804 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 316/612] 10.222.0.40 () {56 vars in 1102 bytes} [Thu Jul 14 09:24:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:24:58.326979 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f84cc9-8487-421b-9883-f1d7d651818d None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:58.331576 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f47867-6afb-4d7c-94de-b4fc167a3d8b None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:58.366514 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b19021d-b674-4b58-bfea-2fa75db855b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:58.367263 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b19021d-b674-4b58-bfea-2fa75db855b7 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:58.367854 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b19021d-b674-4b58-bfea-2fa75db855b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:58.368132 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b19021d-b674-4b58-bfea-2fa75db855b7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:58.379796 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:58.380844 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b19021d-b674-4b58-bfea-2fa75db855b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:24:58.389721 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-2b19021d-b674-4b58-bfea-2fa75db855b7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 09:24:58.389721 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:24:58.389721 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:24:58.389721 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:24:58.389721 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:24:58.389721 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:24:58.389721 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:24:58.389721 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:24:58.389721 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:24:58.389721 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:24:58.389721 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:24:58.389721 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:24:58.389721 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:24:58.389721 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:24:58.389721 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:24:58.389721 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:24:58.391939 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:24:58.391939 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:24:58.391939 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:24:58.391939 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:24:58.391939 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:24:58.391939 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:24:58.391939 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:24:58.391939 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:24:58.391939 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:24:58.391939 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:24:58.391939 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:24:58.391939 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( Jul 14 09:24:58.391939 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:24:58.391939 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:24:58.391939 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:24:58.391939 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:24:58.393202 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:24:58.393202 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:24:58.393202 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:24:58.393202 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:24:58.393202 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:24:58.393202 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:24:58.393202 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:24:58.393202 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:24:58.393202 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:24:58.393202 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:24:58.393202 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 09:24:58.393202 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:24:58.393202 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 297/613] 10.222.0.40 () {56 vars in 1102 bytes} [Thu Jul 14 09:24:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:24:58.398511 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b19021d-b674-4b58-bfea-2fa75db855b7 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:58.438719 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:58.526801 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f47867-6afb-4d7c-94de-b4fc167a3d8b None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:58.580699 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b19021d-b674-4b58-bfea-2fa75db855b7 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:58.587860 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7b31e1-a5e8-4636-859c-cd1b5ccabc6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:58.589099 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7b31e1-a5e8-4636-859c-cd1b5ccabc6c None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:58.589617 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7b31e1-a5e8-4636-859c-cd1b5ccabc6c None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:58.590101 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7b31e1-a5e8-4636-859c-cd1b5ccabc6c None admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:58.591262 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7b31e1-a5e8-4636-859c-cd1b5ccabc6c None admin] RBAC: Adding query filter params (name=service) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:24:58.591777 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7b31e1-a5e8-4636-859c-cd1b5ccabc6c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:58.593845 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7b31e1-a5e8-4636-859c-cd1b5ccabc6c None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:58.604111 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 317/614] 10.222.0.40 () {56 vars in 1103 bytes} [Thu Jul 14 09:24:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:24:58.611514 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7b31e1-a5e8-4636-859c-cd1b5ccabc6c None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:58.638953 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3a16cc-7c36-4b9f-8348-718e8cc5880f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:58.640226 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3a16cc-7c36-4b9f-8348-718e8cc5880f None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:58.640776 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3a16cc-7c36-4b9f-8348-718e8cc5880f None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:58.641981 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3a16cc-7c36-4b9f-8348-718e8cc5880f None admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:58.643283 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3a16cc-7c36-4b9f-8348-718e8cc5880f None admin] RBAC: Adding query filter params (name=service) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:24:58.644648 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3a16cc-7c36-4b9f-8348-718e8cc5880f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:58.646432 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3a16cc-7c36-4b9f-8348-718e8cc5880f None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:58.663822 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 298/615] 10.222.0.40 () {56 vars in 1103 bytes} [Thu Jul 14 09:24:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:24:58.669351 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3a16cc-7c36-4b9f-8348-718e8cc5880f None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:58.793975 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:58.824169 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7b31e1-a5e8-4636-859c-cd1b5ccabc6c None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:58.828645 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:58.877546 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3a16cc-7c36-4b9f-8348-718e8cc5880f None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:58.892781 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee82871-f15d-4fd6-b809-562250fa3035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:58.893871 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee82871-f15d-4fd6-b809-562250fa3035 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:58.894364 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee82871-f15d-4fd6-b809-562250fa3035 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:58.894980 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee82871-f15d-4fd6-b809-562250fa3035 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:58.916495 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee82871-f15d-4fd6-b809-562250fa3035 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:58.919921 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee82871-f15d-4fd6-b809-562250fa3035 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:58.948742 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7351e950-6cb0-49c0-91c6-3ed302921f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:58.949837 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7351e950-6cb0-49c0-91c6-3ed302921f65 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:58.950344 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7351e950-6cb0-49c0-91c6-3ed302921f65 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:58.950797 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7351e950-6cb0-49c0-91c6-3ed302921f65 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:58.956209 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-1ee82871-f15d-4fd6-b809-562250fa3035 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:24:58.956209 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:24:58.956209 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:24:58.956209 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:24:58.956209 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:24:58.956209 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:24:58.956209 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:24:58.956209 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:24:58.956209 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:24:58.956209 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:24:58.956209 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:24:58.956209 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:24:58.956209 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 09:24:58.956209 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 09:24:58.956209 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 09:24:58.957079 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 09:24:58.957079 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:24:58.957079 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:24:58.957079 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:24:58.957079 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:24:58.957079 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:24:58.957079 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:24:58.957079 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:24:58.957079 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( Jul 14 09:24:58.957079 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:24:58.957079 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:24:58.957079 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:24:58.957079 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:24:58.957079 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:24:58.957079 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:24:58.957079 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:24:58.957079 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:24:58.957956 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 09:24:58.957956 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 09:24:58.957956 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:24:58.957956 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Jul 14 09:24:58.960249 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 318/616] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 09:24:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 351 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 09:24:58.966204 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee82871-f15d-4fd6-b809-562250fa3035 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:58.966358 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7351e950-6cb0-49c0-91c6-3ed302921f65 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:58.967716 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7351e950-6cb0-49c0-91c6-3ed302921f65 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:58.993487 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-7351e950-6cb0-49c0-91c6-3ed302921f65 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:24:58.993487 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:24:58.993487 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:24:58.993487 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:24:58.993487 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:24:58.993487 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:24:58.993487 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:24:58.993487 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:24:58.993487 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:24:58.993487 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:24:58.993487 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:24:58.993487 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:24:58.993487 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 09:24:58.993487 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 09:24:58.993487 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 09:24:58.994513 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 09:24:58.994513 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:24:58.994513 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:24:58.994513 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:24:58.994513 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:24:58.994513 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:24:58.994513 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:24:58.994513 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:24:58.994513 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( Jul 14 09:24:58.994513 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:24:58.994513 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:24:58.994513 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:24:58.994513 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:24:58.994513 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:24:58.994513 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:24:58.994513 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:24:58.994513 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:24:58.995388 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 09:24:58.995388 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 09:24:58.995388 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:24:58.995388 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:24:58.995388 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 299/617] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 09:24:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:24:59.000450 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7351e950-6cb0-49c0-91c6-3ed302921f65 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:59.110108 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7351e950-6cb0-49c0-91c6-3ed302921f65 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:59.129428 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee82871-f15d-4fd6-b809-562250fa3035 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:59.148787 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:59.161283 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53a3af7-7a91-4f24-a19c-935cd59a48d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:59.161957 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53a3af7-7a91-4f24-a19c-935cd59a48d0 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:59.162264 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53a3af7-7a91-4f24-a19c-935cd59a48d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:59.162542 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53a3af7-7a91-4f24-a19c-935cd59a48d0 None admin] PATH_INFO: `/v3/domains` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:59.163857 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53a3af7-7a91-4f24-a19c-935cd59a48d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:24:59.164168 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53a3af7-7a91-4f24-a19c-935cd59a48d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:59.166837 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53a3af7-7a91-4f24-a19c-935cd59a48d0 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:59.187277 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 300/618] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 14 09:24:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:24:59.193275 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53a3af7-7a91-4f24-a19c-935cd59a48d0 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:59.208379 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aef2c94-e61e-412d-a32d-5729226a2809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:59.209055 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aef2c94-e61e-412d-a32d-5729226a2809 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:59.209338 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aef2c94-e61e-412d-a32d-5729226a2809 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:59.209641 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aef2c94-e61e-412d-a32d-5729226a2809 None admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:59.210422 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aef2c94-e61e-412d-a32d-5729226a2809 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:24:59.210724 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aef2c94-e61e-412d-a32d-5729226a2809 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:59.212099 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aef2c94-e61e-412d-a32d-5729226a2809 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:59.233038 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 319/619] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 14 09:24:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:24:59.233673 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:59.241861 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aef2c94-e61e-412d-a32d-5729226a2809 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:59.328253 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53a3af7-7a91-4f24-a19c-935cd59a48d0 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:59.365974 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c6cff3-3ebf-4ef6-8be8-bb3808f4dfa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:59.367167 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c6cff3-3ebf-4ef6-8be8-bb3808f4dfa4 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:59.367911 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c6cff3-3ebf-4ef6-8be8-bb3808f4dfa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:59.368464 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c6cff3-3ebf-4ef6-8be8-bb3808f4dfa4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:59.376310 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c6cff3-3ebf-4ef6-8be8-bb3808f4dfa4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:59.378000 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c6cff3-3ebf-4ef6-8be8-bb3808f4dfa4 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:59.393592 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-59c6cff3-3ebf-4ef6-8be8-bb3808f4dfa4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 14 09:24:59.393592 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:24:59.393592 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:24:59.393592 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:24:59.393592 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:24:59.393592 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:24:59.393592 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:24:59.393592 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:24:59.393592 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:24:59.393592 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:24:59.393592 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:24:59.393592 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:24:59.393592 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 09:24:59.393592 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 09:24:59.393592 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 09:24:59.393592 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 09:24:59.394747 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:24:59.394747 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:24:59.394747 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 09:24:59.394747 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 09:24:59.394747 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 09:24:59.394747 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 09:24:59.394747 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:24:59.394747 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:24:59.394747 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:24:59.394747 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:24:59.394747 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:24:59.394747 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( Jul 14 09:24:59.394747 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:24:59.394747 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:24:59.394747 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:24:59.394747 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:24:59.394747 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:24:59.394747 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:24:59.395709 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:24:59.395709 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:24:59.395709 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 09:24:59.395709 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 09:24:59.395709 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 09:24:59.395709 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 09:24:59.395709 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 09:24:59.395709 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 09:24:59.395709 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 14 09:24:59.395709 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:24:59.399110 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 301/620] 10.222.0.40 () {56 vars in 1093 bytes} [Thu Jul 14 09:24:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:24:59.405293 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c6cff3-3ebf-4ef6-8be8-bb3808f4dfa4 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:59.448792 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aef2c94-e61e-412d-a32d-5729226a2809 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:59.490581 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:59.551649 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c6cff3-3ebf-4ef6-8be8-bb3808f4dfa4 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:59.589072 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21cd48e-7b14-4cd9-beef-6072fe269956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:59.590173 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21cd48e-7b14-4cd9-beef-6072fe269956 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:59.590715 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21cd48e-7b14-4cd9-beef-6072fe269956 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:59.591241 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21cd48e-7b14-4cd9-beef-6072fe269956 None admin] PATH_INFO: `/v3/users` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:59.592278 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21cd48e-7b14-4cd9-beef-6072fe269956 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:24:59.592785 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21cd48e-7b14-4cd9-beef-6072fe269956 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:59.594524 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21cd48e-7b14-4cd9-beef-6072fe269956 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:59.607334 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495af827-0aea-44a5-baa8-1408e97ccea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:59.608733 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495af827-0aea-44a5-baa8-1408e97ccea5 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:59.609234 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495af827-0aea-44a5-baa8-1408e97ccea5 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:59.609738 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495af827-0aea-44a5-baa8-1408e97ccea5 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:59.614850 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 302/621] 10.222.0.40 () {56 vars in 1133 bytes} [Thu Jul 14 09:24:59 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:24:59.622261 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21cd48e-7b14-4cd9-beef-6072fe269956 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:59.634910 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495af827-0aea-44a5-baa8-1408e97ccea5 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:59.636365 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495af827-0aea-44a5-baa8-1408e97ccea5 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:59.665766 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-495af827-0aea-44a5-baa8-1408e97ccea5 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 14 09:24:59.665766 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:24:59.665766 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:24:59.665766 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:24:59.665766 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:24:59.665766 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:24:59.665766 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:24:59.665766 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:24:59.665766 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:24:59.665766 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:24:59.665766 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:24:59.665766 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:24:59.665766 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 09:24:59.665766 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 09:24:59.665766 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 09:24:59.665766 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 09:24:59.667905 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:24:59.667905 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:24:59.667905 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 09:24:59.667905 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 09:24:59.667905 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 09:24:59.667905 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 09:24:59.667905 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:24:59.667905 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:24:59.667905 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:24:59.667905 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:24:59.667905 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:24:59.667905 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( Jul 14 09:24:59.667905 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:24:59.667905 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:24:59.667905 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:24:59.667905 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:24:59.667905 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:24:59.667905 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:24:59.669862 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:24:59.669862 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:24:59.669862 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 09:24:59.669862 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 09:24:59.669862 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 09:24:59.669862 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 09:24:59.669862 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 09:24:59.669862 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 09:24:59.669862 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 14 09:24:59.669862 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Jul 14 09:24:59.669862 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 320/622] 10.222.0.40 () {56 vars in 1096 bytes} [Thu Jul 14 09:24:59 2022] GET /identity/v3/users/swift => generated 83 bytes in 428 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:24:59.675067 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495af827-0aea-44a5-baa8-1408e97ccea5 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:59.783312 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:59.800066 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21cd48e-7b14-4cd9-beef-6072fe269956 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:59.812613 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:24:59.831813 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495af827-0aea-44a5-baa8-1408e97ccea5 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:24:59.848043 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c6bfa4-d80a-4a3a-9d66-6dadb688aa19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:59.849631 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c6bfa4-d80a-4a3a-9d66-6dadb688aa19 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:59.850259 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c6bfa4-d80a-4a3a-9d66-6dadb688aa19 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:59.850729 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c6bfa4-d80a-4a3a-9d66-6dadb688aa19 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:59.871332 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3efee5-7c50-462a-86e8-1e2111ec28d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:24:59.872137 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3efee5-7c50-462a-86e8-1e2111ec28d1 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:59.872491 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3efee5-7c50-462a-86e8-1e2111ec28d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:59.872845 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3efee5-7c50-462a-86e8-1e2111ec28d1 None admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:59.873781 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3efee5-7c50-462a-86e8-1e2111ec28d1 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:24:59.874173 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3efee5-7c50-462a-86e8-1e2111ec28d1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:59.877015 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3efee5-7c50-462a-86e8-1e2111ec28d1 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:24:59.896907 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 321/623] 10.222.0.40 () {56 vars in 1135 bytes} [Thu Jul 14 09:24:59 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:24:59.899128 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4731319f-48df-4b66-ae35-8edda6e9b944 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:24:59.899639 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4731319f-48df-4b66-ae35-8edda6e9b944 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:24:59.899996 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4731319f-48df-4b66-ae35-8edda6e9b944 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:24:59.905747 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 322/624] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:24:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:24:59.906717 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4731319f-48df-4b66-ae35-8edda6e9b944 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:24:59.941950 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c6bfa4-d80a-4a3a-9d66-6dadb688aa19 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:24:59.943573 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c6bfa4-d80a-4a3a-9d66-6dadb688aa19 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:00.023296 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4731319f-48df-4b66-ae35-8edda6e9b944 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:00.044769 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:00.054321 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 303/625] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 14 09:24:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 14 09:25:00.055847 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb42eb6a-db3b-4a37-886e-25f2ddd88353 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:00.056145 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb42eb6a-db3b-4a37-886e-25f2ddd88353 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:00.056423 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb42eb6a-db3b-4a37-886e-25f2ddd88353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:00.066168 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95c3442-5e46-4afe-ad57-54525f500455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:00.067377 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95c3442-5e46-4afe-ad57-54525f500455 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:00.067849 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95c3442-5e46-4afe-ad57-54525f500455 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:00.068310 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95c3442-5e46-4afe-ad57-54525f500455 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:00.073366 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-bb42eb6a-db3b-4a37-886e-25f2ddd88353 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:25:00.074702 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-bb42eb6a-db3b-4a37-886e-25f2ddd88353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:00.076749 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:00.081127 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95c3442-5e46-4afe-ad57-54525f500455 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:00.082871 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95c3442-5e46-4afe-ad57-54525f500455 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:00.104600 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-b95c3442-5e46-4afe-ad57-54525f500455 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:25:00.104600 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:25:00.104600 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:25:00.104600 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:25:00.104600 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:25:00.104600 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:25:00.104600 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:25:00.104600 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:25:00.104600 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:25:00.104600 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:25:00.104600 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:25:00.104600 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:25:00.104600 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 09:25:00.104600 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 09:25:00.104600 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 09:25:00.105549 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 09:25:00.105549 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:25:00.105549 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:25:00.105549 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:25:00.105549 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:25:00.105549 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:25:00.105549 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:25:00.105549 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:25:00.105549 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( Jul 14 09:25:00.105549 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:25:00.105549 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:25:00.105549 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:25:00.105549 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:25:00.105549 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:25:00.105549 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:25:00.105549 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:25:00.105549 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:25:00.106469 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 09:25:00.106469 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 09:25:00.106469 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:25:00.106469 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Jul 14 09:25:00.108882 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 323/626] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 09:24:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:25:00.109938 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95c3442-5e46-4afe-ad57-54525f500455 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:00.158212 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 304/627] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:25:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 09:25:00.158212 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb42eb6a-db3b-4a37-886e-25f2ddd88353 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:00.257035 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95c3442-5e46-4afe-ad57-54525f500455 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:00.257744 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb42eb6a-db3b-4a37-886e-25f2ddd88353 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:00.293473 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aeb1f07-1587-4c99-a968-0da5876071f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:00.294149 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeb1f07-1587-4c99-a968-0da5876071f0 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:00.294456 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeb1f07-1587-4c99-a968-0da5876071f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:00.294733 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeb1f07-1587-4c99-a968-0da5876071f0 None admin] PATH_INFO: `/v3/domains` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:00.295667 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aeb1f07-1587-4c99-a968-0da5876071f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:00.295977 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aeb1f07-1587-4c99-a968-0da5876071f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:00.297104 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7967105-c08a-4fd1-b6fb-b1ac6fe32333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:00.297455 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aeb1f07-1587-4c99-a968-0da5876071f0 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:00.298392 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7967105-c08a-4fd1-b6fb-b1ac6fe32333 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:00.298991 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7967105-c08a-4fd1-b6fb-b1ac6fe32333 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:00.299484 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7967105-c08a-4fd1-b6fb-b1ac6fe32333 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:00.304345 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:00.310767 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 305/628] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 14 09:25:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:25:00.313149 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7967105-c08a-4fd1-b6fb-b1ac6fe32333 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:00.315014 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7967105-c08a-4fd1-b6fb-b1ac6fe32333 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:00.316042 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aeb1f07-1587-4c99-a968-0da5876071f0 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:00.336030 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-d7967105-c08a-4fd1-b6fb-b1ac6fe32333 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:25:00.336030 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:25:00.336030 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:25:00.336030 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:25:00.336030 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:25:00.336030 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:25:00.336030 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:25:00.336030 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:25:00.336030 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:25:00.336030 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:25:00.336030 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:25:00.336030 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:25:00.336030 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 09:25:00.336030 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 09:25:00.336030 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 09:25:00.336971 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 09:25:00.336971 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:25:00.336971 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:25:00.336971 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:25:00.336971 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:25:00.336971 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:25:00.336971 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:25:00.336971 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:25:00.336971 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( Jul 14 09:25:00.336971 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:25:00.336971 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:25:00.336971 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:25:00.336971 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:25:00.336971 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:25:00.336971 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:25:00.336971 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:25:00.336971 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:25:00.337935 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 09:25:00.337935 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 09:25:00.337935 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:25:00.337935 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Jul 14 09:25:00.341474 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 324/629] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 09:25:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:25:00.342921 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7967105-c08a-4fd1-b6fb-b1ac6fe32333 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:00.371250 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:00.422572 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aeb1f07-1587-4c99-a968-0da5876071f0 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:00.457639 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1587d9-3013-4d28-8b48-a2893d91a72e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:00.458521 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1587d9-3013-4d28-8b48-a2893d91a72e None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:00.458809 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1587d9-3013-4d28-8b48-a2893d91a72e None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:00.459086 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1587d9-3013-4d28-8b48-a2893d91a72e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:00.461426 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7967105-c08a-4fd1-b6fb-b1ac6fe32333 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:00.470459 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1587d9-3013-4d28-8b48-a2893d91a72e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:25:00.478544 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-7d1587d9-3013-4d28-8b48-a2893d91a72e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 09:25:00.478544 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:25:00.478544 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:25:00.478544 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:25:00.478544 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:25:00.478544 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:25:00.478544 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:25:00.478544 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:25:00.478544 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:25:00.478544 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:25:00.478544 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:25:00.478544 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:25:00.478544 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:25:00.478544 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:25:00.478544 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:25:00.478544 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:25:00.479473 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:25:00.479473 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:25:00.479473 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:25:00.479473 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:25:00.479473 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:25:00.479473 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:25:00.479473 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:25:00.479473 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:25:00.479473 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:25:00.479473 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:25:00.479473 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:25:00.479473 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( Jul 14 09:25:00.479473 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:25:00.479473 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:25:00.479473 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:25:00.479473 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:25:00.485570 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:25:00.485570 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:25:00.485570 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:25:00.485570 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:25:00.485570 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:25:00.485570 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:25:00.485570 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:25:00.485570 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:25:00.485570 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:25:00.485570 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:25:00.485570 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 09:25:00.485570 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:25:00.485570 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 306/630] 10.222.0.40 () {56 vars in 1102 bytes} [Thu Jul 14 09:25:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:25:00.485570 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1587d9-3013-4d28-8b48-a2893d91a72e None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:00.517832 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef2d6f6-4514-4209-b995-ba554113f202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:00.519507 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef2d6f6-4514-4209-b995-ba554113f202 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:00.520019 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef2d6f6-4514-4209-b995-ba554113f202 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:00.520528 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef2d6f6-4514-4209-b995-ba554113f202 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:00.535225 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef2d6f6-4514-4209-b995-ba554113f202 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:00.537241 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef2d6f6-4514-4209-b995-ba554113f202 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:00.553063 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:00.555590 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-9ef2d6f6-4514-4209-b995-ba554113f202 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 09:25:00.555590 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:25:00.555590 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:25:00.555590 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:25:00.555590 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:25:00.555590 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:25:00.555590 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:25:00.555590 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:25:00.555590 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:25:00.555590 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:25:00.555590 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:25:00.555590 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:25:00.555590 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 09:25:00.555590 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 09:25:00.555590 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 09:25:00.556626 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 09:25:00.556626 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:25:00.556626 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:25:00.556626 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:25:00.556626 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:25:00.556626 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:25:00.556626 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:25:00.556626 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:25:00.556626 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( Jul 14 09:25:00.556626 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:25:00.556626 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:25:00.556626 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:25:00.556626 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:25:00.556626 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:25:00.556626 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:25:00.556626 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:25:00.556626 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:25:00.557509 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 09:25:00.557509 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 09:25:00.557509 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 09:25:00.557509 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 09:25:00.557509 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 09:25:00.557509 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 09:25:00.557509 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 09:25:00.557509 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Jul 14 09:25:00.561457 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 325/631] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jul 14 09:25:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:25:00.562605 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef2d6f6-4514-4209-b995-ba554113f202 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:00.609204 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1587d9-3013-4d28-8b48-a2893d91a72e None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:00.645487 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce3928b-b583-4598-993c-caeb1bbabe79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:00.646321 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce3928b-b583-4598-993c-caeb1bbabe79 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:00.646710 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce3928b-b583-4598-993c-caeb1bbabe79 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:00.647159 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce3928b-b583-4598-993c-caeb1bbabe79 None admin] PATH_INFO: `/v3/domains` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:00.648491 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce3928b-b583-4598-993c-caeb1bbabe79 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:00.648903 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce3928b-b583-4598-993c-caeb1bbabe79 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:00.650403 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce3928b-b583-4598-993c-caeb1bbabe79 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:00.662811 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:00.663721 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 307/632] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 14 09:25:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:25:00.664615 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce3928b-b583-4598-993c-caeb1bbabe79 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:00.685433 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef2d6f6-4514-4209-b995-ba554113f202 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:00.724544 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66263a4f-1f92-4907-b369-0bccf54ab55c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:00.725597 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66263a4f-1f92-4907-b369-0bccf54ab55c None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:00.726066 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66263a4f-1f92-4907-b369-0bccf54ab55c None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:00.726955 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66263a4f-1f92-4907-b369-0bccf54ab55c None admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:00.728682 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66263a4f-1f92-4907-b369-0bccf54ab55c None admin] RBAC: Adding query filter params (name=service) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:00.729182 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66263a4f-1f92-4907-b369-0bccf54ab55c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:00.731030 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66263a4f-1f92-4907-b369-0bccf54ab55c None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:00.746464 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 326/633] 10.222.0.40 () {56 vars in 1103 bytes} [Thu Jul 14 09:25:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:25:00.748144 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66263a4f-1f92-4907-b369-0bccf54ab55c None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:00.776761 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce3928b-b583-4598-993c-caeb1bbabe79 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:00.795807 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:00.819867 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7713f89-871c-4aa7-897f-1f3e8717b7a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:00.820865 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7713f89-871c-4aa7-897f-1f3e8717b7a1 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:00.821467 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7713f89-871c-4aa7-897f-1f3e8717b7a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:00.821835 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7713f89-871c-4aa7-897f-1f3e8717b7a1 None admin] PATH_INFO: `/v3/projects` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:00.822999 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7713f89-871c-4aa7-897f-1f3e8717b7a1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:00.823443 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7713f89-871c-4aa7-897f-1f3e8717b7a1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:00.825436 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7713f89-871c-4aa7-897f-1f3e8717b7a1 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:00.845444 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 308/634] 10.222.0.40 () {56 vars in 1148 bytes} [Thu Jul 14 09:25:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:25:00.845444 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7713f89-871c-4aa7-897f-1f3e8717b7a1 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:00.875290 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66263a4f-1f92-4907-b369-0bccf54ab55c None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:00.932757 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7f4906-b338-4529-a72a-5d72174fc376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:00.934021 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7f4906-b338-4529-a72a-5d72174fc376 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:00.934512 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7f4906-b338-4529-a72a-5d72174fc376 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:00.934834 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7f4906-b338-4529-a72a-5d72174fc376 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:00.945878 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7f4906-b338-4529-a72a-5d72174fc376 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:00.948129 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7f4906-b338-4529-a72a-5d72174fc376 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:00.972755 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-dc7f4906-b338-4529-a72a-5d72174fc376 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 09:25:00.972755 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:25:00.972755 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:25:00.972755 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:25:00.972755 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:25:00.972755 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:25:00.972755 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:25:00.972755 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:25:00.972755 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:25:00.972755 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:25:00.972755 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:25:00.972755 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:25:00.972755 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 09:25:00.972755 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 09:25:00.972755 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 09:25:00.973897 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 09:25:00.973897 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:25:00.973897 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:25:00.973897 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:25:00.973897 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:25:00.973897 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:25:00.973897 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:25:00.973897 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:25:00.973897 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( Jul 14 09:25:00.973897 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:25:00.973897 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:25:00.973897 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:25:00.973897 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:25:00.973897 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:25:00.973897 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:25:00.973897 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:25:00.973897 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:25:00.975261 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 09:25:00.975261 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 09:25:00.975261 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 09:25:00.975261 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 09:25:00.975261 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 09:25:00.975261 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 09:25:00.975261 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 09:25:00.975261 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Jul 14 09:25:00.975261 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 327/635] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jul 14 09:25:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:25:00.977923 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c13973c-2d6d-4d3f-9b05-409dfa471a8d None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:00.978417 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c13973c-2d6d-4d3f-9b05-409dfa471a8d None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:00.978841 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c13973c-2d6d-4d3f-9b05-409dfa471a8d None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:00.980918 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 328/636] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:25:00 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:25:00.982527 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c13973c-2d6d-4d3f-9b05-409dfa471a8d None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:00.988350 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:00.991983 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7713f89-871c-4aa7-897f-1f3e8717b7a1 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:01.046441 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49684401-c47a-4ba8-99a8-91c6a6897d3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:01.047489 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49684401-c47a-4ba8-99a8-91c6a6897d3a None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:01.047776 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49684401-c47a-4ba8-99a8-91c6a6897d3a None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:01.048051 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49684401-c47a-4ba8-99a8-91c6a6897d3a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:01.061061 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49684401-c47a-4ba8-99a8-91c6a6897d3a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:01.062680 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49684401-c47a-4ba8-99a8-91c6a6897d3a None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:01.080874 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-49684401-c47a-4ba8-99a8-91c6a6897d3a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:25:01.080874 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:25:01.080874 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:25:01.080874 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:25:01.080874 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:25:01.080874 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:25:01.080874 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:25:01.080874 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:25:01.080874 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:25:01.080874 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:25:01.080874 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:25:01.080874 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:25:01.080874 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 09:25:01.080874 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 09:25:01.080874 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 09:25:01.081956 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 09:25:01.081956 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:25:01.081956 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:25:01.081956 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:25:01.081956 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:25:01.081956 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:25:01.081956 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:25:01.081956 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:25:01.081956 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( Jul 14 09:25:01.081956 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:25:01.081956 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:25:01.081956 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:25:01.081956 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:25:01.081956 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:25:01.081956 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:25:01.081956 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:25:01.081956 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:25:01.083077 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 09:25:01.083077 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 09:25:01.083077 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:25:01.083077 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:25:01.083077 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 309/637] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 09:25:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:25:01.083416 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49684401-c47a-4ba8-99a8-91c6a6897d3a None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:01.121369 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:01.125039 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c13973c-2d6d-4d3f-9b05-409dfa471a8d None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:01.165057 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5345c4f3-a8c7-4fa9-9c5a-92fc853ea553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:01.166026 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5345c4f3-a8c7-4fa9-9c5a-92fc853ea553 None admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:01.166346 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5345c4f3-a8c7-4fa9-9c5a-92fc853ea553 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:01.166629 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5345c4f3-a8c7-4fa9-9c5a-92fc853ea553 None admin] PATH_INFO: `/v3/projects/a478e76f04dd413f89ddfba7b0cdc9cc/users/302c0f7dd3bf4829aad0b29bd0c091a5/roles/c12236aebd8048ba991da4671b44935f` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:01.185822 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5345c4f3-a8c7-4fa9-9c5a-92fc853ea553 None admin] RBAC: Authorizing `identity:create_grant(project_id=a478e76f04dd413f89ddfba7b0cdc9cc, user_id=302c0f7dd3bf4829aad0b29bd0c091a5, role_id=c12236aebd8048ba991da4671b44935f)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:01.187361 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5345c4f3-a8c7-4fa9-9c5a-92fc853ea553 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:01.203734 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49684401-c47a-4ba8-99a8-91c6a6897d3a None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:01.205068 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 329/638] 10.222.0.40 () {58 vars in 1439 bytes} [Thu Jul 14 09:25:00 2022] PUT /identity/v3/projects/a478e76f04dd413f89ddfba7b0cdc9cc/users/302c0f7dd3bf4829aad0b29bd0c091a5/roles/c12236aebd8048ba991da4671b44935f => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:25:01.206559 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736c3d6e-4a60-4906-85b3-d9ce96d00fbd None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:01.206858 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736c3d6e-4a60-4906-85b3-d9ce96d00fbd None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:01.207142 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736c3d6e-4a60-4906-85b3-d9ce96d00fbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:01.230916 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-736c3d6e-4a60-4906-85b3-d9ce96d00fbd None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:25:01.232814 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-736c3d6e-4a60-4906-85b3-d9ce96d00fbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:01.258033 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17aa19b-9b1b-4dd3-96b2-06533a263b47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:01.258783 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17aa19b-9b1b-4dd3-96b2-06533a263b47 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:01.259293 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17aa19b-9b1b-4dd3-96b2-06533a263b47 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:01.259579 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17aa19b-9b1b-4dd3-96b2-06533a263b47 None admin] PATH_INFO: `/v3/projects` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:01.260425 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17aa19b-9b1b-4dd3-96b2-06533a263b47 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:01.260744 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17aa19b-9b1b-4dd3-96b2-06533a263b47 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:01.262525 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17aa19b-9b1b-4dd3-96b2-06533a263b47 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:01.287570 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 310/639] 10.222.0.40 () {56 vars in 1148 bytes} [Thu Jul 14 09:25:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:25:01.287570 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bb1e34-f960-493c-91bb-7da45c51fb88 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:01.287570 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bb1e34-f960-493c-91bb-7da45c51fb88 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:01.287570 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bb1e34-f960-493c-91bb-7da45c51fb88 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:01.290356 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 311/640] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:25:01 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:25:01.291592 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bb1e34-f960-493c-91bb-7da45c51fb88 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:01.306306 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:01.334235 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 330/641] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:25:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 09:25:01.334235 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736c3d6e-4a60-4906-85b3-d9ce96d00fbd None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:01.440500 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:01.454436 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bb1e34-f960-493c-91bb-7da45c51fb88 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:01.466220 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736c3d6e-4a60-4906-85b3-d9ce96d00fbd None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:01.494674 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82e9237-63f5-4125-ae2e-10b2a982d9cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:01.495594 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82e9237-63f5-4125-ae2e-10b2a982d9cd None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:01.496029 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82e9237-63f5-4125-ae2e-10b2a982d9cd None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:01.496481 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82e9237-63f5-4125-ae2e-10b2a982d9cd None admin] PATH_INFO: `/v3/domains` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:01.497356 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82e9237-63f5-4125-ae2e-10b2a982d9cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:01.497827 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82e9237-63f5-4125-ae2e-10b2a982d9cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:01.499391 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82e9237-63f5-4125-ae2e-10b2a982d9cd None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:01.505346 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132a9fc1-987e-4c17-8bec-2fbb16a53738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:01.506293 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132a9fc1-987e-4c17-8bec-2fbb16a53738 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:01.506608 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132a9fc1-987e-4c17-8bec-2fbb16a53738 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:01.506884 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132a9fc1-987e-4c17-8bec-2fbb16a53738 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:01.508191 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132a9fc1-987e-4c17-8bec-2fbb16a53738 None admin] RBAC: Adding query filter params (role.id=c12236aebd8048ba991da4671b44935f, scope.project.id=a478e76f04dd413f89ddfba7b0cdc9cc, user.id=1f6962106dfa4c4c9af551053f8095e9) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:01.508510 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132a9fc1-987e-4c17-8bec-2fbb16a53738 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:01.510396 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132a9fc1-987e-4c17-8bec-2fbb16a53738 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:01.513012 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 312/642] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 14 09:25:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:25:01.514445 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a88d28a-fe9b-4a50-b205-c9c17e9e4ba7 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:01.514734 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a88d28a-fe9b-4a50-b205-c9c17e9e4ba7 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:01.515019 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a88d28a-fe9b-4a50-b205-c9c17e9e4ba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:01.521386 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 331/643] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jul 14 09:25:01 2022] GET /identity/v3/role_assignments?user.id=1f6962106dfa4c4c9af551053f8095e9&scope.project.id=a478e76f04dd413f89ddfba7b0cdc9cc&role.id=c12236aebd8048ba991da4671b44935f => generated 608 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:25:01.523000 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132a9fc1-987e-4c17-8bec-2fbb16a53738 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:01.548802 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-1a88d28a-fe9b-4a50-b205-c9c17e9e4ba7 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:25:01.550052 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-1a88d28a-fe9b-4a50-b205-c9c17e9e4ba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:01.601063 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:01.648684 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 313/644] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:25:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 09:25:01.648684 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a88d28a-fe9b-4a50-b205-c9c17e9e4ba7 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:01.692580 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132a9fc1-987e-4c17-8bec-2fbb16a53738 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:01.734080 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94e4e38-a721-49b1-a3e6-7e274b326488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:01.735076 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94e4e38-a721-49b1-a3e6-7e274b326488 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:01.735456 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94e4e38-a721-49b1-a3e6-7e274b326488 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:01.735839 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94e4e38-a721-49b1-a3e6-7e274b326488 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:01.748215 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94e4e38-a721-49b1-a3e6-7e274b326488 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:25:01.756368 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-d94e4e38-a721-49b1-a3e6-7e274b326488 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 09:25:01.756368 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:25:01.756368 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:25:01.756368 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:25:01.756368 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:25:01.756368 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:25:01.756368 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:25:01.756368 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:25:01.756368 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:25:01.756368 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:25:01.756368 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:25:01.756368 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:25:01.756368 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:25:01.756368 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:25:01.756368 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:25:01.756368 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:25:01.757601 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:25:01.757601 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:25:01.757601 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:25:01.757601 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:25:01.757601 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:25:01.757601 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:25:01.757601 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:25:01.757601 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:25:01.757601 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:25:01.757601 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:25:01.757601 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:25:01.757601 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( Jul 14 09:25:01.757601 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:25:01.757601 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:25:01.757601 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:25:01.757601 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:25:01.758671 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:25:01.758671 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:25:01.758671 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:25:01.758671 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:25:01.758671 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:25:01.758671 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:25:01.758671 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:25:01.758671 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:25:01.758671 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:25:01.758671 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:25:01.758671 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 09:25:01.758671 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Jul 14 09:25:01.760029 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:01.760222 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 332/645] 10.222.0.40 () {56 vars in 1102 bytes} [Thu Jul 14 09:25:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:25:01.761187 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94e4e38-a721-49b1-a3e6-7e274b326488 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:01.792424 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a88d28a-fe9b-4a50-b205-c9c17e9e4ba7 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:01.832320 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fba3e2-872b-4f83-93e6-08e15542543b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:01.833484 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fba3e2-872b-4f83-93e6-08e15542543b None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:01.833868 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fba3e2-872b-4f83-93e6-08e15542543b None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:01.834270 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fba3e2-872b-4f83-93e6-08e15542543b None admin] PATH_INFO: `/v3/users/glance` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:01.846159 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fba3e2-872b-4f83-93e6-08e15542543b None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:01.848125 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fba3e2-872b-4f83-93e6-08e15542543b None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:01.869907 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-52fba3e2-872b-4f83-93e6-08e15542543b None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 14 09:25:01.869907 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:25:01.869907 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:25:01.869907 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:25:01.869907 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:25:01.869907 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:25:01.869907 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:25:01.869907 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:25:01.869907 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:25:01.869907 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:25:01.869907 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:25:01.869907 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:25:01.869907 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 09:25:01.869907 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 09:25:01.869907 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 09:25:01.869907 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 09:25:01.871167 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:25:01.871167 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:25:01.871167 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 09:25:01.871167 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 09:25:01.871167 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 09:25:01.871167 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 09:25:01.871167 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:25:01.871167 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:25:01.871167 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:25:01.871167 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:25:01.871167 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:25:01.871167 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( Jul 14 09:25:01.871167 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:25:01.871167 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:25:01.871167 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:25:01.871167 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:25:01.871167 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:25:01.871167 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:25:01.872486 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:25:01.872486 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:25:01.872486 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 09:25:01.872486 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 09:25:01.872486 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 09:25:01.872486 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 09:25:01.872486 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 09:25:01.872486 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 09:25:01.872486 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 14 09:25:01.872486 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:25:01.874687 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 314/646] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 14 09:25:01 2022] GET /identity/v3/users/glance => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:25:01.875604 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fba3e2-872b-4f83-93e6-08e15542543b None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:01.889100 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94e4e38-a721-49b1-a3e6-7e274b326488 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:01.907076 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:01.938029 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66db2875-867d-4ba4-b4c3-66e135d639d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:01.939691 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66db2875-867d-4ba4-b4c3-66e135d639d0 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:01.940583 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66db2875-867d-4ba4-b4c3-66e135d639d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:01.941029 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66db2875-867d-4ba4-b4c3-66e135d639d0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:01.956639 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66db2875-867d-4ba4-b4c3-66e135d639d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:25:01.972374 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-66db2875-867d-4ba4-b4c3-66e135d639d0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 09:25:01.972374 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:25:01.972374 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:25:01.972374 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:25:01.972374 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:25:01.972374 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:25:01.972374 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:25:01.972374 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:25:01.972374 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:25:01.972374 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:25:01.972374 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:25:01.972374 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:25:01.972374 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:25:01.972374 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:25:01.972374 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:25:01.972374 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:25:01.973349 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:25:01.973349 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:25:01.973349 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:25:01.973349 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:25:01.973349 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:25:01.973349 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:25:01.973349 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:25:01.973349 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:25:01.973349 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:25:01.973349 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:25:01.973349 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:25:01.973349 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( Jul 14 09:25:01.973349 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:25:01.973349 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:25:01.973349 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:25:01.973349 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:25:01.974177 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:25:01.974177 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:25:01.974177 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:25:01.974177 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:25:01.974177 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:25:01.974177 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:25:01.974177 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:25:01.974177 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:25:01.974177 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:25:01.974177 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:25:01.974177 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 09:25:01.974177 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Jul 14 09:25:01.974177 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 333/647] 10.222.0.40 () {56 vars in 1102 bytes} [Thu Jul 14 09:25:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:25:01.981019 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66db2875-867d-4ba4-b4c3-66e135d639d0 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:02.016557 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fba3e2-872b-4f83-93e6-08e15542543b None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:02.061017 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e920e8e8-a3ed-4ce6-a60f-c8a35fc1b3c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:02.061717 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e920e8e8-a3ed-4ce6-a60f-c8a35fc1b3c2 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:02.061997 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e920e8e8-a3ed-4ce6-a60f-c8a35fc1b3c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:02.062375 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e920e8e8-a3ed-4ce6-a60f-c8a35fc1b3c2 None admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:02.063206 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e920e8e8-a3ed-4ce6-a60f-c8a35fc1b3c2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:02.063426 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e920e8e8-a3ed-4ce6-a60f-c8a35fc1b3c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:02.064964 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e920e8e8-a3ed-4ce6-a60f-c8a35fc1b3c2 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:02.078456 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 315/648] 10.222.0.40 () {56 vars in 1103 bytes} [Thu Jul 14 09:25:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:25:02.079347 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e920e8e8-a3ed-4ce6-a60f-c8a35fc1b3c2 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:02.082468 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:02.093795 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66db2875-867d-4ba4-b4c3-66e135d639d0 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:02.133663 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84b5719-fbf4-4009-8b1e-f2dda0ff9463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:02.134421 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84b5719-fbf4-4009-8b1e-f2dda0ff9463 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:02.134705 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84b5719-fbf4-4009-8b1e-f2dda0ff9463 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:02.134980 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84b5719-fbf4-4009-8b1e-f2dda0ff9463 None admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:02.135923 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84b5719-fbf4-4009-8b1e-f2dda0ff9463 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:02.136130 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84b5719-fbf4-4009-8b1e-f2dda0ff9463 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:02.137568 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84b5719-fbf4-4009-8b1e-f2dda0ff9463 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:02.162313 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 334/649] 10.222.0.40 () {56 vars in 1137 bytes} [Thu Jul 14 09:25:01 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:25:02.163378 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84b5719-fbf4-4009-8b1e-f2dda0ff9463 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:02.193540 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:02.218036 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e920e8e8-a3ed-4ce6-a60f-c8a35fc1b3c2 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:02.266289 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6734eed-121a-4401-b420-5c624350e3ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:02.267796 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6734eed-121a-4401-b420-5c624350e3ca None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:02.268580 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6734eed-121a-4401-b420-5c624350e3ca None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:02.269066 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6734eed-121a-4401-b420-5c624350e3ca None admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:02.270710 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6734eed-121a-4401-b420-5c624350e3ca None admin] RBAC: Adding query filter params (name=service) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:02.271489 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6734eed-121a-4401-b420-5c624350e3ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:02.273651 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84b5719-fbf4-4009-8b1e-f2dda0ff9463 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:02.273892 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6734eed-121a-4401-b420-5c624350e3ca None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:02.290361 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 316/650] 10.222.0.40 () {56 vars in 1103 bytes} [Thu Jul 14 09:25:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:25:02.290361 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6734eed-121a-4401-b420-5c624350e3ca None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:02.324547 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba3207c-64f5-48a4-8c18-65584046940f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:02.325925 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba3207c-64f5-48a4-8c18-65584046940f None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:02.327414 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba3207c-64f5-48a4-8c18-65584046940f None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:02.327902 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba3207c-64f5-48a4-8c18-65584046940f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:02.343760 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba3207c-64f5-48a4-8c18-65584046940f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:02.345868 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba3207c-64f5-48a4-8c18-65584046940f None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:02.357816 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:02.373362 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-cba3207c-64f5-48a4-8c18-65584046940f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:25:02.373362 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:25:02.373362 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:25:02.373362 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:25:02.373362 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:25:02.373362 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:25:02.373362 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:25:02.373362 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:25:02.373362 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:25:02.373362 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:25:02.373362 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:25:02.373362 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:25:02.373362 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 09:25:02.373362 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 09:25:02.373362 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 09:25:02.374528 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 09:25:02.374528 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:25:02.374528 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:25:02.374528 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:25:02.374528 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:25:02.374528 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:25:02.374528 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:25:02.374528 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:25:02.374528 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( Jul 14 09:25:02.374528 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:25:02.374528 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:25:02.374528 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:25:02.374528 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:25:02.374528 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:25:02.374528 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:25:02.374528 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:25:02.374528 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:25:02.375608 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 09:25:02.375608 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 09:25:02.375608 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:25:02.375608 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Jul 14 09:25:02.378085 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 335/651] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 09:25:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:25:02.379541 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba3207c-64f5-48a4-8c18-65584046940f None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:02.419618 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6734eed-121a-4401-b420-5c624350e3ca None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:02.472681 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6c505e-70b1-411f-b75f-c849c29f8f09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:02.474027 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6c505e-70b1-411f-b75f-c849c29f8f09 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:02.474491 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6c505e-70b1-411f-b75f-c849c29f8f09 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:02.474947 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6c505e-70b1-411f-b75f-c849c29f8f09 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:02.479413 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:02.511051 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba3207c-64f5-48a4-8c18-65584046940f None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:02.561700 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d30bcc-4227-4ace-b1ee-d978ea166b7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:02.562835 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d30bcc-4227-4ace-b1ee-d978ea166b7d None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:02.563329 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d30bcc-4227-4ace-b1ee-d978ea166b7d None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:02.563933 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d30bcc-4227-4ace-b1ee-d978ea166b7d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:02.580137 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d30bcc-4227-4ace-b1ee-d978ea166b7d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:02.582609 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d30bcc-4227-4ace-b1ee-d978ea166b7d None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:02.586439 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6c505e-70b1-411f-b75f-c849c29f8f09 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:02.587915 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6c505e-70b1-411f-b75f-c849c29f8f09 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:02.605522 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-e4d30bcc-4227-4ace-b1ee-d978ea166b7d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:25:02.605522 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:25:02.605522 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:25:02.605522 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:25:02.605522 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:25:02.605522 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:25:02.605522 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:25:02.605522 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:25:02.605522 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:25:02.605522 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:25:02.605522 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:25:02.605522 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:25:02.605522 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 09:25:02.605522 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 09:25:02.605522 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 09:25:02.606467 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 09:25:02.606467 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:25:02.606467 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:25:02.606467 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:25:02.606467 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:25:02.606467 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:25:02.606467 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:25:02.606467 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:25:02.606467 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( Jul 14 09:25:02.606467 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:25:02.606467 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:25:02.606467 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:25:02.606467 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:25:02.606467 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:25:02.606467 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:25:02.606467 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:25:02.606467 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:25:02.607490 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 09:25:02.607490 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 09:25:02.607490 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:25:02.607490 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Jul 14 09:25:02.610122 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 336/652] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 09:25:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:25:02.611592 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d30bcc-4227-4ace-b1ee-d978ea166b7d None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:02.681993 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:02.734098 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 317/653] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 14 09:25:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 09:25:02.735394 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6c505e-70b1-411f-b75f-c849c29f8f09 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:02.755183 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d30bcc-4227-4ace-b1ee-d978ea166b7d None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:02.799345 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:02.809685 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1fface-29e1-4059-b1d6-83683ff28cfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:02.810695 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1fface-29e1-4059-b1d6-83683ff28cfb None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:02.810986 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1fface-29e1-4059-b1d6-83683ff28cfb None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:02.811264 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1fface-29e1-4059-b1d6-83683ff28cfb None admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:02.812027 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1fface-29e1-4059-b1d6-83683ff28cfb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:02.812336 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1fface-29e1-4059-b1d6-83683ff28cfb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:02.814505 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1fface-29e1-4059-b1d6-83683ff28cfb None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:02.838350 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 337/654] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 14 09:25:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:25:02.839563 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1fface-29e1-4059-b1d6-83683ff28cfb None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:02.866747 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6c505e-70b1-411f-b75f-c849c29f8f09 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:02.906878 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f54a180-4f54-4c31-ab05-2336ec09bccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:02.907406 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f54a180-4f54-4c31-ab05-2336ec09bccc None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:02.907688 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f54a180-4f54-4c31-ab05-2336ec09bccc None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:02.907965 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f54a180-4f54-4c31-ab05-2336ec09bccc None admin] PATH_INFO: `/v3/domains` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:02.908695 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f54a180-4f54-4c31-ab05-2336ec09bccc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:02.909026 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f54a180-4f54-4c31-ab05-2336ec09bccc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:02.910466 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f54a180-4f54-4c31-ab05-2336ec09bccc None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:02.923180 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 318/655] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 14 09:25:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:25:02.923722 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f54a180-4f54-4c31-ab05-2336ec09bccc None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:02.952676 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:02.958546 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1fface-29e1-4059-b1d6-83683ff28cfb None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:02.997143 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a94c78-fdf8-45b5-a2f5-7d55d7f8332d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:02.998325 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a94c78-fdf8-45b5-a2f5-7d55d7f8332d None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:02.998852 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a94c78-fdf8-45b5-a2f5-7d55d7f8332d None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:02.999368 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a94c78-fdf8-45b5-a2f5-7d55d7f8332d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:03.010491 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a94c78-fdf8-45b5-a2f5-7d55d7f8332d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:03.012211 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a94c78-fdf8-45b5-a2f5-7d55d7f8332d None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:03.031616 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-b2a94c78-fdf8-45b5-a2f5-7d55d7f8332d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:25:03.031616 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:25:03.031616 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:25:03.031616 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:25:03.031616 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:25:03.031616 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:25:03.031616 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:25:03.031616 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:25:03.031616 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:25:03.031616 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:25:03.031616 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:25:03.031616 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:25:03.031616 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 09:25:03.031616 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 09:25:03.031616 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 09:25:03.032548 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 09:25:03.032548 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:25:03.032548 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:25:03.032548 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:25:03.032548 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:25:03.032548 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:25:03.032548 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:25:03.032548 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:25:03.032548 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( Jul 14 09:25:03.032548 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:25:03.032548 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:25:03.032548 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:25:03.032548 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:25:03.032548 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:25:03.032548 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:25:03.032548 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:25:03.032548 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:25:03.033418 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 09:25:03.033418 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 09:25:03.033418 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:25:03.033418 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Jul 14 09:25:03.033646 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f54a180-4f54-4c31-ab05-2336ec09bccc None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:03.040560 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 338/656] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 09:25:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:25:03.041690 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a94c78-fdf8-45b5-a2f5-7d55d7f8332d None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:03.069628 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a353915c-a066-4555-9ad9-b96c3484b3e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:03.070473 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a353915c-a066-4555-9ad9-b96c3484b3e0 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:03.070757 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a353915c-a066-4555-9ad9-b96c3484b3e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:03.071150 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a353915c-a066-4555-9ad9-b96c3484b3e0 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:03.078908 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a353915c-a066-4555-9ad9-b96c3484b3e0 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:03.080351 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a353915c-a066-4555-9ad9-b96c3484b3e0 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:03.090749 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:03.095987 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-a353915c-a066-4555-9ad9-b96c3484b3e0 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 14 09:25:03.095987 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:25:03.095987 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:25:03.095987 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:25:03.095987 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:25:03.095987 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:25:03.095987 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:25:03.095987 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:25:03.095987 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:25:03.095987 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:25:03.095987 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:25:03.095987 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:25:03.095987 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 09:25:03.095987 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 09:25:03.095987 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 09:25:03.095987 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 09:25:03.096922 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:25:03.096922 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:25:03.096922 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 09:25:03.096922 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 09:25:03.096922 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 09:25:03.096922 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 09:25:03.096922 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:25:03.096922 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:25:03.096922 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:25:03.096922 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:25:03.096922 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:25:03.096922 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( Jul 14 09:25:03.096922 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:25:03.096922 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:25:03.096922 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:25:03.096922 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:25:03.096922 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:25:03.096922 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:25:03.098308 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:25:03.098308 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:25:03.098308 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 09:25:03.098308 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 09:25:03.098308 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 09:25:03.098308 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 09:25:03.098308 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 09:25:03.098308 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 09:25:03.098308 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 14 09:25:03.098308 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:25:03.098308 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 319/657] 10.222.0.40 () {56 vars in 1102 bytes} [Thu Jul 14 09:25:02 2022] GET /identity/v3/users/neutron => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:25:03.098308 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a353915c-a066-4555-9ad9-b96c3484b3e0 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:03.181182 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a94c78-fdf8-45b5-a2f5-7d55d7f8332d None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:03.218894 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601fb444-71a7-4240-97b7-9fd595fb1b3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:03.219706 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601fb444-71a7-4240-97b7-9fd595fb1b3a None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:03.219991 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601fb444-71a7-4240-97b7-9fd595fb1b3a None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:03.220268 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601fb444-71a7-4240-97b7-9fd595fb1b3a None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:03.226244 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:03.229807 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601fb444-71a7-4240-97b7-9fd595fb1b3a None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:03.231452 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601fb444-71a7-4240-97b7-9fd595fb1b3a None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:03.246872 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a353915c-a066-4555-9ad9-b96c3484b3e0 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:03.248719 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-601fb444-71a7-4240-97b7-9fd595fb1b3a None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 14 09:25:03.248719 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:25:03.248719 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:25:03.248719 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:25:03.248719 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:25:03.248719 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:25:03.248719 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:25:03.248719 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:25:03.248719 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:25:03.248719 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:25:03.248719 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:25:03.248719 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:25:03.248719 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 09:25:03.248719 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 09:25:03.248719 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 09:25:03.248719 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 09:25:03.249651 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:25:03.249651 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:25:03.249651 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 09:25:03.249651 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 09:25:03.249651 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 09:25:03.249651 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 09:25:03.249651 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:25:03.249651 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:25:03.249651 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:25:03.249651 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:25:03.249651 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:25:03.249651 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( Jul 14 09:25:03.249651 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:25:03.249651 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:25:03.249651 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:25:03.249651 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:25:03.249651 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:25:03.249651 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:25:03.251207 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:25:03.251207 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:25:03.251207 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 09:25:03.251207 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 09:25:03.251207 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 09:25:03.251207 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 09:25:03.251207 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 09:25:03.251207 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 09:25:03.251207 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 14 09:25:03.251207 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Jul 14 09:25:03.251207 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 339/658] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 14 09:25:03 2022] GET /identity/v3/users/cinder => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:25:03.251207 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601fb444-71a7-4240-97b7-9fd595fb1b3a None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:03.294132 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd1740f-8756-4527-9699-f3dac7b81fc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:03.294835 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd1740f-8756-4527-9699-f3dac7b81fc2 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:03.295117 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd1740f-8756-4527-9699-f3dac7b81fc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:03.295386 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd1740f-8756-4527-9699-f3dac7b81fc2 None admin] PATH_INFO: `/v3/domains` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:03.296129 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd1740f-8756-4527-9699-f3dac7b81fc2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:03.296437 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd1740f-8756-4527-9699-f3dac7b81fc2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:03.297809 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd1740f-8756-4527-9699-f3dac7b81fc2 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:03.314051 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 320/659] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 14 09:25:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:25:03.314051 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd1740f-8756-4527-9699-f3dac7b81fc2 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:03.369749 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601fb444-71a7-4240-97b7-9fd595fb1b3a None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:03.371386 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:03.409165 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8310ff-938a-4663-86cf-b4932914521c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:03.409843 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8310ff-938a-4663-86cf-b4932914521c None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:03.410127 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8310ff-938a-4663-86cf-b4932914521c None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:03.410427 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8310ff-938a-4663-86cf-b4932914521c None admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:03.411282 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8310ff-938a-4663-86cf-b4932914521c None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:03.411593 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8310ff-938a-4663-86cf-b4932914521c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:03.413066 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8310ff-938a-4663-86cf-b4932914521c None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:03.430869 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd1740f-8756-4527-9699-f3dac7b81fc2 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:03.433300 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 340/660] 10.222.0.40 () {56 vars in 1139 bytes} [Thu Jul 14 09:25:03 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:25:03.435121 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af4b4ce-0d52-40d0-9942-14e504922cc1 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:03.435121 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af4b4ce-0d52-40d0-9942-14e504922cc1 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:03.435321 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af4b4ce-0d52-40d0-9942-14e504922cc1 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:03.438285 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 341/661] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:25:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:25:03.438285 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af4b4ce-0d52-40d0-9942-14e504922cc1 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:03.477713 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff98784a-f3c4-4e9c-badc-5284995c10ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:03.479036 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff98784a-f3c4-4e9c-badc-5284995c10ff None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:03.479491 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff98784a-f3c4-4e9c-badc-5284995c10ff None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:03.479766 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff98784a-f3c4-4e9c-badc-5284995c10ff None admin] PATH_INFO: `/v3/users` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:03.480621 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff98784a-f3c4-4e9c-badc-5284995c10ff None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:03.480930 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff98784a-f3c4-4e9c-badc-5284995c10ff None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:03.482386 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff98784a-f3c4-4e9c-badc-5284995c10ff None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:03.501012 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 321/662] 10.222.0.40 () {56 vars in 1137 bytes} [Thu Jul 14 09:25:03 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:25:03.501873 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff98784a-f3c4-4e9c-badc-5284995c10ff None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:03.504827 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:03.570353 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af4b4ce-0d52-40d0-9942-14e504922cc1 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:03.608653 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb05cf4-871f-433d-8e7f-a2b2354d5bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:03.609621 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb05cf4-871f-433d-8e7f-a2b2354d5bcb None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:03.609751 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb05cf4-871f-433d-8e7f-a2b2354d5bcb None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:03.610012 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb05cf4-871f-433d-8e7f-a2b2354d5bcb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:03.617760 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb05cf4-871f-433d-8e7f-a2b2354d5bcb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:03.619249 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb05cf4-871f-433d-8e7f-a2b2354d5bcb None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:03.633754 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-beb05cf4-871f-433d-8e7f-a2b2354d5bcb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 09:25:03.633754 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:25:03.633754 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:25:03.633754 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:25:03.633754 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:25:03.633754 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:25:03.633754 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:25:03.633754 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:25:03.633754 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:25:03.633754 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:25:03.633754 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:25:03.633754 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:25:03.633754 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 09:25:03.633754 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 09:25:03.633754 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 09:25:03.634713 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 09:25:03.634713 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:25:03.634713 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:25:03.634713 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:25:03.634713 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:25:03.634713 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:25:03.634713 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:25:03.634713 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:25:03.634713 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( Jul 14 09:25:03.634713 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:25:03.634713 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:25:03.634713 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:25:03.634713 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:25:03.634713 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:25:03.634713 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:25:03.634713 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:25:03.634713 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:25:03.640873 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 09:25:03.640873 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 09:25:03.640873 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 09:25:03.640873 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 09:25:03.640873 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 09:25:03.640873 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 09:25:03.640873 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 09:25:03.640873 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Jul 14 09:25:03.641341 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff98784a-f3c4-4e9c-badc-5284995c10ff None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:03.641416 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 342/663] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jul 14 09:25:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:25:03.641416 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54607af5-05b0-4c9f-af96-a59f1af7aeac None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:03.641416 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54607af5-05b0-4c9f-af96-a59f1af7aeac None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:03.641416 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54607af5-05b0-4c9f-af96-a59f1af7aeac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:03.654489 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-54607af5-05b0-4c9f-af96-a59f1af7aeac None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:25:03.655698 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-54607af5-05b0-4c9f-af96-a59f1af7aeac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:03.671032 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:03.680948 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2780f5e7-3406-4c02-9ca1-b0dd863eb3c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:03.681619 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2780f5e7-3406-4c02-9ca1-b0dd863eb3c9 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:03.681909 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2780f5e7-3406-4c02-9ca1-b0dd863eb3c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:03.682290 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2780f5e7-3406-4c02-9ca1-b0dd863eb3c9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:03.734052 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 343/664] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:25:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 09:25:03.735274 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54607af5-05b0-4c9f-af96-a59f1af7aeac None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:03.771087 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2780f5e7-3406-4c02-9ca1-b0dd863eb3c9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:03.773149 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2780f5e7-3406-4c02-9ca1-b0dd863eb3c9 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:03.775087 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:03.836518 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54607af5-05b0-4c9f-af96-a59f1af7aeac None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:03.871162 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a338b1da-d810-48cf-a26a-b5fbe7cf2e29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:03.871817 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a338b1da-d810-48cf-a26a-b5fbe7cf2e29 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:03.872102 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a338b1da-d810-48cf-a26a-b5fbe7cf2e29 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:03.872381 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a338b1da-d810-48cf-a26a-b5fbe7cf2e29 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:03.872667 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 322/665] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 14 09:25:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 09:25:03.873522 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2780f5e7-3406-4c02-9ca1-b0dd863eb3c9 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:03.891690 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:03.940444 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a338b1da-d810-48cf-a26a-b5fbe7cf2e29 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:03.941913 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a338b1da-d810-48cf-a26a-b5fbe7cf2e29 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:03.973194 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2780f5e7-3406-4c02-9ca1-b0dd863eb3c9 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:03.974765 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:04.008403 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428a9f78-ba8c-4cd1-9a88-575bc122c2af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:04.008996 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428a9f78-ba8c-4cd1-9a88-575bc122c2af None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:04.009281 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428a9f78-ba8c-4cd1-9a88-575bc122c2af None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:04.009559 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428a9f78-ba8c-4cd1-9a88-575bc122c2af None admin] PATH_INFO: `/v3/projects` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:04.010398 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428a9f78-ba8c-4cd1-9a88-575bc122c2af None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:04.010710 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428a9f78-ba8c-4cd1-9a88-575bc122c2af None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:04.012141 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428a9f78-ba8c-4cd1-9a88-575bc122c2af None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:04.023757 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 323/666] 10.222.0.40 () {56 vars in 1148 bytes} [Thu Jul 14 09:25:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:25:04.025062 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7ea1dc-cc2b-458b-8887-fb69183aa2ab None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:04.025355 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7ea1dc-cc2b-458b-8887-fb69183aa2ab None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:04.025653 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7ea1dc-cc2b-458b-8887-fb69183aa2ab None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:04.030817 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 324/667] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:25:04 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:25:04.031632 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7ea1dc-cc2b-458b-8887-fb69183aa2ab None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:04.044151 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 344/668] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 14 09:25:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 09:25:04.045011 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a338b1da-d810-48cf-a26a-b5fbe7cf2e29 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:04.094119 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:04.133243 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7ea1dc-cc2b-458b-8887-fb69183aa2ab None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:04.145791 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a338b1da-d810-48cf-a26a-b5fbe7cf2e29 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:04.166468 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c6b2ba-d691-4f27-b80d-82a4301dd6f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:04.167346 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c6b2ba-d691-4f27-b80d-82a4301dd6f1 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:04.167629 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c6b2ba-d691-4f27-b80d-82a4301dd6f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:04.167904 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c6b2ba-d691-4f27-b80d-82a4301dd6f1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:04.178091 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c6b2ba-d691-4f27-b80d-82a4301dd6f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:25:04.181381 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1eeb77-01f9-4514-a95d-fddea2442d84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:04.182173 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1eeb77-01f9-4514-a95d-fddea2442d84 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:04.182489 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1eeb77-01f9-4514-a95d-fddea2442d84 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:04.182769 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1eeb77-01f9-4514-a95d-fddea2442d84 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:04.186446 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-58c6b2ba-d691-4f27-b80d-82a4301dd6f1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 09:25:04.186446 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:25:04.186446 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:25:04.186446 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:25:04.186446 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:25:04.186446 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:25:04.186446 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:25:04.186446 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:25:04.186446 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:25:04.186446 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:25:04.186446 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:25:04.186446 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:25:04.186446 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:25:04.186446 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:25:04.186446 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:25:04.186446 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:25:04.187384 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:25:04.187384 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:25:04.187384 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:25:04.187384 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:25:04.187384 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:25:04.187384 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:25:04.187384 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:25:04.187384 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:25:04.187384 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:25:04.187384 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:25:04.187384 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:25:04.187384 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( Jul 14 09:25:04.187384 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:25:04.187384 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:25:04.187384 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:25:04.187384 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:25:04.188228 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:25:04.188228 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:25:04.188228 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:25:04.188228 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:25:04.188228 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:25:04.188228 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:25:04.188228 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:25:04.188228 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:25:04.188228 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:25:04.188228 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:25:04.188228 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 09:25:04.188228 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:25:04.188228 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 325/669] 10.222.0.40 () {56 vars in 1102 bytes} [Thu Jul 14 09:25:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:25:04.188933 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c6b2ba-d691-4f27-b80d-82a4301dd6f1 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:04.193891 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1eeb77-01f9-4514-a95d-fddea2442d84 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:04.195407 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1eeb77-01f9-4514-a95d-fddea2442d84 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:04.215444 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-ba1eeb77-01f9-4514-a95d-fddea2442d84 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:25:04.215444 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:25:04.215444 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:25:04.215444 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:25:04.215444 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:25:04.215444 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:25:04.215444 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:25:04.215444 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:25:04.215444 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:25:04.215444 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:25:04.215444 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:25:04.215444 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:25:04.215444 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 09:25:04.215444 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 09:25:04.215444 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 09:25:04.228197 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 09:25:04.228197 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:25:04.228197 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:25:04.228197 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:25:04.228197 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:25:04.228197 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:25:04.228197 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:25:04.228197 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:25:04.228197 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( Jul 14 09:25:04.228197 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:25:04.228197 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:25:04.228197 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:25:04.228197 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:25:04.228197 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:25:04.228197 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:25:04.228197 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:25:04.228197 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:25:04.229329 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 09:25:04.229329 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 09:25:04.229329 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:25:04.229329 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Jul 14 09:25:04.229329 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 345/670] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 09:25:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:25:04.229329 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1095e3a9-4698-4a8d-a80e-26bb4e67bd47 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:04.229329 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1095e3a9-4698-4a8d-a80e-26bb4e67bd47 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:04.229798 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:04.229871 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1095e3a9-4698-4a8d-a80e-26bb4e67bd47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:04.246596 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-1095e3a9-4698-4a8d-a80e-26bb4e67bd47 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:25:04.247797 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-1095e3a9-4698-4a8d-a80e-26bb4e67bd47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:04.301726 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c6b2ba-d691-4f27-b80d-82a4301dd6f1 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:04.317663 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 346/671] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:25:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 09:25:04.318548 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1095e3a9-4698-4a8d-a80e-26bb4e67bd47 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:04.346504 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21f4a9b-1376-4b31-be1d-d6ef1e2c29e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:04.347175 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21f4a9b-1376-4b31-be1d-d6ef1e2c29e2 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:04.347460 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21f4a9b-1376-4b31-be1d-d6ef1e2c29e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:04.347769 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21f4a9b-1376-4b31-be1d-d6ef1e2c29e2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:04.348616 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21f4a9b-1376-4b31-be1d-d6ef1e2c29e2 None admin] RBAC: Adding query filter params (role.id=c12236aebd8048ba991da4671b44935f, scope.project.id=a478e76f04dd413f89ddfba7b0cdc9cc, user.id=7ba461800d6845e6a767c83777ae5213) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:04.348789 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:04.348934 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21f4a9b-1376-4b31-be1d-d6ef1e2c29e2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:04.351232 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21f4a9b-1376-4b31-be1d-d6ef1e2c29e2 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:04.357295 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 326/672] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jul 14 09:25:04 2022] GET /identity/v3/role_assignments?user.id=7ba461800d6845e6a767c83777ae5213&scope.project.id=a478e76f04dd413f89ddfba7b0cdc9cc&role.id=c12236aebd8048ba991da4671b44935f => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:25:04.358092 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21f4a9b-1376-4b31-be1d-d6ef1e2c29e2 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:04.429666 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1095e3a9-4698-4a8d-a80e-26bb4e67bd47 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:04.451951 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:04.469535 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7829f412-11f7-47a9-a14e-0835212615b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:04.470074 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21f4a9b-1376-4b31-be1d-d6ef1e2c29e2 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:04.470392 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7829f412-11f7-47a9-a14e-0835212615b3 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:04.470680 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7829f412-11f7-47a9-a14e-0835212615b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:04.470960 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7829f412-11f7-47a9-a14e-0835212615b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:04.483320 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7829f412-11f7-47a9-a14e-0835212615b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:04.484796 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7829f412-11f7-47a9-a14e-0835212615b3 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:04.505421 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-7829f412-11f7-47a9-a14e-0835212615b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:25:04.505421 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:25:04.505421 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:25:04.505421 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:25:04.505421 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:25:04.505421 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:25:04.505421 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:25:04.505421 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:25:04.505421 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:25:04.505421 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:25:04.505421 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:25:04.505421 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:25:04.505421 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 09:25:04.505421 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 09:25:04.505421 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 09:25:04.506459 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 09:25:04.506459 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:25:04.506459 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:25:04.506459 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:25:04.506459 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:25:04.506459 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:25:04.506459 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:25:04.506459 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:25:04.506459 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( Jul 14 09:25:04.506459 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:25:04.506459 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:25:04.506459 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:25:04.506459 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:25:04.506459 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:25:04.506459 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:25:04.506459 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:25:04.506459 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:25:04.507368 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 09:25:04.507368 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 09:25:04.507368 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:25:04.507368 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Jul 14 09:25:04.507368 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 347/673] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 09:25:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:25:04.507648 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7829f412-11f7-47a9-a14e-0835212615b3 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:04.512291 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adb2ca3-8a49-45d3-88e6-9a6cc6bf02e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:04.512972 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adb2ca3-8a49-45d3-88e6-9a6cc6bf02e8 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:04.513253 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adb2ca3-8a49-45d3-88e6-9a6cc6bf02e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:04.513526 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adb2ca3-8a49-45d3-88e6-9a6cc6bf02e8 None admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:04.514466 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adb2ca3-8a49-45d3-88e6-9a6cc6bf02e8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:04.514724 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adb2ca3-8a49-45d3-88e6-9a6cc6bf02e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:04.516103 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adb2ca3-8a49-45d3-88e6-9a6cc6bf02e8 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:04.525674 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 327/674] 10.222.0.40 () {56 vars in 1103 bytes} [Thu Jul 14 09:25:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:25:04.527109 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adb2ca3-8a49-45d3-88e6-9a6cc6bf02e8 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:04.621974 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:04.643272 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7829f412-11f7-47a9-a14e-0835212615b3 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:04.654335 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adb2ca3-8a49-45d3-88e6-9a6cc6bf02e8 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:04.686885 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17e2f79-1d43-4896-aa1d-b08ea9496273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:04.687554 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17e2f79-1d43-4896-aa1d-b08ea9496273 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:04.687838 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17e2f79-1d43-4896-aa1d-b08ea9496273 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:04.688111 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17e2f79-1d43-4896-aa1d-b08ea9496273 None admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:04.688944 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17e2f79-1d43-4896-aa1d-b08ea9496273 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:04.689251 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17e2f79-1d43-4896-aa1d-b08ea9496273 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:04.690795 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17e2f79-1d43-4896-aa1d-b08ea9496273 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:04.697176 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffb9af4-e32d-4481-a668-8a8086bef278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:04.698068 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffb9af4-e32d-4481-a668-8a8086bef278 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:04.698444 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffb9af4-e32d-4481-a668-8a8086bef278 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:04.698799 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffb9af4-e32d-4481-a668-8a8086bef278 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:04.704033 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 348/675] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 14 09:25:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:25:04.704951 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17e2f79-1d43-4896-aa1d-b08ea9496273 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:04.716388 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffb9af4-e32d-4481-a668-8a8086bef278 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:25:04.724905 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-6ffb9af4-e32d-4481-a668-8a8086bef278 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 09:25:04.724905 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:25:04.724905 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:25:04.724905 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:25:04.724905 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:25:04.724905 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:25:04.724905 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:25:04.724905 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:25:04.724905 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:25:04.724905 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:25:04.724905 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:25:04.724905 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:25:04.724905 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:25:04.724905 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:25:04.724905 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:25:04.724905 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:25:04.726635 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:25:04.726635 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:25:04.726635 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:25:04.726635 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:25:04.726635 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:25:04.726635 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:25:04.726635 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:25:04.726635 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:25:04.726635 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:25:04.726635 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:25:04.726635 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:25:04.726635 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( Jul 14 09:25:04.726635 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:25:04.726635 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:25:04.726635 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:25:04.726635 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:25:04.727699 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:25:04.727699 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:25:04.727699 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:25:04.727699 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:25:04.727699 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:25:04.727699 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:25:04.727699 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:25:04.727699 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:25:04.727699 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:25:04.727699 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:25:04.727699 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 09:25:04.727699 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:25:04.728643 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 328/676] 10.222.0.40 () {56 vars in 1096 bytes} [Thu Jul 14 09:25:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:25:04.729504 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffb9af4-e32d-4481-a668-8a8086bef278 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:04.743151 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:04.826104 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17e2f79-1d43-4896-aa1d-b08ea9496273 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:04.842220 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffb9af4-e32d-4481-a668-8a8086bef278 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:04.877516 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468cbef2-3498-4600-85b2-594b801c4369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:04.878545 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468cbef2-3498-4600-85b2-594b801c4369 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:04.878980 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468cbef2-3498-4600-85b2-594b801c4369 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:04.879262 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468cbef2-3498-4600-85b2-594b801c4369 None admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:04.880093 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e598b673-6f7a-4425-9bf1-2935fdcff454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:04.880374 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468cbef2-3498-4600-85b2-594b801c4369 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:04.880837 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468cbef2-3498-4600-85b2-594b801c4369 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:04.881078 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e598b673-6f7a-4425-9bf1-2935fdcff454 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:04.881963 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e598b673-6f7a-4425-9bf1-2935fdcff454 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:04.882340 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e598b673-6f7a-4425-9bf1-2935fdcff454 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:04.883644 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468cbef2-3498-4600-85b2-594b801c4369 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:04.894182 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e598b673-6f7a-4425-9bf1-2935fdcff454 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:04.895680 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e598b673-6f7a-4425-9bf1-2935fdcff454 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:04.907740 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 349/677] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 14 09:25:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:25:04.907740 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468cbef2-3498-4600-85b2-594b801c4369 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:04.909296 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:04.920557 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-e598b673-6f7a-4425-9bf1-2935fdcff454 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:25:04.920557 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:25:04.920557 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:25:04.920557 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:25:04.920557 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:25:04.920557 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:25:04.920557 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:25:04.920557 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:25:04.920557 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:25:04.920557 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:25:04.920557 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:25:04.920557 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:25:04.920557 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 09:25:04.920557 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 09:25:04.920557 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 09:25:04.921658 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 09:25:04.921658 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:25:04.921658 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:25:04.921658 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:25:04.921658 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:25:04.921658 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:25:04.921658 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:25:04.921658 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:25:04.921658 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( Jul 14 09:25:04.921658 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:25:04.921658 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:25:04.921658 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:25:04.921658 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:25:04.921658 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:25:04.921658 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:25:04.921658 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:25:04.921658 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:25:04.922626 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 09:25:04.922626 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 09:25:04.922626 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:25:04.922626 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:25:04.922626 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 329/678] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 09:25:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:25:04.922626 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e598b673-6f7a-4425-9bf1-2935fdcff454 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:04.995171 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:05.025412 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468cbef2-3498-4600-85b2-594b801c4369 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:05.043006 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e598b673-6f7a-4425-9bf1-2935fdcff454 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:05.061210 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec86bc72-3366-46a5-acad-8cc7001f6ebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:05.062021 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec86bc72-3366-46a5-acad-8cc7001f6ebb None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:05.062343 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec86bc72-3366-46a5-acad-8cc7001f6ebb None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:05.062621 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec86bc72-3366-46a5-acad-8cc7001f6ebb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:05.070244 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec86bc72-3366-46a5-acad-8cc7001f6ebb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:05.071708 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec86bc72-3366-46a5-acad-8cc7001f6ebb None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:05.078424 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db51d94c-ef8c-4840-bcf2-89f19dba8643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:05.079034 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db51d94c-ef8c-4840-bcf2-89f19dba8643 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:05.079316 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db51d94c-ef8c-4840-bcf2-89f19dba8643 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:05.079590 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db51d94c-ef8c-4840-bcf2-89f19dba8643 None admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:05.080351 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db51d94c-ef8c-4840-bcf2-89f19dba8643 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:05.080655 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db51d94c-ef8c-4840-bcf2-89f19dba8643 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:05.082018 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db51d94c-ef8c-4840-bcf2-89f19dba8643 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:05.086799 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-ec86bc72-3366-46a5-acad-8cc7001f6ebb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 09:25:05.086799 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:25:05.086799 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:25:05.086799 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:25:05.086799 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:25:05.086799 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:25:05.086799 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:25:05.086799 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:25:05.086799 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:25:05.086799 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:25:05.086799 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:25:05.086799 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:25:05.086799 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 09:25:05.086799 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 09:25:05.086799 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 09:25:05.087709 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 09:25:05.087709 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:25:05.087709 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:25:05.087709 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:25:05.087709 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:25:05.087709 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:25:05.087709 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:25:05.087709 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:25:05.087709 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( Jul 14 09:25:05.087709 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:25:05.087709 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:25:05.087709 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:25:05.087709 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:25:05.087709 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:25:05.087709 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:25:05.087709 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:25:05.087709 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:25:05.093874 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 09:25:05.093874 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 09:25:05.093874 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 09:25:05.093874 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 09:25:05.093874 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 09:25:05.093874 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 09:25:05.093874 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 09:25:05.093874 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Jul 14 09:25:05.093874 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 350/679] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jul 14 09:25:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:25:05.093874 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec86bc72-3366-46a5-acad-8cc7001f6ebb None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:05.103020 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 330/680] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 14 09:25:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:25:05.103952 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db51d94c-ef8c-4840-bcf2-89f19dba8643 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:05.160879 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:05.203032 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec86bc72-3366-46a5-acad-8cc7001f6ebb None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:05.216284 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db51d94c-ef8c-4840-bcf2-89f19dba8643 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:05.237740 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3cfa85-8551-4a09-971c-cbda78edb8aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:05.238675 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3cfa85-8551-4a09-971c-cbda78edb8aa None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:05.238951 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3cfa85-8551-4a09-971c-cbda78edb8aa None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:05.239230 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3cfa85-8551-4a09-971c-cbda78edb8aa None admin] PATH_INFO: `/v3/projects/service` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:05.245338 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:05.247204 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3cfa85-8551-4a09-971c-cbda78edb8aa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:05.249201 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3cfa85-8551-4a09-971c-cbda78edb8aa None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:05.258406 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd11ebac-982c-4da5-989b-0051480a61ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:05.259079 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd11ebac-982c-4da5-989b-0051480a61ec None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:05.259362 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd11ebac-982c-4da5-989b-0051480a61ec None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:05.259638 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd11ebac-982c-4da5-989b-0051480a61ec None admin] PATH_INFO: `/v3/domains` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:05.260364 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd11ebac-982c-4da5-989b-0051480a61ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:05.260672 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd11ebac-982c-4da5-989b-0051480a61ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:05.262032 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd11ebac-982c-4da5-989b-0051480a61ec None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:05.264786 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-2e3cfa85-8551-4a09-971c-cbda78edb8aa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 09:25:05.264786 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:25:05.264786 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:25:05.264786 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:25:05.264786 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:25:05.264786 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:25:05.264786 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:25:05.264786 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:25:05.264786 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:25:05.264786 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:25:05.264786 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:25:05.264786 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:25:05.264786 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 09:25:05.264786 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 09:25:05.264786 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 09:25:05.265624 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 09:25:05.265624 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:25:05.265624 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:25:05.265624 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:25:05.265624 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:25:05.265624 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:25:05.265624 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:25:05.265624 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:25:05.265624 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( Jul 14 09:25:05.265624 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:25:05.265624 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:25:05.265624 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:25:05.265624 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:25:05.265624 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:25:05.265624 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:25:05.265624 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:25:05.265624 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:25:05.266572 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 09:25:05.266572 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 09:25:05.266572 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 09:25:05.266572 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 09:25:05.266572 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 09:25:05.266572 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 09:25:05.266572 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 09:25:05.266572 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Jul 14 09:25:05.270716 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 351/681] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jul 14 09:25:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:25:05.271365 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3cfa85-8551-4a09-971c-cbda78edb8aa None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:05.275733 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 331/682] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 14 09:25:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:25:05.280889 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd11ebac-982c-4da5-989b-0051480a61ec None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:05.385493 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3cfa85-8551-4a09-971c-cbda78edb8aa None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:05.385674 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd11ebac-982c-4da5-989b-0051480a61ec None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:05.413580 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:05.423465 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5796c705-c0eb-400f-81d5-c874d24dd0c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:05.424265 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5796c705-c0eb-400f-81d5-c874d24dd0c9 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:05.424550 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5796c705-c0eb-400f-81d5-c874d24dd0c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:05.424828 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5796c705-c0eb-400f-81d5-c874d24dd0c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:05.427148 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e40cb82-b711-4d54-8bf4-2ff12f15297e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:05.428196 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e40cb82-b711-4d54-8bf4-2ff12f15297e None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:05.428539 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e40cb82-b711-4d54-8bf4-2ff12f15297e None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:05.428880 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e40cb82-b711-4d54-8bf4-2ff12f15297e None admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:05.429677 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e40cb82-b711-4d54-8bf4-2ff12f15297e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:05.430039 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e40cb82-b711-4d54-8bf4-2ff12f15297e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:05.431926 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e40cb82-b711-4d54-8bf4-2ff12f15297e None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:05.435098 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5796c705-c0eb-400f-81d5-c874d24dd0c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:05.436544 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5796c705-c0eb-400f-81d5-c874d24dd0c9 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:05.447270 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 352/683] 10.222.0.40 () {56 vars in 1148 bytes} [Thu Jul 14 09:25:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:25:05.448425 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e40cb82-b711-4d54-8bf4-2ff12f15297e None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:05.454619 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-5796c705-c0eb-400f-81d5-c874d24dd0c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:25:05.454619 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:25:05.454619 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:25:05.454619 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:25:05.454619 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:25:05.454619 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:25:05.454619 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:25:05.454619 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:25:05.454619 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:25:05.454619 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:25:05.454619 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:25:05.454619 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:25:05.454619 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 09:25:05.454619 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 09:25:05.454619 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 09:25:05.455517 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 09:25:05.455517 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:25:05.455517 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:25:05.455517 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:25:05.455517 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:25:05.455517 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:25:05.455517 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:25:05.455517 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:25:05.455517 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( Jul 14 09:25:05.455517 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:25:05.455517 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:25:05.455517 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:25:05.455517 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:25:05.455517 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:25:05.455517 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:25:05.455517 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:25:05.455517 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:25:05.456708 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 09:25:05.456708 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 09:25:05.456708 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:25:05.456708 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:25:05.456708 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 332/684] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 09:25:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:25:05.456708 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5796c705-c0eb-400f-81d5-c874d24dd0c9 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:05.492924 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:05.578926 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5796c705-c0eb-400f-81d5-c874d24dd0c9 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:05.583335 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e40cb82-b711-4d54-8bf4-2ff12f15297e None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:05.618739 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd25bfe7-51f5-4d75-a938-336fe977e0b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:05.619413 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd25bfe7-51f5-4d75-a938-336fe977e0b7 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:05.619701 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd25bfe7-51f5-4d75-a938-336fe977e0b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:05.619979 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd25bfe7-51f5-4d75-a938-336fe977e0b7 None admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:05.620776 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd25bfe7-51f5-4d75-a938-336fe977e0b7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:05.621089 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd25bfe7-51f5-4d75-a938-336fe977e0b7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:05.621648 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18213dc0-dd57-45a6-b7b1-f1dd2353b1f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:05.622475 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18213dc0-dd57-45a6-b7b1-f1dd2353b1f7 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:05.622585 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd25bfe7-51f5-4d75-a938-336fe977e0b7 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:05.623007 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18213dc0-dd57-45a6-b7b1-f1dd2353b1f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:05.623007 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18213dc0-dd57-45a6-b7b1-f1dd2353b1f7 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:05.631775 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18213dc0-dd57-45a6-b7b1-f1dd2353b1f7 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:05.633232 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18213dc0-dd57-45a6-b7b1-f1dd2353b1f7 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:05.635029 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 353/685] 10.222.0.40 () {56 vars in 1148 bytes} [Thu Jul 14 09:25:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:25:05.639165 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd25bfe7-51f5-4d75-a938-336fe977e0b7 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:05.648956 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-18213dc0-dd57-45a6-b7b1-f1dd2353b1f7 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 14 09:25:05.648956 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:25:05.648956 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:25:05.648956 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:25:05.648956 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:25:05.648956 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:25:05.648956 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:25:05.648956 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:25:05.648956 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:25:05.648956 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:25:05.648956 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:25:05.648956 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:25:05.648956 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 09:25:05.648956 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 09:25:05.648956 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 09:25:05.648956 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 09:25:05.650080 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:25:05.650080 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:25:05.650080 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 09:25:05.650080 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 09:25:05.650080 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 09:25:05.650080 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 09:25:05.650080 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:25:05.650080 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:25:05.650080 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:25:05.650080 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:25:05.650080 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:25:05.650080 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( Jul 14 09:25:05.650080 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:25:05.650080 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:25:05.650080 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:25:05.650080 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:25:05.650080 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:25:05.650080 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:25:05.651341 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:25:05.651341 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:25:05.651341 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 09:25:05.651341 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 09:25:05.651341 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 09:25:05.651341 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 09:25:05.651341 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 09:25:05.651341 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 09:25:05.651341 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 14 09:25:05.651341 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:25:05.654722 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 333/686] 10.222.0.40 () {56 vars in 1096 bytes} [Thu Jul 14 09:25:05 2022] GET /identity/v3/users/swift => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:25:05.655389 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18213dc0-dd57-45a6-b7b1-f1dd2353b1f7 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:05.696844 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:05.755116 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:05.755902 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd25bfe7-51f5-4d75-a938-336fe977e0b7 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:05.764709 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18213dc0-dd57-45a6-b7b1-f1dd2353b1f7 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:05.791058 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea28372e-4594-4ab3-a848-f00338062a7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:05.791934 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea28372e-4594-4ab3-a848-f00338062a7c None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:05.792418 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea28372e-4594-4ab3-a848-f00338062a7c None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:05.792844 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea28372e-4594-4ab3-a848-f00338062a7c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:05.793839 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea28372e-4594-4ab3-a848-f00338062a7c None admin] RBAC: Adding query filter params (role.id=c12236aebd8048ba991da4671b44935f, scope.project.id=a478e76f04dd413f89ddfba7b0cdc9cc, user.id=65e4a5a8965e4802a9055d332179b7a8) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:05.794343 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea28372e-4594-4ab3-a848-f00338062a7c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:05.795788 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea28372e-4594-4ab3-a848-f00338062a7c None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:05.810221 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f740d6-a6bc-42d0-a4e7-179e0c334ddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:05.810484 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 354/687] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jul 14 09:25:05 2022] GET /identity/v3/role_assignments?user.id=65e4a5a8965e4802a9055d332179b7a8&scope.project.id=a478e76f04dd413f89ddfba7b0cdc9cc&role.id=c12236aebd8048ba991da4671b44935f => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:25:05.810585 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f740d6-a6bc-42d0-a4e7-179e0c334ddb None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:05.810585 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f740d6-a6bc-42d0-a4e7-179e0c334ddb None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:05.810752 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea28372e-4594-4ab3-a848-f00338062a7c None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:05.810836 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f740d6-a6bc-42d0-a4e7-179e0c334ddb None admin] PATH_INFO: `/v3/domains` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:05.810836 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f740d6-a6bc-42d0-a4e7-179e0c334ddb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:05.810836 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f740d6-a6bc-42d0-a4e7-179e0c334ddb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:05.810836 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f740d6-a6bc-42d0-a4e7-179e0c334ddb None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:05.823613 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 334/688] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 14 09:25:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:25:05.824585 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f740d6-a6bc-42d0-a4e7-179e0c334ddb None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:05.955715 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f740d6-a6bc-42d0-a4e7-179e0c334ddb None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:05.962467 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea28372e-4594-4ab3-a848-f00338062a7c None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:05.979173 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:05.998302 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c08dda4-4712-42b8-9f70-40a97430e21a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:05.999450 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c08dda4-4712-42b8-9f70-40a97430e21a None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:05.999928 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c08dda4-4712-42b8-9f70-40a97430e21a None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:06.000328 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c08dda4-4712-42b8-9f70-40a97430e21a None admin] PATH_INFO: `/v3/users` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:06.001215 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c08dda4-4712-42b8-9f70-40a97430e21a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:06.001532 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c08dda4-4712-42b8-9f70-40a97430e21a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:06.003078 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c08dda4-4712-42b8-9f70-40a97430e21a None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:06.022768 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf43f49-bca0-46b9-8b18-d413624fe891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:06.023660 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf43f49-bca0-46b9-8b18-d413624fe891 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:06.023771 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 335/689] 10.222.0.40 () {56 vars in 1135 bytes} [Thu Jul 14 09:25:05 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:25:06.023851 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf43f49-bca0-46b9-8b18-d413624fe891 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:06.024016 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf43f49-bca0-46b9-8b18-d413624fe891 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:06.024825 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c08dda4-4712-42b8-9f70-40a97430e21a None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:06.024945 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf43f49-bca0-46b9-8b18-d413624fe891 None admin] RBAC: Adding query filter params (role.id=c12236aebd8048ba991da4671b44935f, scope.project.id=a478e76f04dd413f89ddfba7b0cdc9cc, user.id=25048b29787d482783ebc944f1a7df65) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:06.025523 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf43f49-bca0-46b9-8b18-d413624fe891 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:06.026639 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf43f49-bca0-46b9-8b18-d413624fe891 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:06.035139 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 355/690] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jul 14 09:25:05 2022] GET /identity/v3/role_assignments?user.id=25048b29787d482783ebc944f1a7df65&scope.project.id=a478e76f04dd413f89ddfba7b0cdc9cc&role.id=c12236aebd8048ba991da4671b44935f => generated 608 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:25:06.036424 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf43f49-bca0-46b9-8b18-d413624fe891 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:06.040743 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:06.152969 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c08dda4-4712-42b8-9f70-40a97430e21a None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:06.193213 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31bb324-7a37-4c7f-8cad-7c451dea218f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:06.194874 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31bb324-7a37-4c7f-8cad-7c451dea218f None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:06.195277 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31bb324-7a37-4c7f-8cad-7c451dea218f None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:06.195682 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31bb324-7a37-4c7f-8cad-7c451dea218f None admin] PATH_INFO: `/v3/users/nova` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:06.196908 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf43f49-bca0-46b9-8b18-d413624fe891 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:06.205290 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31bb324-7a37-4c7f-8cad-7c451dea218f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:06.207038 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31bb324-7a37-4c7f-8cad-7c451dea218f None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:06.223684 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-f31bb324-7a37-4c7f-8cad-7c451dea218f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 14 09:25:06.223684 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:25:06.223684 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:25:06.223684 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:25:06.223684 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:25:06.223684 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:25:06.223684 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:25:06.223684 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:25:06.223684 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:25:06.223684 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:25:06.223684 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:25:06.223684 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:25:06.223684 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 09:25:06.223684 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 09:25:06.223684 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 09:25:06.223684 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 09:25:06.225529 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:25:06.225529 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:25:06.225529 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 09:25:06.225529 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 09:25:06.225529 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 09:25:06.225529 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 09:25:06.225529 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:25:06.225529 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:25:06.225529 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:25:06.225529 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:25:06.225529 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:25:06.225529 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( Jul 14 09:25:06.225529 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:25:06.225529 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:25:06.225529 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:25:06.225529 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:25:06.225529 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:25:06.225529 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:25:06.226496 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:25:06.226496 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:25:06.226496 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 09:25:06.226496 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 09:25:06.226496 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 09:25:06.226496 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 09:25:06.226496 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 09:25:06.226496 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 09:25:06.226496 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 14 09:25:06.226496 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:25:06.230342 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 336/691] 10.222.0.40 () {56 vars in 1093 bytes} [Thu Jul 14 09:25:06 2022] GET /identity/v3/users/nova => generated 82 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:25:06.232217 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31bb324-7a37-4c7f-8cad-7c451dea218f None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:06.246139 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad0d019-b0e0-40dd-99d1-8d599a8edd81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:06.247210 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad0d019-b0e0-40dd-99d1-8d599a8edd81 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:06.247732 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad0d019-b0e0-40dd-99d1-8d599a8edd81 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:06.248234 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad0d019-b0e0-40dd-99d1-8d599a8edd81 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:06.293749 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:06.311317 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:06.325504 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad0d019-b0e0-40dd-99d1-8d599a8edd81 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:06.327084 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad0d019-b0e0-40dd-99d1-8d599a8edd81 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:06.345892 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31bb324-7a37-4c7f-8cad-7c451dea218f None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:06.384298 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c460099-a6ec-4744-8c29-262016e59cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:06.385450 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c460099-a6ec-4744-8c29-262016e59cb1 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:06.385968 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c460099-a6ec-4744-8c29-262016e59cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:06.386498 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c460099-a6ec-4744-8c29-262016e59cb1 None admin] PATH_INFO: `/v3/users` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:06.387581 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c460099-a6ec-4744-8c29-262016e59cb1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:06.388108 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c460099-a6ec-4744-8c29-262016e59cb1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:06.389768 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c460099-a6ec-4744-8c29-262016e59cb1 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:06.414182 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 337/692] 10.222.0.40 () {56 vars in 1133 bytes} [Thu Jul 14 09:25:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:25:06.415838 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c460099-a6ec-4744-8c29-262016e59cb1 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:06.439766 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 356/693] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 14 09:25:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 09:25:06.445312 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad0d019-b0e0-40dd-99d1-8d599a8edd81 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:06.522291 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:06.522752 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c460099-a6ec-4744-8c29-262016e59cb1 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:06.561811 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:06.562991 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad0d019-b0e0-40dd-99d1-8d599a8edd81 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:06.570317 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a040f773-91eb-4b5a-83c6-b799a0abedef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:06.571291 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a040f773-91eb-4b5a-83c6-b799a0abedef None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:06.571771 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a040f773-91eb-4b5a-83c6-b799a0abedef None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:06.572240 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a040f773-91eb-4b5a-83c6-b799a0abedef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:06.605685 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a1fb7d-1213-48ae-ac46-a6b31f4dd46c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:06.606535 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a1fb7d-1213-48ae-ac46-a6b31f4dd46c None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:06.606825 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a1fb7d-1213-48ae-ac46-a6b31f4dd46c None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:06.607107 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a1fb7d-1213-48ae-ac46-a6b31f4dd46c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:06.619639 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a1fb7d-1213-48ae-ac46-a6b31f4dd46c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:06.621108 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a1fb7d-1213-48ae-ac46-a6b31f4dd46c None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:06.639331 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-44a1fb7d-1213-48ae-ac46-a6b31f4dd46c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:25:06.639331 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:25:06.639331 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:25:06.639331 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:25:06.639331 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:25:06.639331 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:25:06.639331 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:25:06.639331 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:25:06.639331 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:25:06.639331 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:25:06.639331 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:25:06.639331 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:25:06.639331 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 09:25:06.639331 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 09:25:06.639331 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 09:25:06.640701 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 09:25:06.640701 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:25:06.640701 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:25:06.640701 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:25:06.640701 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:25:06.640701 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:25:06.640701 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:25:06.640701 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:25:06.640701 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( Jul 14 09:25:06.640701 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:25:06.640701 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:25:06.640701 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:25:06.640701 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:25:06.640701 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:25:06.640701 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:25:06.640701 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:25:06.640701 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:25:06.642163 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 09:25:06.642163 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 09:25:06.642163 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:25:06.642163 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Jul 14 09:25:06.642163 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 357/694] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 09:25:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:25:06.646249 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a1fb7d-1213-48ae-ac46-a6b31f4dd46c None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:06.654117 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a040f773-91eb-4b5a-83c6-b799a0abedef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:06.656211 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a040f773-91eb-4b5a-83c6-b799a0abedef None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:06.766004 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 338/695] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 14 09:25:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 09:25:06.767813 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b610000-8d73-478e-9c48-0768814c8c5f None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:06.768340 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b610000-8d73-478e-9c48-0768814c8c5f None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:06.768812 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b610000-8d73-478e-9c48-0768814c8c5f None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:06.770806 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 339/696] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:25:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:25:06.772362 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b610000-8d73-478e-9c48-0768814c8c5f None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:06.785610 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a1fb7d-1213-48ae-ac46-a6b31f4dd46c None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:06.812395 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:06.817329 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:06.826002 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50b02aa-bc19-41a4-bcc7-999be30d26a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:06.827031 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50b02aa-bc19-41a4-bcc7-999be30d26a7 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:06.827407 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50b02aa-bc19-41a4-bcc7-999be30d26a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:06.827776 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50b02aa-bc19-41a4-bcc7-999be30d26a7 None admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:06.828604 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50b02aa-bc19-41a4-bcc7-999be30d26a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:06.829011 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50b02aa-bc19-41a4-bcc7-999be30d26a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:06.830533 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50b02aa-bc19-41a4-bcc7-999be30d26a7 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:06.846894 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 358/697] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 14 09:25:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:25:06.848446 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b47288-dfc4-44fa-8491-3a31f6468580 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:06.848835 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b47288-dfc4-44fa-8491-3a31f6468580 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:06.849213 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b47288-dfc4-44fa-8491-3a31f6468580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:06.875543 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-c1b47288-dfc4-44fa-8491-3a31f6468580 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:25:06.876889 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-c1b47288-dfc4-44fa-8491-3a31f6468580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:06.906149 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b610000-8d73-478e-9c48-0768814c8c5f None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:06.944880 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd88bc4-50d3-4b63-88d8-25edc898eb88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:06.945678 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd88bc4-50d3-4b63-88d8-25edc898eb88 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:06.945960 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd88bc4-50d3-4b63-88d8-25edc898eb88 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:06.946256 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd88bc4-50d3-4b63-88d8-25edc898eb88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:06.955661 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 359/698] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:25:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 09:25:06.956665 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b47288-dfc4-44fa-8491-3a31f6468580 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:06.958614 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd88bc4-50d3-4b63-88d8-25edc898eb88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:06.961618 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd88bc4-50d3-4b63-88d8-25edc898eb88 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:06.981393 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-8fd88bc4-50d3-4b63-88d8-25edc898eb88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:25:06.981393 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:25:06.981393 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:25:06.981393 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:25:06.981393 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:25:06.981393 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:25:06.981393 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:25:06.981393 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:25:06.981393 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:25:06.981393 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:25:06.981393 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:25:06.981393 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:25:06.981393 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 09:25:06.981393 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 09:25:06.981393 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 09:25:06.982622 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 09:25:06.982622 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:25:06.982622 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:25:06.982622 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:25:06.982622 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:25:06.982622 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:25:06.982622 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:25:06.982622 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:25:06.982622 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( Jul 14 09:25:06.982622 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:25:06.982622 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:25:06.982622 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:25:06.982622 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:25:06.982622 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:25:06.982622 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:25:06.982622 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:25:06.982622 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:25:06.984008 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 09:25:06.984008 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 09:25:06.984008 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:25:06.984008 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:25:06.984008 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 340/699] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 09:25:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:25:06.988378 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd88bc4-50d3-4b63-88d8-25edc898eb88 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:07.071604 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b47288-dfc4-44fa-8491-3a31f6468580 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:07.079668 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:07.087138 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:07.103656 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd88bc4-50d3-4b63-88d8-25edc898eb88 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:07.109663 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17c947e-230c-460b-a6d3-bc2754af63e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:07.110626 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17c947e-230c-460b-a6d3-bc2754af63e2 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:07.111008 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17c947e-230c-460b-a6d3-bc2754af63e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:07.111384 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17c947e-230c-460b-a6d3-bc2754af63e2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:07.118805 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17c947e-230c-460b-a6d3-bc2754af63e2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:07.120357 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17c947e-230c-460b-a6d3-bc2754af63e2 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:07.135300 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-a17c947e-230c-460b-a6d3-bc2754af63e2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 09:25:07.135300 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:25:07.135300 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:25:07.135300 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:25:07.135300 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:25:07.135300 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:25:07.135300 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:25:07.135300 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:25:07.135300 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:25:07.135300 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:25:07.135300 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:25:07.135300 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:25:07.135300 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 09:25:07.135300 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 09:25:07.135300 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 09:25:07.136393 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 09:25:07.136393 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:25:07.136393 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:25:07.136393 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:25:07.136393 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:25:07.136393 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:25:07.136393 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:25:07.136393 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:25:07.136393 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( Jul 14 09:25:07.136393 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:25:07.136393 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:25:07.136393 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:25:07.136393 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:25:07.136393 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:25:07.136393 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:25:07.136393 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:25:07.136393 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:25:07.137425 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 09:25:07.137425 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 09:25:07.137425 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 09:25:07.137425 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 09:25:07.137425 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 09:25:07.137425 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 09:25:07.137425 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 09:25:07.137425 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Jul 14 09:25:07.138916 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 360/700] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jul 14 09:25:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:25:07.139963 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17c947e-230c-460b-a6d3-bc2754af63e2 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:07.146376 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e80ea6b-40e7-41fd-bd62-4ad204a7e83a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:07.147886 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e80ea6b-40e7-41fd-bd62-4ad204a7e83a None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:07.148353 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e80ea6b-40e7-41fd-bd62-4ad204a7e83a None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:07.148812 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e80ea6b-40e7-41fd-bd62-4ad204a7e83a None admin] PATH_INFO: `/v3/domains` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:07.149735 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e80ea6b-40e7-41fd-bd62-4ad204a7e83a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:07.150266 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e80ea6b-40e7-41fd-bd62-4ad204a7e83a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:07.152060 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e80ea6b-40e7-41fd-bd62-4ad204a7e83a None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:07.170725 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 341/701] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 14 09:25:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:25:07.172327 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e80ea6b-40e7-41fd-bd62-4ad204a7e83a None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:07.250407 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17c947e-230c-460b-a6d3-bc2754af63e2 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:07.284290 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e80ea6b-40e7-41fd-bd62-4ad204a7e83a None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:07.288652 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a747d5bb-f1de-464a-b5e8-64e12a15ecce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:07.289547 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a747d5bb-f1de-464a-b5e8-64e12a15ecce None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:07.289901 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a747d5bb-f1de-464a-b5e8-64e12a15ecce None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:07.290287 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a747d5bb-f1de-464a-b5e8-64e12a15ecce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:07.302131 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a747d5bb-f1de-464a-b5e8-64e12a15ecce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:07.304155 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a747d5bb-f1de-464a-b5e8-64e12a15ecce None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:07.322539 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568934fa-d474-459a-9b18-5aba853c8db8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:07.323541 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568934fa-d474-459a-9b18-5aba853c8db8 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:07.324010 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568934fa-d474-459a-9b18-5aba853c8db8 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:07.324498 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568934fa-d474-459a-9b18-5aba853c8db8 None admin] PATH_INFO: `/v3/projects` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:07.324938 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-a747d5bb-f1de-464a-b5e8-64e12a15ecce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:25:07.324938 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:25:07.324938 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:25:07.324938 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:25:07.324938 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:25:07.324938 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:25:07.324938 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:25:07.324938 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:25:07.324938 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:25:07.324938 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:25:07.324938 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:25:07.324938 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:25:07.324938 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 09:25:07.324938 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 09:25:07.324938 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 09:25:07.325792 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 09:25:07.325792 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:25:07.325792 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:25:07.325792 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:25:07.325792 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:25:07.325792 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:25:07.325792 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:25:07.325792 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:25:07.325792 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( Jul 14 09:25:07.325792 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:25:07.325792 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:25:07.325792 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:25:07.325792 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:25:07.325792 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:25:07.325792 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:25:07.325792 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:25:07.325792 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:25:07.326724 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 09:25:07.326724 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 09:25:07.326724 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:25:07.326724 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Jul 14 09:25:07.326724 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 361/702] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 09:25:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:25:07.327755 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a747d5bb-f1de-464a-b5e8-64e12a15ecce None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:07.328329 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568934fa-d474-459a-9b18-5aba853c8db8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:07.328825 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568934fa-d474-459a-9b18-5aba853c8db8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:07.330598 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568934fa-d474-459a-9b18-5aba853c8db8 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:07.345102 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 342/703] 10.222.0.40 () {56 vars in 1148 bytes} [Thu Jul 14 09:25:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:25:07.346265 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568934fa-d474-459a-9b18-5aba853c8db8 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:07.349783 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:07.359620 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:07.440488 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a747d5bb-f1de-464a-b5e8-64e12a15ecce None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:07.453303 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568934fa-d474-459a-9b18-5aba853c8db8 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:07.477043 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe587c1-dd52-4c00-a597-47cd25c3e8cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:07.477946 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe587c1-dd52-4c00-a597-47cd25c3e8cf None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:07.478250 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe587c1-dd52-4c00-a597-47cd25c3e8cf None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:07.478530 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe587c1-dd52-4c00-a597-47cd25c3e8cf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:07.485850 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe587c1-dd52-4c00-a597-47cd25c3e8cf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:07.487508 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe587c1-dd52-4c00-a597-47cd25c3e8cf None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:07.490620 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a718d9f0-9bfb-4502-82ac-f8c11173b034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:07.491528 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a718d9f0-9bfb-4502-82ac-f8c11173b034 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:07.492015 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a718d9f0-9bfb-4502-82ac-f8c11173b034 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:07.492756 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a718d9f0-9bfb-4502-82ac-f8c11173b034 None admin] PATH_INFO: `/v3/domains` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:07.493686 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a718d9f0-9bfb-4502-82ac-f8c11173b034 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:07.494235 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a718d9f0-9bfb-4502-82ac-f8c11173b034 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:07.495966 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a718d9f0-9bfb-4502-82ac-f8c11173b034 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:07.502744 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-dfe587c1-dd52-4c00-a597-47cd25c3e8cf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 09:25:07.502744 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:25:07.502744 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:25:07.502744 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:25:07.502744 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:25:07.502744 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:25:07.502744 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:25:07.502744 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:25:07.502744 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:25:07.502744 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:25:07.502744 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:25:07.502744 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:25:07.502744 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 09:25:07.502744 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 09:25:07.502744 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 09:25:07.503687 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 09:25:07.503687 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:25:07.503687 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:25:07.503687 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:25:07.503687 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:25:07.503687 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:25:07.503687 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:25:07.503687 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:25:07.503687 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( Jul 14 09:25:07.503687 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:25:07.503687 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:25:07.503687 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:25:07.503687 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:25:07.503687 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:25:07.503687 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:25:07.503687 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:25:07.503687 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:25:07.504628 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 09:25:07.504628 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 09:25:07.504628 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 09:25:07.504628 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 09:25:07.504628 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 09:25:07.504628 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 09:25:07.504628 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 09:25:07.504628 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Jul 14 09:25:07.504628 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 362/704] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jul 14 09:25:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:25:07.505165 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe587c1-dd52-4c00-a597-47cd25c3e8cf None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:07.516973 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 343/705] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 14 09:25:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:25:07.518121 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a718d9f0-9bfb-4502-82ac-f8c11173b034 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:07.584460 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:07.599794 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:07.616851 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe587c1-dd52-4c00-a597-47cd25c3e8cf None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:07.627379 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a718d9f0-9bfb-4502-82ac-f8c11173b034 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:07.653408 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60cc472-fd75-444a-b40c-1e01b8109b74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:07.654130 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60cc472-fd75-444a-b40c-1e01b8109b74 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:07.654393 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60cc472-fd75-444a-b40c-1e01b8109b74 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:07.654671 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60cc472-fd75-444a-b40c-1e01b8109b74 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:07.655878 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60cc472-fd75-444a-b40c-1e01b8109b74 None admin] RBAC: Adding query filter params (role.id=c12236aebd8048ba991da4671b44935f, scope.project.id=a478e76f04dd413f89ddfba7b0cdc9cc, user.id=302c0f7dd3bf4829aad0b29bd0c091a5) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:07.655878 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60cc472-fd75-444a-b40c-1e01b8109b74 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:07.657338 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60cc472-fd75-444a-b40c-1e01b8109b74 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:07.664406 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 363/706] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jul 14 09:25:07 2022] GET /identity/v3/role_assignments?user.id=302c0f7dd3bf4829aad0b29bd0c091a5&scope.project.id=a478e76f04dd413f89ddfba7b0cdc9cc&role.id=c12236aebd8048ba991da4671b44935f => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:25:07.665311 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60cc472-fd75-444a-b40c-1e01b8109b74 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:07.677346 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa71e7a-6282-49e7-a2cd-802625e35916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:07.679408 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa71e7a-6282-49e7-a2cd-802625e35916 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:07.679948 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa71e7a-6282-49e7-a2cd-802625e35916 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:07.680486 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa71e7a-6282-49e7-a2cd-802625e35916 None admin] PATH_INFO: `/v3/projects` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:07.681550 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa71e7a-6282-49e7-a2cd-802625e35916 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:07.682096 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa71e7a-6282-49e7-a2cd-802625e35916 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:07.684020 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa71e7a-6282-49e7-a2cd-802625e35916 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:07.711048 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 344/707] 10.222.0.40 () {56 vars in 1148 bytes} [Thu Jul 14 09:25:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:25:07.717362 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa71e7a-6282-49e7-a2cd-802625e35916 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:07.836022 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa71e7a-6282-49e7-a2cd-802625e35916 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:07.866576 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:07.875376 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476b74f4-2df1-476c-b367-a948d4aaa67c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:07.876325 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476b74f4-2df1-476c-b367-a948d4aaa67c None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:07.876816 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476b74f4-2df1-476c-b367-a948d4aaa67c None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:07.877689 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476b74f4-2df1-476c-b367-a948d4aaa67c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:07.878801 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476b74f4-2df1-476c-b367-a948d4aaa67c None admin] RBAC: Adding query filter params (role.id=e3965bd0d5f1427a86a313c0c90bfef3, scope.project.id=a478e76f04dd413f89ddfba7b0cdc9cc, user.id=1f6962106dfa4c4c9af551053f8095e9) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:07.879355 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476b74f4-2df1-476c-b367-a948d4aaa67c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:07.881048 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476b74f4-2df1-476c-b367-a948d4aaa67c None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:07.889738 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 345/708] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jul 14 09:25:07 2022] GET /identity/v3/role_assignments?user.id=1f6962106dfa4c4c9af551053f8095e9&scope.project.id=a478e76f04dd413f89ddfba7b0cdc9cc&role.id=e3965bd0d5f1427a86a313c0c90bfef3 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:25:07.895670 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60cc472-fd75-444a-b40c-1e01b8109b74 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:07.936190 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2386276a-02d1-48c5-9232-dd1a4e710846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:07.936882 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2386276a-02d1-48c5-9232-dd1a4e710846 None admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:07.937168 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2386276a-02d1-48c5-9232-dd1a4e710846 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:07.937447 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2386276a-02d1-48c5-9232-dd1a4e710846 None admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:07.938167 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2386276a-02d1-48c5-9232-dd1a4e710846 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:07.939744 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2386276a-02d1-48c5-9232-dd1a4e710846 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:07.968671 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 364/709] 10.222.0.40 () {60 vars in 1132 bytes} [Thu Jul 14 09:25:07 2022] POST /identity/v3/users => generated 254 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:25:08.252629 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711a6ee6-4214-4c71-8dd1-09294faa9401 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:08.253364 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711a6ee6-4214-4c71-8dd1-09294faa9401 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:08.253859 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711a6ee6-4214-4c71-8dd1-09294faa9401 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:08.255947 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 346/710] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:25:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:25:08.261391 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba4f8d1-852b-4f56-842f-e9a4779c5b90 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:08.261705 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba4f8d1-852b-4f56-842f-e9a4779c5b90 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:08.261970 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba4f8d1-852b-4f56-842f-e9a4779c5b90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:08.276378 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:08.284509 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-1ba4f8d1-852b-4f56-842f-e9a4779c5b90 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:25:08.288691 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-1ba4f8d1-852b-4f56-842f-e9a4779c5b90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:08.367507 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 365/711] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:25:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 09:25:08.389674 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711a6ee6-4214-4c71-8dd1-09294faa9401 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:08.513310 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711a6ee6-4214-4c71-8dd1-09294faa9401 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:08.573287 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5575fe9f-fca9-4f59-b110-524c83979047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:08.574159 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5575fe9f-fca9-4f59-b110-524c83979047 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:08.574475 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5575fe9f-fca9-4f59-b110-524c83979047 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:08.574759 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5575fe9f-fca9-4f59-b110-524c83979047 None admin] PATH_INFO: `/v3/services/network` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:08.575489 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5575fe9f-fca9-4f59-b110-524c83979047 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:08.576897 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5575fe9f-fca9-4f59-b110-524c83979047 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:08.601019 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-5575fe9f-fca9-4f59-b110-524c83979047 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 14 09:25:08.601019 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:25:08.601019 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 09:25:08.601019 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 09:25:08.601019 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 09:25:08.601019 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 09:25:08.601019 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 09:25:08.601019 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 09:25:08.601019 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 14 09:25:08.601019 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:25:08.601019 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 09:25:08.601019 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:25:08.601019 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:25:08.601019 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:25:08.601019 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:25:08.601019 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:25:08.601019 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:25:08.602130 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:25:08.602130 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:25:08.602130 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:25:08.602130 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:25:08.602130 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:25:08.602130 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:25:08.602130 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 09:25:08.602130 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 09:25:08.602130 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 09:25:08.602130 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 09:25:08.602130 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:25:08.602130 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:25:08.602130 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:25:08.602130 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:25:08.602130 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:25:08.602130 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:25:08.603029 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:25:08.603029 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( Jul 14 09:25:08.603029 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:25:08.603029 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:25:08.603029 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:25:08.603029 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:25:08.603029 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:25:08.603029 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:25:08.603029 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:25:08.603029 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:25:08.603029 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 09:25:08.603029 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 09:25:08.603029 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 14 09:25:08.603029 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:25:08.603029 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 347/712] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jul 14 09:25:08 2022] GET /identity/v3/services/network => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:25:08.608586 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba4f8d1-852b-4f56-842f-e9a4779c5b90 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:08.714211 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba4f8d1-852b-4f56-842f-e9a4779c5b90 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:08.749544 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b941799a-601f-48c3-9fbd-cefe88abd37e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:08.750249 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b941799a-601f-48c3-9fbd-cefe88abd37e None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:08.750543 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b941799a-601f-48c3-9fbd-cefe88abd37e None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:08.750830 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b941799a-601f-48c3-9fbd-cefe88abd37e None admin] PATH_INFO: `/v3/services` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:08.751558 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b941799a-601f-48c3-9fbd-cefe88abd37e None admin] RBAC: Adding query filter params (name=network) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:08.751869 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b941799a-601f-48c3-9fbd-cefe88abd37e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:08.753257 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b941799a-601f-48c3-9fbd-cefe88abd37e None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:08.755460 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:08.762542 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 366/713] 10.222.0.40 () {56 vars in 1112 bytes} [Thu Jul 14 09:25:08 2022] GET /identity/v3/services?name=network => generated 124 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:25:08.765029 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5575fe9f-fca9-4f59-b110-524c83979047 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:08.768732 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b804916a-5a84-4286-b7e7-97703a4ac3ce None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:08.769274 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b804916a-5a84-4286-b7e7-97703a4ac3ce None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:08.769770 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b804916a-5a84-4286-b7e7-97703a4ac3ce None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:08.771666 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 367/714] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:25:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 09:25:08.777505 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ba2bf7-42bd-4fc9-9fe7-074fbdb07d92 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:08.778155 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ba2bf7-42bd-4fc9-9fe7-074fbdb07d92 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:08.778747 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ba2bf7-42bd-4fc9-9fe7-074fbdb07d92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:08.796074 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-33ba2bf7-42bd-4fc9-9fe7-074fbdb07d92 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:25:08.797675 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-33ba2bf7-42bd-4fc9-9fe7-074fbdb07d92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:08.828044 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:08.891577 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5575fe9f-fca9-4f59-b110-524c83979047 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:08.940906 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c69f5f-0046-459b-aa52-4d65ca8e29f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:08.941589 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c69f5f-0046-459b-aa52-4d65ca8e29f3 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:08.941873 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c69f5f-0046-459b-aa52-4d65ca8e29f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:08.942145 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c69f5f-0046-459b-aa52-4d65ca8e29f3 None admin] PATH_INFO: `/v3/services` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:08.942892 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c69f5f-0046-459b-aa52-4d65ca8e29f3 None admin] RBAC: Adding query filter params (type=network) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:08.943198 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c69f5f-0046-459b-aa52-4d65ca8e29f3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:08.945119 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c69f5f-0046-459b-aa52-4d65ca8e29f3 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:08.954305 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 368/715] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:25:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 09:25:08.960036 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 348/716] 10.222.0.40 () {56 vars in 1112 bytes} [Thu Jul 14 09:25:08 2022] GET /identity/v3/services?type=network => generated 124 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:25:08.976506 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ba2bf7-42bd-4fc9-9fe7-074fbdb07d92 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:09.124733 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ba2bf7-42bd-4fc9-9fe7-074fbdb07d92 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:09.163080 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:09.170923 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c62e89-3740-4cc7-8baf-53f90a91dcad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:09.171958 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c62e89-3740-4cc7-8baf-53f90a91dcad None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:09.172253 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c62e89-3740-4cc7-8baf-53f90a91dcad None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:09.172529 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c62e89-3740-4cc7-8baf-53f90a91dcad None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:09.173195 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c62e89-3740-4cc7-8baf-53f90a91dcad None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:09.174612 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c62e89-3740-4cc7-8baf-53f90a91dcad None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:09.190405 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-f1c62e89-3740-4cc7-8baf-53f90a91dcad None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 14 09:25:09.190405 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:25:09.190405 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 09:25:09.190405 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 09:25:09.190405 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 09:25:09.190405 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 09:25:09.190405 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 09:25:09.190405 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 09:25:09.190405 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 14 09:25:09.190405 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Jul 14 09:25:09.190405 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 09:25:09.190405 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Jul 14 09:25:09.190405 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:25:09.190405 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:25:09.190405 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:25:09.190405 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:25:09.191409 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:25:09.191409 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:25:09.191409 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:25:09.191409 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:25:09.191409 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:25:09.191409 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:25:09.191409 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:25:09.191409 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 09:25:09.191409 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 09:25:09.191409 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 09:25:09.191409 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 09:25:09.191409 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:25:09.191409 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:25:09.191409 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:25:09.191409 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:25:09.191409 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:25:09.192240 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:25:09.192240 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:25:09.192240 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( Jul 14 09:25:09.192240 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:25:09.192240 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:25:09.192240 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:25:09.192240 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:25:09.192240 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:25:09.192240 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:25:09.192240 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:25:09.192240 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:25:09.192240 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 09:25:09.192240 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 09:25:09.192240 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 14 09:25:09.192240 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Jul 14 09:25:09.195404 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 369/717] 10.222.0.40 () {56 vars in 1129 bytes} [Thu Jul 14 09:25:08 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:25:09.198511 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c69f5f-0046-459b-aa52-4d65ca8e29f3 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:09.328551 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c69f5f-0046-459b-aa52-4d65ca8e29f3 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:09.353656 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:09.383854 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf24fb91-8035-4100-8b9a-a9c12f084172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:09.384450 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf24fb91-8035-4100-8b9a-a9c12f084172 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:09.384730 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf24fb91-8035-4100-8b9a-a9c12f084172 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:09.385003 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf24fb91-8035-4100-8b9a-a9c12f084172 None admin] PATH_INFO: `/v3/services` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:09.385715 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf24fb91-8035-4100-8b9a-a9c12f084172 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:09.386019 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf24fb91-8035-4100-8b9a-a9c12f084172 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:09.387669 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf24fb91-8035-4100-8b9a-a9c12f084172 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:09.395812 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 349/718] 10.222.0.40 () {56 vars in 1124 bytes} [Thu Jul 14 09:25:09 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:25:09.401468 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c62e89-3740-4cc7-8baf-53f90a91dcad None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:09.547454 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c62e89-3740-4cc7-8baf-53f90a91dcad None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:09.701715 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1520fc89-6f45-4cb6-8ae4-63d2b99508ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:09.702737 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1520fc89-6f45-4cb6-8ae4-63d2b99508ac None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:09.703165 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1520fc89-6f45-4cb6-8ae4-63d2b99508ac None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:09.703585 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1520fc89-6f45-4cb6-8ae4-63d2b99508ac None admin] PATH_INFO: `/v3/services` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:09.704503 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1520fc89-6f45-4cb6-8ae4-63d2b99508ac None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:09.704964 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1520fc89-6f45-4cb6-8ae4-63d2b99508ac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:09.706560 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1520fc89-6f45-4cb6-8ae4-63d2b99508ac None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:09.718312 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 370/719] 10.222.0.40 () {56 vars in 1124 bytes} [Thu Jul 14 09:25:09 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:25:10.401212 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd34613-6723-438f-b655-803300459aa0 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:10.402095 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd34613-6723-438f-b655-803300459aa0 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:10.402591 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd34613-6723-438f-b655-803300459aa0 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:10.404570 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 350/720] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:25:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:25:10.409448 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5147fb-e95f-478b-817d-f31a8f59489a None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:10.409912 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5147fb-e95f-478b-817d-f31a8f59489a None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:10.410391 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5147fb-e95f-478b-817d-f31a8f59489a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:10.435195 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-ea5147fb-e95f-478b-817d-f31a8f59489a None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:25:10.436766 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-ea5147fb-e95f-478b-817d-f31a8f59489a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:10.440608 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f8aaab-b1c1-45ed-948e-9f1ad5d241ba None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:10.441022 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f8aaab-b1c1-45ed-948e-9f1ad5d241ba None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:10.441413 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f8aaab-b1c1-45ed-948e-9f1ad5d241ba None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:10.443189 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 351/721] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:25:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:25:10.450548 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68b2582-7cc2-4f87-afe1-7c4728a1b504 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:10.450972 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68b2582-7cc2-4f87-afe1-7c4728a1b504 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:10.451364 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68b2582-7cc2-4f87-afe1-7c4728a1b504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:10.472268 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-a68b2582-7cc2-4f87-afe1-7c4728a1b504 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:25:10.473648 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-a68b2582-7cc2-4f87-afe1-7c4728a1b504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:10.546578 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:10.571386 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 371/722] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:25:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 09:25:10.600904 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 352/723] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:25:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 09:25:10.612665 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5147fb-e95f-478b-817d-f31a8f59489a None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:10.658281 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68b2582-7cc2-4f87-afe1-7c4728a1b504 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:10.749761 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5147fb-e95f-478b-817d-f31a8f59489a None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:10.795617 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c96d4ef-8e05-4545-9eb0-ac77f4a9bb13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:10.799503 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c96d4ef-8e05-4545-9eb0-ac77f4a9bb13 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:10.800035 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c96d4ef-8e05-4545-9eb0-ac77f4a9bb13 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:10.800519 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c96d4ef-8e05-4545-9eb0-ac77f4a9bb13 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:10.812489 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c96d4ef-8e05-4545-9eb0-ac77f4a9bb13 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:25:10.821104 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-7c96d4ef-8e05-4545-9eb0-ac77f4a9bb13 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 09:25:10.821104 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:25:10.821104 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:25:10.821104 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:25:10.821104 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:25:10.821104 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:25:10.821104 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:25:10.821104 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:25:10.821104 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:25:10.821104 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:25:10.821104 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:25:10.821104 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:25:10.821104 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:25:10.821104 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:25:10.821104 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:25:10.821104 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:25:10.822043 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:25:10.822043 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:25:10.822043 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:25:10.822043 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:25:10.822043 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:25:10.822043 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:25:10.822043 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:25:10.822043 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:25:10.822043 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:25:10.822043 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:25:10.822043 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:25:10.822043 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( Jul 14 09:25:10.822043 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:25:10.822043 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:25:10.822043 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:25:10.822043 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:25:10.822920 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:25:10.822920 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:25:10.822920 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:25:10.822920 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:25:10.822920 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:25:10.822920 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:25:10.822920 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:25:10.822920 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:25:10.822920 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:25:10.822920 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:25:10.822920 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 09:25:10.822920 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Jul 14 09:25:10.825555 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68b2582-7cc2-4f87-afe1-7c4728a1b504 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:10.825783 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 372/724] 10.222.0.40 () {56 vars in 1096 bytes} [Thu Jul 14 09:25:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:25:10.835197 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c96d4ef-8e05-4545-9eb0-ac77f4a9bb13 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:10.838446 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:10.894496 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:10.902914 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e60d19f-c6e9-4be5-85bb-0c01bc7c43bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:10.903791 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e60d19f-c6e9-4be5-85bb-0c01bc7c43bb None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:10.904131 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e60d19f-c6e9-4be5-85bb-0c01bc7c43bb None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:10.904531 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e60d19f-c6e9-4be5-85bb-0c01bc7c43bb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:10.916456 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e60d19f-c6e9-4be5-85bb-0c01bc7c43bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:25:10.924334 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-3e60d19f-c6e9-4be5-85bb-0c01bc7c43bb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 09:25:10.924334 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:25:10.924334 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:25:10.924334 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:25:10.924334 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:25:10.924334 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:25:10.924334 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:25:10.924334 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:25:10.924334 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:25:10.924334 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:25:10.924334 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:25:10.924334 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:25:10.924334 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:25:10.924334 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:25:10.924334 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:25:10.924334 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:25:10.925260 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:25:10.925260 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:25:10.925260 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:25:10.925260 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:25:10.925260 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:25:10.925260 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:25:10.925260 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:25:10.925260 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:25:10.925260 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:25:10.925260 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:25:10.925260 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:25:10.925260 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( Jul 14 09:25:10.925260 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:25:10.925260 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:25:10.925260 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:25:10.925260 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:25:10.926159 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:25:10.926159 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:25:10.926159 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:25:10.926159 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:25:10.926159 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:25:10.926159 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:25:10.926159 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:25:10.926159 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:25:10.926159 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:25:10.926159 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:25:10.926159 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 09:25:10.926159 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:25:10.926159 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 353/725] 10.222.0.40 () {56 vars in 1096 bytes} [Thu Jul 14 09:25:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:25:10.927388 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa6d4df-1a30-47e8-9275-a6c425500f08 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:10.927568 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa6d4df-1a30-47e8-9275-a6c425500f08 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:10.928461 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa6d4df-1a30-47e8-9275-a6c425500f08 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:10.930006 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 354/726] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:25:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:25:10.932294 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa6d4df-1a30-47e8-9275-a6c425500f08 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:10.953692 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c96d4ef-8e05-4545-9eb0-ac77f4a9bb13 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:10.995872 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12586e64-72a3-49ec-a614-26c49024fc41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:10.996908 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12586e64-72a3-49ec-a614-26c49024fc41 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:11.002215 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12586e64-72a3-49ec-a614-26c49024fc41 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:11.002215 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12586e64-72a3-49ec-a614-26c49024fc41 None admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:11.002215 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12586e64-72a3-49ec-a614-26c49024fc41 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:11.002215 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12586e64-72a3-49ec-a614-26c49024fc41 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:11.002215 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12586e64-72a3-49ec-a614-26c49024fc41 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:11.009536 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 373/727] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 14 09:25:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:25:11.015238 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844efd4c-8dff-4c5f-a716-caef15653b7c None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:11.015535 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844efd4c-8dff-4c5f-a716-caef15653b7c None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:11.015819 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844efd4c-8dff-4c5f-a716-caef15653b7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:11.032735 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-844efd4c-8dff-4c5f-a716-caef15653b7c None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:25:11.033949 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-844efd4c-8dff-4c5f-a716-caef15653b7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:11.046950 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa6d4df-1a30-47e8-9275-a6c425500f08 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:11.084634 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bef2caa-f9ae-413c-bc4d-d9857588ae61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:11.085317 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bef2caa-f9ae-413c-bc4d-d9857588ae61 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:11.085601 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bef2caa-f9ae-413c-bc4d-d9857588ae61 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:11.085876 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bef2caa-f9ae-413c-bc4d-d9857588ae61 None admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:11.086769 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bef2caa-f9ae-413c-bc4d-d9857588ae61 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:11.087188 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bef2caa-f9ae-413c-bc4d-d9857588ae61 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:11.088575 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bef2caa-f9ae-413c-bc4d-d9857588ae61 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:11.104018 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 355/728] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 14 09:25:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:25:11.105481 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bef2caa-f9ae-413c-bc4d-d9857588ae61 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:11.106356 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 374/729] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:25:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 09:25:11.111185 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844efd4c-8dff-4c5f-a716-caef15653b7c None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:11.163905 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:11.216155 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:11.225457 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844efd4c-8dff-4c5f-a716-caef15653b7c None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:11.262360 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00a6ab0-1799-4786-9464-77edd6dee5e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:11.263166 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00a6ab0-1799-4786-9464-77edd6dee5e5 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:11.263452 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00a6ab0-1799-4786-9464-77edd6dee5e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:11.263732 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00a6ab0-1799-4786-9464-77edd6dee5e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:11.274392 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00a6ab0-1799-4786-9464-77edd6dee5e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:11.275855 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00a6ab0-1799-4786-9464-77edd6dee5e5 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:11.294045 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-d00a6ab0-1799-4786-9464-77edd6dee5e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:25:11.294045 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:25:11.294045 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:25:11.294045 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:25:11.294045 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:25:11.294045 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:25:11.294045 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:25:11.294045 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:25:11.294045 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:25:11.294045 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:25:11.294045 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:25:11.294045 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:25:11.294045 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 09:25:11.294045 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 09:25:11.294045 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 09:25:11.296114 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 09:25:11.296114 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:25:11.296114 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:25:11.296114 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:25:11.296114 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:25:11.296114 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:25:11.296114 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:25:11.296114 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:25:11.296114 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( Jul 14 09:25:11.296114 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:25:11.296114 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:25:11.296114 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:25:11.296114 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:25:11.296114 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:25:11.296114 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:25:11.296114 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:25:11.296114 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:25:11.298274 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 09:25:11.298274 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 09:25:11.298274 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:25:11.298274 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Jul 14 09:25:11.298274 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 375/730] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 09:25:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:25:11.298274 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00a6ab0-1799-4786-9464-77edd6dee5e5 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:11.351396 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bef2caa-f9ae-413c-bc4d-d9857588ae61 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:11.397017 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:11.408132 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00a6ab0-1799-4786-9464-77edd6dee5e5 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:11.417324 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bc7a7f-7420-44f7-baf5-45899856e756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:11.418774 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bc7a7f-7420-44f7-baf5-45899856e756 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:11.419290 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bc7a7f-7420-44f7-baf5-45899856e756 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:11.419799 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bc7a7f-7420-44f7-baf5-45899856e756 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:11.439476 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bc7a7f-7420-44f7-baf5-45899856e756 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:11.442630 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bc7a7f-7420-44f7-baf5-45899856e756 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:11.448653 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b461ed0-de3b-4902-87a9-b0a9bcc0427f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:11.451182 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b461ed0-de3b-4902-87a9-b0a9bcc0427f None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:11.451581 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b461ed0-de3b-4902-87a9-b0a9bcc0427f None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:11.451965 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b461ed0-de3b-4902-87a9-b0a9bcc0427f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:11.466506 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b461ed0-de3b-4902-87a9-b0a9bcc0427f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:25:11.468256 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-f1bc7a7f-7420-44f7-baf5-45899856e756 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:25:11.468256 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:25:11.468256 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:25:11.468256 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:25:11.468256 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:25:11.468256 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:25:11.468256 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:25:11.468256 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:25:11.468256 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:25:11.468256 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:25:11.468256 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:25:11.468256 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:25:11.468256 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 09:25:11.468256 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 09:25:11.468256 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 09:25:11.469291 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 09:25:11.469291 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:25:11.469291 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:25:11.469291 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:25:11.469291 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:25:11.469291 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:25:11.469291 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:25:11.469291 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:25:11.469291 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( Jul 14 09:25:11.469291 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:25:11.469291 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:25:11.469291 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:25:11.469291 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:25:11.469291 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:25:11.469291 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:25:11.469291 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:25:11.469291 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:25:11.470464 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 09:25:11.470464 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 09:25:11.470464 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:25:11.470464 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:25:11.476927 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 356/731] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 09:25:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 372 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:25:11.477278 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-7b461ed0-de3b-4902-87a9-b0a9bcc0427f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 09:25:11.477278 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:25:11.477278 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:25:11.477278 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:25:11.477278 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:25:11.477278 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:25:11.477278 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:25:11.477278 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:25:11.477278 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:25:11.477278 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:25:11.477278 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:25:11.477278 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:25:11.477278 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:25:11.477278 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:25:11.477278 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:25:11.477278 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:25:11.478439 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:25:11.478439 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:25:11.478439 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:25:11.478439 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:25:11.478439 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:25:11.478439 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:25:11.478439 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:25:11.478439 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:25:11.478439 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:25:11.478439 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:25:11.478439 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:25:11.478439 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( Jul 14 09:25:11.478439 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:25:11.478439 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:25:11.478439 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:25:11.478439 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:25:11.479478 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:25:11.479478 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:25:11.479478 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:25:11.479478 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:25:11.479478 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:25:11.479478 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:25:11.479478 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:25:11.479478 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:25:11.479478 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:25:11.479478 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:25:11.479478 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 09:25:11.479478 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Jul 14 09:25:11.481240 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bc7a7f-7420-44f7-baf5-45899856e756 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:11.486289 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 376/732] 10.222.0.40 () {56 vars in 1102 bytes} [Thu Jul 14 09:25:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:25:11.488352 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b461ed0-de3b-4902-87a9-b0a9bcc0427f None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:11.588976 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:11.609146 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b461ed0-de3b-4902-87a9-b0a9bcc0427f None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:11.609570 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bc7a7f-7420-44f7-baf5-45899856e756 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:11.644384 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226644d2-04de-47f4-a228-6f89b591b4da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:11.645062 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226644d2-04de-47f4-a228-6f89b591b4da None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:11.645343 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226644d2-04de-47f4-a228-6f89b591b4da None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:11.645618 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226644d2-04de-47f4-a228-6f89b591b4da None admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:11.646499 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226644d2-04de-47f4-a228-6f89b591b4da None admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:11.646816 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226644d2-04de-47f4-a228-6f89b591b4da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:11.648187 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226644d2-04de-47f4-a228-6f89b591b4da None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:11.648989 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf98053-2192-4307-a852-e502841b07b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:11.649990 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf98053-2192-4307-a852-e502841b07b7 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:11.650616 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf98053-2192-4307-a852-e502841b07b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:11.650895 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf98053-2192-4307-a852-e502841b07b7 None admin] PATH_INFO: `/v3/domains` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:11.651626 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf98053-2192-4307-a852-e502841b07b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:11.651935 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf98053-2192-4307-a852-e502841b07b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:11.653284 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf98053-2192-4307-a852-e502841b07b7 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:11.660301 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 377/733] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 14 09:25:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:25:11.661122 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226644d2-04de-47f4-a228-6f89b591b4da None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:11.671969 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 357/734] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 14 09:25:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:25:11.671969 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3540fef-2816-460a-be11-cc224c5516a1 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:11.671969 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3540fef-2816-460a-be11-cc224c5516a1 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:11.671969 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3540fef-2816-460a-be11-cc224c5516a1 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:11.671969 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 358/735] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:25:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:25:11.672554 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3540fef-2816-460a-be11-cc224c5516a1 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:11.681780 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:11.770795 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226644d2-04de-47f4-a228-6f89b591b4da None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:11.777119 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3540fef-2816-460a-be11-cc224c5516a1 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:11.808973 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c882eeb3-9d9f-4761-9975-d21d25f7b908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:11.809642 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c882eeb3-9d9f-4761-9975-d21d25f7b908 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:11.809923 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c882eeb3-9d9f-4761-9975-d21d25f7b908 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:11.810209 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c882eeb3-9d9f-4761-9975-d21d25f7b908 None admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:11.810979 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c882eeb3-9d9f-4761-9975-d21d25f7b908 None admin] RBAC: Adding query filter params (name=service) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:11.811287 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c882eeb3-9d9f-4761-9975-d21d25f7b908 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:11.812358 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907a7bb7-fcdf-4def-995e-52b5e17b1801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:11.812641 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c882eeb3-9d9f-4761-9975-d21d25f7b908 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:11.813166 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907a7bb7-fcdf-4def-995e-52b5e17b1801 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:11.813453 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907a7bb7-fcdf-4def-995e-52b5e17b1801 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:11.813757 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907a7bb7-fcdf-4def-995e-52b5e17b1801 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:11.821308 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 378/736] 10.222.0.40 () {56 vars in 1103 bytes} [Thu Jul 14 09:25:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:25:11.821978 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c882eeb3-9d9f-4761-9975-d21d25f7b908 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:11.826369 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907a7bb7-fcdf-4def-995e-52b5e17b1801 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:11.827932 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907a7bb7-fcdf-4def-995e-52b5e17b1801 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:11.842933 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-907a7bb7-fcdf-4def-995e-52b5e17b1801 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 14 09:25:11.842933 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:25:11.842933 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:25:11.842933 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:25:11.842933 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:25:11.842933 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:25:11.842933 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:25:11.842933 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:25:11.842933 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:25:11.842933 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:25:11.842933 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:25:11.842933 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:25:11.842933 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 09:25:11.842933 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 09:25:11.842933 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 09:25:11.842933 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 09:25:11.843900 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:25:11.843900 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:25:11.843900 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 09:25:11.843900 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 09:25:11.843900 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 09:25:11.843900 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 09:25:11.843900 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:25:11.843900 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:25:11.843900 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:25:11.843900 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:25:11.843900 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:25:11.843900 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( Jul 14 09:25:11.843900 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:25:11.843900 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:25:11.843900 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:25:11.843900 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:25:11.843900 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:25:11.843900 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:25:11.845451 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:25:11.845451 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:25:11.845451 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 09:25:11.845451 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 09:25:11.845451 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 09:25:11.845451 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 09:25:11.845451 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 09:25:11.845451 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 09:25:11.845451 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 14 09:25:11.845451 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:25:11.845451 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 359/737] 10.222.0.40 () {56 vars in 1093 bytes} [Thu Jul 14 09:25:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:25:11.846060 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d64c12-2475-4232-b4da-00283bb992a7 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:11.846060 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d64c12-2475-4232-b4da-00283bb992a7 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:11.846211 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d64c12-2475-4232-b4da-00283bb992a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:11.851843 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:11.867328 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-69d64c12-2475-4232-b4da-00283bb992a7 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:25:11.868933 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-69d64c12-2475-4232-b4da-00283bb992a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:11.907355 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:11.936899 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c882eeb3-9d9f-4761-9975-d21d25f7b908 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:11.937565 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 360/738] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:25:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 09:25:11.938427 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d64c12-2475-4232-b4da-00283bb992a7 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:11.979297 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb8c55f-41a4-423b-a91e-5bdf42d4e397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:11.980402 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb8c55f-41a4-423b-a91e-5bdf42d4e397 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:11.980960 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb8c55f-41a4-423b-a91e-5bdf42d4e397 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:11.981420 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb8c55f-41a4-423b-a91e-5bdf42d4e397 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:11.989378 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb8c55f-41a4-423b-a91e-5bdf42d4e397 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:11.991713 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb8c55f-41a4-423b-a91e-5bdf42d4e397 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:12.008043 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-dbb8c55f-41a4-423b-a91e-5bdf42d4e397 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 14 09:25:12.008043 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:25:12.008043 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:25:12.008043 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:25:12.008043 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:25:12.008043 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:25:12.008043 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:25:12.008043 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:25:12.008043 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:25:12.008043 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:25:12.008043 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:25:12.008043 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:25:12.008043 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 09:25:12.008043 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 09:25:12.008043 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 09:25:12.008043 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 09:25:12.009006 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:25:12.009006 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:25:12.009006 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 09:25:12.009006 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 09:25:12.009006 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 09:25:12.009006 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 09:25:12.009006 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:25:12.009006 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:25:12.009006 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:25:12.009006 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:25:12.009006 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:25:12.009006 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( Jul 14 09:25:12.009006 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:25:12.009006 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:25:12.009006 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:25:12.009006 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:25:12.009006 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:25:12.009006 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:25:12.009918 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:25:12.009918 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:25:12.009918 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 09:25:12.009918 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 09:25:12.009918 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 09:25:12.009918 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 09:25:12.009918 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 09:25:12.009918 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 09:25:12.009918 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 14 09:25:12.009918 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Jul 14 09:25:12.011969 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 379/739] 10.222.0.40 () {56 vars in 1096 bytes} [Thu Jul 14 09:25:11 2022] GET /identity/v3/users/swift => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:25:12.012879 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb8c55f-41a4-423b-a91e-5bdf42d4e397 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:12.042077 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d64c12-2475-4232-b4da-00283bb992a7 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:12.071587 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:12.076868 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610ed1f0-7220-4b22-9942-c9fa6926a1e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:12.077671 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610ed1f0-7220-4b22-9942-c9fa6926a1e7 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:12.077953 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610ed1f0-7220-4b22-9942-c9fa6926a1e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:12.078249 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610ed1f0-7220-4b22-9942-c9fa6926a1e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:12.090231 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610ed1f0-7220-4b22-9942-c9fa6926a1e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:12.092656 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610ed1f0-7220-4b22-9942-c9fa6926a1e7 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:12.112228 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-610ed1f0-7220-4b22-9942-c9fa6926a1e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:25:12.112228 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:25:12.112228 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:25:12.112228 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:25:12.112228 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:25:12.112228 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:25:12.112228 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:25:12.112228 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:25:12.112228 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:25:12.112228 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:25:12.112228 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:25:12.112228 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:25:12.112228 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 09:25:12.112228 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 09:25:12.112228 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 09:25:12.113344 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 09:25:12.113344 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:25:12.113344 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:25:12.113344 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:25:12.113344 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:25:12.113344 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:25:12.113344 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:25:12.113344 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:25:12.113344 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( Jul 14 09:25:12.113344 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:25:12.113344 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:25:12.113344 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:25:12.113344 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:25:12.113344 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:25:12.113344 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:25:12.113344 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:25:12.113344 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:25:12.114294 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 09:25:12.114294 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 09:25:12.114294 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:25:12.114294 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:25:12.114294 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 361/740] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 09:25:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:25:12.114628 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610ed1f0-7220-4b22-9942-c9fa6926a1e7 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:12.126515 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb8c55f-41a4-423b-a91e-5bdf42d4e397 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:12.161505 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7700e4cd-d98b-4b2a-a4ec-7c18a14708fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:12.162760 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7700e4cd-d98b-4b2a-a4ec-7c18a14708fd None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:12.163049 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7700e4cd-d98b-4b2a-a4ec-7c18a14708fd None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:12.163325 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7700e4cd-d98b-4b2a-a4ec-7c18a14708fd None admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:12.164157 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7700e4cd-d98b-4b2a-a4ec-7c18a14708fd None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:12.164462 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7700e4cd-d98b-4b2a-a4ec-7c18a14708fd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:12.165871 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7700e4cd-d98b-4b2a-a4ec-7c18a14708fd None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:12.167555 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:12.184436 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 380/741] 10.222.0.40 () {56 vars in 1133 bytes} [Thu Jul 14 09:25:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:25:12.185153 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7700e4cd-d98b-4b2a-a4ec-7c18a14708fd None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:12.219032 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610ed1f0-7220-4b22-9942-c9fa6926a1e7 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:12.252571 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4bc796-24e6-4484-a05d-9e6f5b3fb326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:12.253177 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4bc796-24e6-4484-a05d-9e6f5b3fb326 None admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:12.253470 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4bc796-24e6-4484-a05d-9e6f5b3fb326 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:12.253746 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4bc796-24e6-4484-a05d-9e6f5b3fb326 None admin] PATH_INFO: `/v3/services` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:12.254509 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4bc796-24e6-4484-a05d-9e6f5b3fb326 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:12.259433 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4bc796-24e6-4484-a05d-9e6f5b3fb326 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:12.276021 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 362/742] 10.222.0.40 () {60 vars in 1141 bytes} [Thu Jul 14 09:25:12 2022] POST /identity/v3/services => generated 240 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:25:12.276865 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4bc796-24e6-4484-a05d-9e6f5b3fb326 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:12.295800 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7700e4cd-d98b-4b2a-a4ec-7c18a14708fd None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:12.331041 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:12.353105 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34c26ef-0698-4f5f-87bc-f6936dc0ce0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:12.353803 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34c26ef-0698-4f5f-87bc-f6936dc0ce0d None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:12.354093 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34c26ef-0698-4f5f-87bc-f6936dc0ce0d None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:12.354410 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34c26ef-0698-4f5f-87bc-f6936dc0ce0d None admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:12.355270 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34c26ef-0698-4f5f-87bc-f6936dc0ce0d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:12.355706 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34c26ef-0698-4f5f-87bc-f6936dc0ce0d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:12.357221 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34c26ef-0698-4f5f-87bc-f6936dc0ce0d None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:12.377774 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 381/743] 10.222.0.40 () {56 vars in 1135 bytes} [Thu Jul 14 09:25:12 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:25:12.379651 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64fffaa-7fcd-407c-aa85-c706af7aa0a3 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:12.379943 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64fffaa-7fcd-407c-aa85-c706af7aa0a3 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:12.380222 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64fffaa-7fcd-407c-aa85-c706af7aa0a3 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:12.382254 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 382/744] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:25:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:25:12.386788 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64fffaa-7fcd-407c-aa85-c706af7aa0a3 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:12.404881 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4bc796-24e6-4484-a05d-9e6f5b3fb326 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:12.440918 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:12.445111 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52f894f-b986-4481-8882-81f6b783a061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:12.445111 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52f894f-b986-4481-8882-81f6b783a061 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:12.445668 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52f894f-b986-4481-8882-81f6b783a061 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:12.445668 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52f894f-b986-4481-8882-81f6b783a061 None admin] PATH_INFO: `/v3/domains` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:12.446444 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52f894f-b986-4481-8882-81f6b783a061 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:12.446807 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52f894f-b986-4481-8882-81f6b783a061 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:12.448195 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52f894f-b986-4481-8882-81f6b783a061 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:12.461837 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 363/745] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 14 09:25:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:25:12.462673 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52f894f-b986-4481-8882-81f6b783a061 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:12.504409 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64fffaa-7fcd-407c-aa85-c706af7aa0a3 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:12.544580 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c557f7-d42d-4184-9037-1d95350827e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:12.545392 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c557f7-d42d-4184-9037-1d95350827e1 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:12.545677 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c557f7-d42d-4184-9037-1d95350827e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:12.546362 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c557f7-d42d-4184-9037-1d95350827e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:12.557756 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c557f7-d42d-4184-9037-1d95350827e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:12.559251 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c557f7-d42d-4184-9037-1d95350827e1 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:12.576955 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52f894f-b986-4481-8882-81f6b783a061 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:12.577373 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-10c557f7-d42d-4184-9037-1d95350827e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:25:12.577373 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:25:12.577373 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:25:12.577373 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:25:12.577373 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:25:12.577373 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:25:12.577373 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:25:12.577373 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:25:12.577373 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:25:12.577373 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:25:12.577373 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:25:12.577373 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:25:12.577373 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 09:25:12.577373 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 09:25:12.577373 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 09:25:12.578458 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 09:25:12.578458 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:25:12.578458 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:25:12.578458 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:25:12.578458 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:25:12.578458 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:25:12.578458 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:25:12.578458 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:25:12.578458 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( Jul 14 09:25:12.578458 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:25:12.578458 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:25:12.578458 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:25:12.578458 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:25:12.578458 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:25:12.578458 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:25:12.578458 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:25:12.578458 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:25:12.579412 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 09:25:12.579412 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 09:25:12.579412 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:25:12.579412 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Jul 14 09:25:12.579412 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 383/746] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 09:25:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:25:12.580240 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9585e75a-133a-4a72-8b0b-174f99ea0ce5 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:12.580240 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9585e75a-133a-4a72-8b0b-174f99ea0ce5 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:12.580471 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9585e75a-133a-4a72-8b0b-174f99ea0ce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:12.584345 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:12.598810 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-9585e75a-133a-4a72-8b0b-174f99ea0ce5 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:25:12.600561 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-9585e75a-133a-4a72-8b0b-174f99ea0ce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:12.620462 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b8fb70-8cda-4377-9884-2e2320b36eae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:12.621121 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b8fb70-8cda-4377-9884-2e2320b36eae None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:12.621407 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b8fb70-8cda-4377-9884-2e2320b36eae None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:12.621686 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b8fb70-8cda-4377-9884-2e2320b36eae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:12.679481 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 384/747] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:25:12 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 09:25:12.680072 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9585e75a-133a-4a72-8b0b-174f99ea0ce5 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:12.706947 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b8fb70-8cda-4377-9884-2e2320b36eae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:12.708401 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b8fb70-8cda-4377-9884-2e2320b36eae None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:12.712973 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:12.789722 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9585e75a-133a-4a72-8b0b-174f99ea0ce5 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:12.821644 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 364/748] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 14 09:25:12 2022] GET /identity/v3/auth/tokens => generated 898 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 09:25:12.821644 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b8fb70-8cda-4377-9884-2e2320b36eae None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:12.822853 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:12.832523 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab115909-fbe0-43cf-81d1-cd127459d97b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:12.833355 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab115909-fbe0-43cf-81d1-cd127459d97b None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:12.833797 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab115909-fbe0-43cf-81d1-cd127459d97b None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:12.834636 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab115909-fbe0-43cf-81d1-cd127459d97b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:12.843832 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab115909-fbe0-43cf-81d1-cd127459d97b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:12.845763 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab115909-fbe0-43cf-81d1-cd127459d97b None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:12.865828 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-ab115909-fbe0-43cf-81d1-cd127459d97b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 14 09:25:12.865828 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:25:12.865828 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:25:12.865828 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:25:12.865828 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:25:12.865828 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:25:12.865828 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:25:12.865828 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:25:12.865828 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:25:12.865828 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:25:12.865828 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:25:12.865828 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:25:12.865828 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 09:25:12.865828 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 09:25:12.865828 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 09:25:12.865828 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 09:25:12.866823 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:25:12.866823 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:25:12.866823 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 09:25:12.866823 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 09:25:12.866823 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 09:25:12.866823 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 09:25:12.866823 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:25:12.866823 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:25:12.866823 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:25:12.866823 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:25:12.866823 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:25:12.866823 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( Jul 14 09:25:12.866823 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:25:12.866823 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:25:12.866823 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:25:12.866823 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:25:12.866823 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:25:12.866823 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:25:12.867988 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:25:12.867988 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:25:12.867988 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 09:25:12.867988 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 09:25:12.867988 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 09:25:12.867988 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 09:25:12.867988 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 09:25:12.867988 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 09:25:12.867988 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 14 09:25:12.867988 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Jul 14 09:25:12.869359 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 385/749] 10.222.0.40 () {56 vars in 1117 bytes} [Thu Jul 14 09:25:12 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:25:12.870162 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab115909-fbe0-43cf-81d1-cd127459d97b None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:12.933738 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b8fb70-8cda-4377-9884-2e2320b36eae None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:12.966375 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:12.968746 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c166c370-386c-47bf-9cf2-31591f4e16fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:12.969423 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c166c370-386c-47bf-9cf2-31591f4e16fb None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:12.969722 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c166c370-386c-47bf-9cf2-31591f4e16fb None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:12.970002 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c166c370-386c-47bf-9cf2-31591f4e16fb None admin] PATH_INFO: `/v3/domains` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:12.970893 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c166c370-386c-47bf-9cf2-31591f4e16fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:12.971126 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c166c370-386c-47bf-9cf2-31591f4e16fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:12.972513 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c166c370-386c-47bf-9cf2-31591f4e16fb None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:12.980538 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab115909-fbe0-43cf-81d1-cd127459d97b None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:12.991491 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 365/750] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 14 09:25:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:25:12.991491 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c166c370-386c-47bf-9cf2-31591f4e16fb None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:13.023915 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff631996-0f85-4802-838c-8d45c6c583f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:13.024588 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff631996-0f85-4802-838c-8d45c6c583f6 None admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:13.024877 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff631996-0f85-4802-838c-8d45c6c583f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:13.025164 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff631996-0f85-4802-838c-8d45c6c583f6 None admin] PATH_INFO: `/v3/services` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:13.025893 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff631996-0f85-4802-838c-8d45c6c583f6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:13.027299 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff631996-0f85-4802-838c-8d45c6c583f6 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:13.043173 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 386/751] 10.222.0.40 () {60 vars in 1141 bytes} [Thu Jul 14 09:25:12 2022] POST /identity/v3/services => generated 251 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:25:13.044006 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff631996-0f85-4802-838c-8d45c6c583f6 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:13.073426 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:13.122409 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c166c370-386c-47bf-9cf2-31591f4e16fb None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:13.175034 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acad8cc-3d3c-4fe7-b833-e8cfbe78dca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:13.176229 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acad8cc-3d3c-4fe7-b833-e8cfbe78dca8 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:13.176699 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acad8cc-3d3c-4fe7-b833-e8cfbe78dca8 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:13.177180 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acad8cc-3d3c-4fe7-b833-e8cfbe78dca8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:13.189610 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff631996-0f85-4802-838c-8d45c6c583f6 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:13.190628 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acad8cc-3d3c-4fe7-b833-e8cfbe78dca8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:13.192562 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acad8cc-3d3c-4fe7-b833-e8cfbe78dca8 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:13.215728 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-5acad8cc-3d3c-4fe7-b833-e8cfbe78dca8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:25:13.215728 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:25:13.215728 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:25:13.215728 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:25:13.215728 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:25:13.215728 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:25:13.215728 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:25:13.215728 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:25:13.215728 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:25:13.215728 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:25:13.215728 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:25:13.215728 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:25:13.215728 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 09:25:13.215728 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 09:25:13.215728 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 09:25:13.216978 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 09:25:13.216978 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:25:13.216978 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:25:13.216978 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:25:13.216978 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:25:13.216978 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:25:13.216978 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:25:13.216978 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:25:13.216978 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( Jul 14 09:25:13.216978 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:25:13.216978 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:25:13.216978 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:25:13.216978 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:25:13.216978 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:25:13.216978 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:25:13.216978 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:25:13.216978 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:25:13.217868 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 09:25:13.217868 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 09:25:13.217868 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:25:13.217868 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:25:13.220568 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 366/752] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 09:25:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:25:13.221672 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acad8cc-3d3c-4fe7-b833-e8cfbe78dca8 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:13.230085 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc0263d-6174-48a3-8efa-9bb2741ae793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:13.230798 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc0263d-6174-48a3-8efa-9bb2741ae793 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:13.231080 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc0263d-6174-48a3-8efa-9bb2741ae793 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:13.231355 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc0263d-6174-48a3-8efa-9bb2741ae793 None admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:13.232349 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc0263d-6174-48a3-8efa-9bb2741ae793 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:13.232662 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc0263d-6174-48a3-8efa-9bb2741ae793 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:13.234085 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc0263d-6174-48a3-8efa-9bb2741ae793 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:13.255048 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 387/753] 10.222.0.40 () {56 vars in 1149 bytes} [Thu Jul 14 09:25:13 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:25:13.256323 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc0263d-6174-48a3-8efa-9bb2741ae793 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:13.265787 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:13.343367 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acad8cc-3d3c-4fe7-b833-e8cfbe78dca8 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:13.356963 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:13.380128 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7216d764-22a3-4402-976f-ee8f5398de6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:13.381838 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7216d764-22a3-4402-976f-ee8f5398de6e None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:13.382371 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7216d764-22a3-4402-976f-ee8f5398de6e None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:13.382852 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7216d764-22a3-4402-976f-ee8f5398de6e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:13.384687 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc0263d-6174-48a3-8efa-9bb2741ae793 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:13.390575 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7216d764-22a3-4402-976f-ee8f5398de6e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:13.392303 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7216d764-22a3-4402-976f-ee8f5398de6e None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:13.408320 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-7216d764-22a3-4402-976f-ee8f5398de6e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 09:25:13.408320 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:25:13.408320 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:25:13.408320 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:25:13.408320 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:25:13.408320 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:25:13.408320 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:25:13.408320 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:25:13.408320 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:25:13.408320 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:25:13.408320 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:25:13.408320 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:25:13.408320 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 09:25:13.408320 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 09:25:13.408320 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 09:25:13.409266 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 09:25:13.409266 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:25:13.409266 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:25:13.409266 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:25:13.409266 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:25:13.409266 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:25:13.409266 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:25:13.409266 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:25:13.409266 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( Jul 14 09:25:13.409266 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:25:13.409266 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:25:13.409266 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:25:13.409266 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:25:13.409266 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:25:13.409266 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:25:13.409266 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:25:13.409266 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:25:13.410166 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 09:25:13.410166 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 09:25:13.410166 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 09:25:13.410166 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 09:25:13.410166 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 09:25:13.410166 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 09:25:13.410166 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 09:25:13.410166 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:25:13.412832 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 367/754] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jul 14 09:25:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:25:13.413901 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7216d764-22a3-4402-976f-ee8f5398de6e None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:13.427547 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7abfc9-ff03-4dc8-8b21-35d63d1a36bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:13.428128 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7abfc9-ff03-4dc8-8b21-35d63d1a36bf None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:13.428461 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7abfc9-ff03-4dc8-8b21-35d63d1a36bf None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:13.428792 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7abfc9-ff03-4dc8-8b21-35d63d1a36bf None admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:13.429546 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7abfc9-ff03-4dc8-8b21-35d63d1a36bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:13.429856 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7abfc9-ff03-4dc8-8b21-35d63d1a36bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:13.431693 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7abfc9-ff03-4dc8-8b21-35d63d1a36bf None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:13.451805 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 388/755] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 14 09:25:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:25:13.451805 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7abfc9-ff03-4dc8-8b21-35d63d1a36bf None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:13.522967 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:13.533702 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7216d764-22a3-4402-976f-ee8f5398de6e None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:13.566027 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7abfc9-ff03-4dc8-8b21-35d63d1a36bf None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:13.575972 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e1912c-c6e1-4b8f-b47f-9725ffcf80ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:13.576972 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e1912c-c6e1-4b8f-b47f-9725ffcf80ce None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:13.577462 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e1912c-c6e1-4b8f-b47f-9725ffcf80ce None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:13.578032 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e1912c-c6e1-4b8f-b47f-9725ffcf80ce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:13.605275 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e699c38-1444-44d4-b62d-f78d89d9d50a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:13.605865 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e699c38-1444-44d4-b62d-f78d89d9d50a None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:13.606175 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e699c38-1444-44d4-b62d-f78d89d9d50a None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:13.608104 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e699c38-1444-44d4-b62d-f78d89d9d50a None admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:13.608104 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e699c38-1444-44d4-b62d-f78d89d9d50a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:13.608104 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e699c38-1444-44d4-b62d-f78d89d9d50a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:13.609492 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e699c38-1444-44d4-b62d-f78d89d9d50a None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:13.623213 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 389/756] 10.222.0.40 () {56 vars in 1148 bytes} [Thu Jul 14 09:25:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:25:13.624052 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e699c38-1444-44d4-b62d-f78d89d9d50a None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:13.630034 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:13.655868 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e1912c-c6e1-4b8f-b47f-9725ffcf80ce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:13.657716 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e1912c-c6e1-4b8f-b47f-9725ffcf80ce None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:13.743444 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e699c38-1444-44d4-b62d-f78d89d9d50a None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:13.768842 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 368/757] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 14 09:25:13 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 09:25:13.770062 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e1912c-c6e1-4b8f-b47f-9725ffcf80ce None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:13.771119 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:13.782102 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7905395-c9cb-4c2e-8d25-506b7de0ff3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:13.783031 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7905395-c9cb-4c2e-8d25-506b7de0ff3f None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:13.783563 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7905395-c9cb-4c2e-8d25-506b7de0ff3f None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:13.783671 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7905395-c9cb-4c2e-8d25-506b7de0ff3f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:13.792003 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7905395-c9cb-4c2e-8d25-506b7de0ff3f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:13.793470 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7905395-c9cb-4c2e-8d25-506b7de0ff3f None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:13.809897 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-d7905395-c9cb-4c2e-8d25-506b7de0ff3f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 09:25:13.809897 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:25:13.809897 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:25:13.809897 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:25:13.809897 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:25:13.809897 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:25:13.809897 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:25:13.809897 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:25:13.809897 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:25:13.809897 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:25:13.809897 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:25:13.809897 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:25:13.809897 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 09:25:13.809897 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 09:25:13.809897 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 09:25:13.811014 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 09:25:13.811014 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:25:13.811014 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:25:13.811014 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:25:13.811014 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:25:13.811014 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:25:13.811014 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:25:13.811014 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:25:13.811014 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( Jul 14 09:25:13.811014 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:25:13.811014 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:25:13.811014 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:25:13.811014 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:25:13.811014 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:25:13.811014 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:25:13.811014 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:25:13.811014 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:25:13.811929 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 09:25:13.811929 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 09:25:13.811929 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 09:25:13.811929 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 09:25:13.811929 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 09:25:13.811929 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 09:25:13.811929 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 09:25:13.811929 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Jul 14 09:25:13.815859 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 390/758] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jul 14 09:25:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:25:13.816725 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7905395-c9cb-4c2e-8d25-506b7de0ff3f None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:13.850640 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:13.893777 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e1912c-c6e1-4b8f-b47f-9725ffcf80ce None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:13.932680 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed02b40c-5843-4d9f-9a4d-2079b270201c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:13.933600 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed02b40c-5843-4d9f-9a4d-2079b270201c None admin] REQUEST_METHOD: `PUT` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:13.933880 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed02b40c-5843-4d9f-9a4d-2079b270201c None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:13.934157 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed02b40c-5843-4d9f-9a4d-2079b270201c None admin] PATH_INFO: `/v3/projects/a478e76f04dd413f89ddfba7b0cdc9cc/users/1f6962106dfa4c4c9af551053f8095e9/roles/e3965bd0d5f1427a86a313c0c90bfef3` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:13.936402 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed02b40c-5843-4d9f-9a4d-2079b270201c None admin] RBAC: Authorizing `identity:create_grant(project_id=a478e76f04dd413f89ddfba7b0cdc9cc, user_id=1f6962106dfa4c4c9af551053f8095e9, role_id=e3965bd0d5f1427a86a313c0c90bfef3)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:13.937976 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed02b40c-5843-4d9f-9a4d-2079b270201c None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:13.950976 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7905395-c9cb-4c2e-8d25-506b7de0ff3f None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:13.956237 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 369/759] 10.222.0.40 () {58 vars in 1439 bytes} [Thu Jul 14 09:25:13 2022] PUT /identity/v3/projects/a478e76f04dd413f89ddfba7b0cdc9cc/users/1f6962106dfa4c4c9af551053f8095e9/roles/e3965bd0d5f1427a86a313c0c90bfef3 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:25:13.957141 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed02b40c-5843-4d9f-9a4d-2079b270201c None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:13.995879 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7989b6a8-9a77-48c4-94e1-de6ed9b700d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:13.997957 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7989b6a8-9a77-48c4-94e1-de6ed9b700d6 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:13.998541 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7989b6a8-9a77-48c4-94e1-de6ed9b700d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:13.999346 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7989b6a8-9a77-48c4-94e1-de6ed9b700d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:14.017647 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7989b6a8-9a77-48c4-94e1-de6ed9b700d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:14.021080 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7989b6a8-9a77-48c4-94e1-de6ed9b700d6 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:14.050556 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-7989b6a8-9a77-48c4-94e1-de6ed9b700d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:25:14.050556 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:25:14.050556 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:25:14.050556 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:25:14.050556 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:25:14.050556 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:25:14.050556 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:25:14.050556 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:25:14.050556 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:25:14.050556 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:25:14.050556 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:25:14.050556 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:25:14.050556 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 09:25:14.050556 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 09:25:14.050556 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 09:25:14.051514 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 09:25:14.051514 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:25:14.051514 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:25:14.051514 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:25:14.051514 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:25:14.051514 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:25:14.051514 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:25:14.051514 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:25:14.051514 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( Jul 14 09:25:14.051514 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:25:14.051514 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:25:14.051514 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:25:14.051514 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:25:14.051514 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:25:14.051514 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:25:14.051514 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:25:14.051514 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:25:14.052401 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 09:25:14.052401 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 09:25:14.052401 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:25:14.052401 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Jul 14 09:25:14.056476 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 391/760] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 09:25:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:25:14.063213 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7989b6a8-9a77-48c4-94e1-de6ed9b700d6 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:14.120475 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed02b40c-5843-4d9f-9a4d-2079b270201c None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:14.127067 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:14.190483 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:14.199094 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5eb2d0-41d2-4d1a-86fc-40b965d617b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:14.200199 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5eb2d0-41d2-4d1a-86fc-40b965d617b2 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:14.200647 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5eb2d0-41d2-4d1a-86fc-40b965d617b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:14.201353 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5eb2d0-41d2-4d1a-86fc-40b965d617b2 None admin] PATH_INFO: `/v3/projects` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:14.202501 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5eb2d0-41d2-4d1a-86fc-40b965d617b2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:14.202814 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5eb2d0-41d2-4d1a-86fc-40b965d617b2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:14.204929 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5eb2d0-41d2-4d1a-86fc-40b965d617b2 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:14.207263 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7989b6a8-9a77-48c4-94e1-de6ed9b700d6 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:14.221401 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 370/761] 10.222.0.40 () {56 vars in 1148 bytes} [Thu Jul 14 09:25:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:25:14.227684 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5eb2d0-41d2-4d1a-86fc-40b965d617b2 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:14.248489 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6fc6d0-6a94-4ca1-b167-6876459297a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:14.249235 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6fc6d0-6a94-4ca1-b167-6876459297a2 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:14.249522 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6fc6d0-6a94-4ca1-b167-6876459297a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:14.249796 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6fc6d0-6a94-4ca1-b167-6876459297a2 None admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:14.250584 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6fc6d0-6a94-4ca1-b167-6876459297a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:14.250893 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6fc6d0-6a94-4ca1-b167-6876459297a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:14.252264 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6fc6d0-6a94-4ca1-b167-6876459297a2 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:14.264405 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 392/762] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 14 09:25:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:25:14.270431 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6fc6d0-6a94-4ca1-b167-6876459297a2 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:14.349097 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5eb2d0-41d2-4d1a-86fc-40b965d617b2 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:14.385645 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1498d180-41d6-41b4-b80b-dc68d71ad9cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:14.386346 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1498d180-41d6-41b4-b80b-dc68d71ad9cb None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:14.386630 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1498d180-41d6-41b4-b80b-dc68d71ad9cb None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:14.386910 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1498d180-41d6-41b4-b80b-dc68d71ad9cb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:14.387746 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1498d180-41d6-41b4-b80b-dc68d71ad9cb None admin] RBAC: Adding query filter params (role.id=e3965bd0d5f1427a86a313c0c90bfef3, scope.project.id=a478e76f04dd413f89ddfba7b0cdc9cc, user.id=302c0f7dd3bf4829aad0b29bd0c091a5) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:14.388060 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1498d180-41d6-41b4-b80b-dc68d71ad9cb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:14.389498 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1498d180-41d6-41b4-b80b-dc68d71ad9cb None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:14.393788 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:14.395993 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 371/763] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jul 14 09:25:14 2022] GET /identity/v3/role_assignments?user.id=302c0f7dd3bf4829aad0b29bd0c091a5&scope.project.id=a478e76f04dd413f89ddfba7b0cdc9cc&role.id=e3965bd0d5f1427a86a313c0c90bfef3 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:25:14.399285 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6fc6d0-6a94-4ca1-b167-6876459297a2 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:14.439366 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3a6f8d-d6d8-44c9-9ac4-e483399b2183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:14.440173 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3a6f8d-d6d8-44c9-9ac4-e483399b2183 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:14.440456 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3a6f8d-d6d8-44c9-9ac4-e483399b2183 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:14.440783 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3a6f8d-d6d8-44c9-9ac4-e483399b2183 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:14.448973 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3a6f8d-d6d8-44c9-9ac4-e483399b2183 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:14.450495 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3a6f8d-d6d8-44c9-9ac4-e483399b2183 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:14.466903 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-ad3a6f8d-d6d8-44c9-9ac4-e483399b2183 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 09:25:14.466903 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:25:14.466903 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:25:14.466903 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:25:14.466903 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:25:14.466903 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:25:14.466903 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:25:14.466903 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:25:14.466903 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:25:14.466903 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:25:14.466903 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:25:14.466903 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:25:14.466903 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 09:25:14.466903 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 09:25:14.466903 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 09:25:14.468056 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 09:25:14.468056 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:25:14.468056 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:25:14.468056 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:25:14.468056 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:25:14.468056 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:25:14.468056 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:25:14.468056 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:25:14.468056 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( Jul 14 09:25:14.468056 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:25:14.468056 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:25:14.468056 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:25:14.468056 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:25:14.468056 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:25:14.468056 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:25:14.468056 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:25:14.468056 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:25:14.469168 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 09:25:14.469168 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 09:25:14.469168 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 09:25:14.469168 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 09:25:14.469168 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 09:25:14.469168 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 09:25:14.469168 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 09:25:14.469168 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Jul 14 09:25:14.469168 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 393/764] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jul 14 09:25:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:25:14.475567 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1498d180-41d6-41b4-b80b-dc68d71ad9cb None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:14.509979 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0827139e-334e-475d-983e-7d9018c3b4e9 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:14.511021 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0827139e-334e-475d-983e-7d9018c3b4e9 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:14.511410 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0827139e-334e-475d-983e-7d9018c3b4e9 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:14.513214 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 394/765] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:25:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:25:14.519892 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867d9bf1-0f60-491b-9076-b6f8dbe36406 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:14.519892 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867d9bf1-0f60-491b-9076-b6f8dbe36406 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:14.519892 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867d9bf1-0f60-491b-9076-b6f8dbe36406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:14.548114 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-867d9bf1-0f60-491b-9076-b6f8dbe36406 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:25:14.549585 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-867d9bf1-0f60-491b-9076-b6f8dbe36406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:14.612670 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:14.667972 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 395/766] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:25:14 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 09:25:14.690153 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1498d180-41d6-41b4-b80b-dc68d71ad9cb None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:14.690882 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867d9bf1-0f60-491b-9076-b6f8dbe36406 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:14.767364 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e8c8d9-7b65-467f-9efc-84e5ce182952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:14.768318 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e8c8d9-7b65-467f-9efc-84e5ce182952 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:14.768747 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e8c8d9-7b65-467f-9efc-84e5ce182952 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:14.769169 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e8c8d9-7b65-467f-9efc-84e5ce182952 None admin] PATH_INFO: `/v3/projects` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:14.770109 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e8c8d9-7b65-467f-9efc-84e5ce182952 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:14.770672 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e8c8d9-7b65-467f-9efc-84e5ce182952 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:14.773060 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e8c8d9-7b65-467f-9efc-84e5ce182952 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:14.799705 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 372/767] 10.222.0.40 () {56 vars in 1148 bytes} [Thu Jul 14 09:25:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:25:14.805955 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e8c8d9-7b65-467f-9efc-84e5ce182952 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:14.864126 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:14.879052 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867d9bf1-0f60-491b-9076-b6f8dbe36406 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:14.944319 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f57ec87-8c9d-4d59-8a6d-16a2ac0038af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:14.947040 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f57ec87-8c9d-4d59-8a6d-16a2ac0038af None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:14.948394 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f57ec87-8c9d-4d59-8a6d-16a2ac0038af None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:14.948835 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f57ec87-8c9d-4d59-8a6d-16a2ac0038af None admin] PATH_INFO: `/v3/services/network` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:14.949644 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f57ec87-8c9d-4d59-8a6d-16a2ac0038af None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:14.952775 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f57ec87-8c9d-4d59-8a6d-16a2ac0038af None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:14.976979 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-2f57ec87-8c9d-4d59-8a6d-16a2ac0038af None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 14 09:25:14.976979 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:25:14.976979 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 09:25:14.976979 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 09:25:14.976979 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 09:25:14.976979 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 09:25:14.976979 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 09:25:14.976979 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 09:25:14.976979 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 14 09:25:14.976979 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Jul 14 09:25:14.976979 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 09:25:14.976979 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Jul 14 09:25:14.976979 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:25:14.976979 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:25:14.976979 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:25:14.976979 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:25:14.976979 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:25:14.978215 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:25:14.978215 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:25:14.978215 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:25:14.978215 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:25:14.978215 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:25:14.978215 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:25:14.978215 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 09:25:14.978215 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 09:25:14.978215 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 09:25:14.978215 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 09:25:14.978215 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:25:14.978215 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:25:14.978215 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:25:14.978215 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:25:14.978215 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:25:14.978215 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:25:14.979072 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:25:14.979072 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( Jul 14 09:25:14.979072 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:25:14.979072 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:25:14.979072 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:25:14.979072 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:25:14.979072 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:25:14.979072 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:25:14.979072 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:25:14.979072 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:25:14.979072 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 09:25:14.979072 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 09:25:14.979072 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 14 09:25:14.979072 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Jul 14 09:25:14.979833 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 396/768] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jul 14 09:25:14 2022] GET /identity/v3/services/network => generated 88 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 09:25:14.986928 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f57ec87-8c9d-4d59-8a6d-16a2ac0038af None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:15.003598 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e8c8d9-7b65-467f-9efc-84e5ce182952 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:15.023906 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:15.051985 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c38665-f6ac-471c-9535-9c69381753ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:15.054136 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c38665-f6ac-471c-9535-9c69381753ae None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:15.054667 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c38665-f6ac-471c-9535-9c69381753ae None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:15.055301 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c38665-f6ac-471c-9535-9c69381753ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:15.058922 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c38665-f6ac-471c-9535-9c69381753ae None admin] RBAC: Adding query filter params (role.id=c12236aebd8048ba991da4671b44935f, scope.project.id=a478e76f04dd413f89ddfba7b0cdc9cc, user.id=6cf35868f9ff46e2835a6cc023641da6) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:15.059467 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c38665-f6ac-471c-9535-9c69381753ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:15.061231 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c38665-f6ac-471c-9535-9c69381753ae None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:15.079346 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 373/769] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jul 14 09:25:14 2022] GET /identity/v3/role_assignments?user.id=6cf35868f9ff46e2835a6cc023641da6&scope.project.id=a478e76f04dd413f89ddfba7b0cdc9cc&role.id=c12236aebd8048ba991da4671b44935f => generated 259 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:25:15.152393 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f57ec87-8c9d-4d59-8a6d-16a2ac0038af None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:15.193897 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd95bd4-dc1f-4fbb-81de-13607e873136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:15.195066 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd95bd4-dc1f-4fbb-81de-13607e873136 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:15.195551 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd95bd4-dc1f-4fbb-81de-13607e873136 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:15.196040 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd95bd4-dc1f-4fbb-81de-13607e873136 None admin] PATH_INFO: `/v3/services` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:15.196961 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd95bd4-dc1f-4fbb-81de-13607e873136 None admin] RBAC: Adding query filter params (name=network) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:15.197465 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd95bd4-dc1f-4fbb-81de-13607e873136 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:15.199102 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd95bd4-dc1f-4fbb-81de-13607e873136 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:15.204665 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 397/770] 10.222.0.40 () {56 vars in 1112 bytes} [Thu Jul 14 09:25:14 2022] GET /identity/v3/services?name=network => generated 124 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:25:15.211342 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c38665-f6ac-471c-9535-9c69381753ae None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:15.349449 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c38665-f6ac-471c-9535-9c69381753ae None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:15.402972 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f40c6a-c339-481d-a4d4-1bbf0ebe38ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:15.404040 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f40c6a-c339-481d-a4d4-1bbf0ebe38ad None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:15.404633 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f40c6a-c339-481d-a4d4-1bbf0ebe38ad None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:15.405117 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f40c6a-c339-481d-a4d4-1bbf0ebe38ad None admin] PATH_INFO: `/v3/services` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:15.406037 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f40c6a-c339-481d-a4d4-1bbf0ebe38ad None admin] RBAC: Adding query filter params (type=network) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:15.406561 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f40c6a-c339-481d-a4d4-1bbf0ebe38ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:15.408243 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f40c6a-c339-481d-a4d4-1bbf0ebe38ad None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:15.416449 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 374/771] 10.222.0.40 () {56 vars in 1112 bytes} [Thu Jul 14 09:25:15 2022] GET /identity/v3/services?type=network => generated 350 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:25:15.422228 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd95bd4-dc1f-4fbb-81de-13607e873136 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:15.442927 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:15.535659 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd95bd4-dc1f-4fbb-81de-13607e873136 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:15.575789 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9241e4-0ad3-4ea2-ae43-1567d2b3d099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:15.576473 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9241e4-0ad3-4ea2-ae43-1567d2b3d099 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:15.576753 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9241e4-0ad3-4ea2-ae43-1567d2b3d099 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:15.577034 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9241e4-0ad3-4ea2-ae43-1567d2b3d099 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:15.577982 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9241e4-0ad3-4ea2-ae43-1567d2b3d099 None admin] RBAC: Adding query filter params (interface=public, service_id=e3a3bb54f4294e979231697d155fcbc8, region_id=RegionOne) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:15.578327 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9241e4-0ad3-4ea2-ae43-1567d2b3d099 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:15.579762 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9241e4-0ad3-4ea2-ae43-1567d2b3d099 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:15.588843 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 398/772] 10.222.0.40 () {56 vars in 1251 bytes} [Thu Jul 14 09:25:15 2022] GET /identity/v3/endpoints?service_id=e3a3bb54f4294e979231697d155fcbc8&interface=public®ion_id=RegionOne => generated 194 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:25:15.591052 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739b3440-550c-4440-a608-33c68e3e543a None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:15.591342 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739b3440-550c-4440-a608-33c68e3e543a None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:15.591622 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739b3440-550c-4440-a608-33c68e3e543a None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:15.593537 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 375/773] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:25:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:25:15.598957 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9241e4-0ad3-4ea2-ae43-1567d2b3d099 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:15.599998 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b714bde4-1555-4008-b212-fbb10cdc2a4f None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:15.600383 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b714bde4-1555-4008-b212-fbb10cdc2a4f None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:15.600785 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b714bde4-1555-4008-b212-fbb10cdc2a4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:15.625216 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-b714bde4-1555-4008-b212-fbb10cdc2a4f None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:25:15.625216 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-b714bde4-1555-4008-b212-fbb10cdc2a4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:15.675294 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:15.704665 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 376/774] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:25:15 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 09:25:15.751627 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b714bde4-1555-4008-b212-fbb10cdc2a4f None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:15.753073 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:15.792439 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9241e4-0ad3-4ea2-ae43-1567d2b3d099 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:15.837888 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9760e31f-3d36-48f2-8bb7-150e5fd9db42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:15.838592 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9760e31f-3d36-48f2-8bb7-150e5fd9db42 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:15.838878 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9760e31f-3d36-48f2-8bb7-150e5fd9db42 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:15.839156 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9760e31f-3d36-48f2-8bb7-150e5fd9db42 None admin] PATH_INFO: `/v3/services` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:15.839853 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9760e31f-3d36-48f2-8bb7-150e5fd9db42 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:15.841215 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9760e31f-3d36-48f2-8bb7-150e5fd9db42 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:15.852260 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 399/775] 10.222.0.40 () {56 vars in 1087 bytes} [Thu Jul 14 09:25:15 2022] GET /identity/v3/services => generated 772 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:25:15.904813 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b714bde4-1555-4008-b212-fbb10cdc2a4f None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:15.964260 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2566846b-3cb4-4d05-9032-1096dadfd4ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:15.964850 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2566846b-3cb4-4d05-9032-1096dadfd4ae None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:15.965137 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2566846b-3cb4-4d05-9032-1096dadfd4ae None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:15.965415 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2566846b-3cb4-4d05-9032-1096dadfd4ae None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:15.966093 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2566846b-3cb4-4d05-9032-1096dadfd4ae None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:15.969584 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2566846b-3cb4-4d05-9032-1096dadfd4ae None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:15.983574 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-2566846b-3cb4-4d05-9032-1096dadfd4ae None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 14 09:25:15.983574 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:25:15.983574 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 09:25:15.983574 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 09:25:15.983574 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 09:25:15.983574 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 09:25:15.983574 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 09:25:15.983574 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 09:25:15.983574 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 14 09:25:15.983574 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:25:15.983574 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 09:25:15.983574 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:25:15.983574 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:25:15.983574 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:25:15.983574 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:25:15.983574 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:25:15.986048 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:25:15.986048 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:25:15.986048 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:25:15.986048 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:25:15.986048 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:25:15.986048 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:25:15.986048 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:25:15.986048 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 09:25:15.986048 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 09:25:15.986048 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 09:25:15.986048 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 09:25:15.986048 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:25:15.986048 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:25:15.986048 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:25:15.986048 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:25:15.986048 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:25:15.988117 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:25:15.988117 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:25:15.988117 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( Jul 14 09:25:15.988117 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:25:15.988117 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:25:15.988117 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:25:15.988117 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:25:15.988117 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:25:15.988117 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:25:15.988117 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:25:15.988117 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:25:15.988117 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 09:25:15.988117 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 09:25:15.988117 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 14 09:25:15.988117 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:25:15.988117 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 377/776] 10.222.0.40 () {56 vars in 1129 bytes} [Thu Jul 14 09:25:15 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 09:25:15.997910 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9760e31f-3d36-48f2-8bb7-150e5fd9db42 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:16.132278 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9760e31f-3d36-48f2-8bb7-150e5fd9db42 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:16.187862 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec358b05-21f4-4f7a-9221-d61d2915a585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:16.188558 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec358b05-21f4-4f7a-9221-d61d2915a585 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:16.188844 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec358b05-21f4-4f7a-9221-d61d2915a585 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:16.189122 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec358b05-21f4-4f7a-9221-d61d2915a585 None admin] PATH_INFO: `/v3/services` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:16.189853 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec358b05-21f4-4f7a-9221-d61d2915a585 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:16.190161 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec358b05-21f4-4f7a-9221-d61d2915a585 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:16.191569 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec358b05-21f4-4f7a-9221-d61d2915a585 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:16.202126 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 400/777] 10.222.0.40 () {56 vars in 1124 bytes} [Thu Jul 14 09:25:15 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:25:16.208117 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2566846b-3cb4-4d05-9032-1096dadfd4ae None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:16.268376 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:16.357558 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2566846b-3cb4-4d05-9032-1096dadfd4ae None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:16.407148 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c48be8-843a-45d8-809f-49a673e3a5e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:16.407797 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c48be8-843a-45d8-809f-49a673e3a5e2 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:16.408090 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c48be8-843a-45d8-809f-49a673e3a5e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:16.408366 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c48be8-843a-45d8-809f-49a673e3a5e2 None admin] PATH_INFO: `/v3/services` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:16.409088 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c48be8-843a-45d8-809f-49a673e3a5e2 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:16.409396 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c48be8-843a-45d8-809f-49a673e3a5e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:16.410810 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c48be8-843a-45d8-809f-49a673e3a5e2 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:16.422725 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 378/778] 10.222.0.40 () {56 vars in 1124 bytes} [Thu Jul 14 09:25:16 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:25:16.428592 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec358b05-21f4-4f7a-9221-d61d2915a585 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:16.439682 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:16.576196 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec358b05-21f4-4f7a-9221-d61d2915a585 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:16.629739 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3a0caf-a79b-410a-9dec-f02216d6beef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:16.631381 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3a0caf-a79b-410a-9dec-f02216d6beef None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:16.631897 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3a0caf-a79b-410a-9dec-f02216d6beef None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:16.632379 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3a0caf-a79b-410a-9dec-f02216d6beef None admin] PATH_INFO: `/v3/endpoints` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:16.633488 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3a0caf-a79b-410a-9dec-f02216d6beef None admin] RBAC: Adding query filter params (interface=public, service_id=16ecfad001824a1cbe2ae632a99211ab, region_id=RegionOne) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:16.634048 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3a0caf-a79b-410a-9dec-f02216d6beef None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:16.635666 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3a0caf-a79b-410a-9dec-f02216d6beef None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:16.641738 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 401/779] 10.222.0.40 () {56 vars in 1251 bytes} [Thu Jul 14 09:25:16 2022] GET /identity/v3/endpoints?service_id=16ecfad001824a1cbe2ae632a99211ab&interface=public®ion_id=RegionOne => generated 194 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:25:16.651307 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c48be8-843a-45d8-809f-49a673e3a5e2 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:16.719143 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a411dc-78a1-4903-81c2-1439209f74fa None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:16.719784 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a411dc-78a1-4903-81c2-1439209f74fa None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:16.720275 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a411dc-78a1-4903-81c2-1439209f74fa None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:16.724957 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 402/780] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:25:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 09:25:16.733370 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a903ebe1-dcbf-42dd-a166-20cbc3adeb8a None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:16.734011 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a903ebe1-dcbf-42dd-a166-20cbc3adeb8a None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:16.734541 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a903ebe1-dcbf-42dd-a166-20cbc3adeb8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:16.771256 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-a903ebe1-dcbf-42dd-a166-20cbc3adeb8a None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:25:16.772813 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-a903ebe1-dcbf-42dd-a166-20cbc3adeb8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:16.784999 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c48be8-843a-45d8-809f-49a673e3a5e2 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:16.787752 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:16.831707 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d7b2a6-d2ab-4255-993c-92f97c4dc3fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:16.832398 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d7b2a6-d2ab-4255-993c-92f97c4dc3fb None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:16.832682 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d7b2a6-d2ab-4255-993c-92f97c4dc3fb None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:16.832961 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d7b2a6-d2ab-4255-993c-92f97c4dc3fb None admin] PATH_INFO: `/v3/services` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:16.833664 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d7b2a6-d2ab-4255-993c-92f97c4dc3fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:16.835075 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d7b2a6-d2ab-4255-993c-92f97c4dc3fb None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:16.841235 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 379/781] 10.222.0.40 () {56 vars in 1087 bytes} [Thu Jul 14 09:25:16 2022] GET /identity/v3/services => generated 772 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:25:16.855144 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d951ccf5-d031-4502-bcd3-4f634fb3c24c None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:16.855537 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d951ccf5-d031-4502-bcd3-4f634fb3c24c None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:16.855891 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d951ccf5-d031-4502-bcd3-4f634fb3c24c None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:16.858946 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 380/782] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:25:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 09:25:16.863681 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6f2c7c-0ca3-41b9-9d69-2f8f59f16a63 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:16.863985 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6f2c7c-0ca3-41b9-9d69-2f8f59f16a63 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:16.864271 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6f2c7c-0ca3-41b9-9d69-2f8f59f16a63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:16.885325 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-0d6f2c7c-0ca3-41b9-9d69-2f8f59f16a63 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:25:16.886677 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-0d6f2c7c-0ca3-41b9-9d69-2f8f59f16a63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:16.968213 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 403/783] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:25:16 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 09:25:16.969707 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 381/784] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:25:16 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 09:25:16.994509 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a903ebe1-dcbf-42dd-a166-20cbc3adeb8a None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:16.997209 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:17.004703 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6f2c7c-0ca3-41b9-9d69-2f8f59f16a63 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:17.124051 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a903ebe1-dcbf-42dd-a166-20cbc3adeb8a None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:17.143329 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6f2c7c-0ca3-41b9-9d69-2f8f59f16a63 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:17.154556 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:17.164636 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a74958-86df-4178-8f69-b90252dff8da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:17.165467 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a74958-86df-4178-8f69-b90252dff8da None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:17.165755 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a74958-86df-4178-8f69-b90252dff8da None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:17.166030 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a74958-86df-4178-8f69-b90252dff8da None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:17.181133 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38989ca2-12d9-4b52-965f-555d8493ba82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:17.181738 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a74958-86df-4178-8f69-b90252dff8da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:25:17.181953 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38989ca2-12d9-4b52-965f-555d8493ba82 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:17.189729 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-24a74958-86df-4178-8f69-b90252dff8da None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 09:25:17.189729 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:25:17.189729 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:25:17.189729 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:25:17.189729 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:25:17.189729 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:25:17.189729 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:25:17.189729 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:25:17.189729 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:25:17.189729 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:25:17.189729 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:25:17.189729 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:25:17.189729 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:25:17.189729 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:25:17.189729 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:25:17.189729 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:25:17.190692 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:25:17.190692 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:25:17.190692 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:25:17.190692 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:25:17.190692 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:25:17.190692 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:25:17.190692 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:25:17.190692 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:25:17.190692 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:25:17.190692 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:25:17.190692 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:25:17.190692 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( Jul 14 09:25:17.190692 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:25:17.190692 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:25:17.190692 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:25:17.190692 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:25:17.191501 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:25:17.191501 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:25:17.191501 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:25:17.191501 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:25:17.191501 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:25:17.191501 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:25:17.191501 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:25:17.191501 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:25:17.191501 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:25:17.191501 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:25:17.191501 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 09:25:17.191501 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Jul 14 09:25:17.192124 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38989ca2-12d9-4b52-965f-555d8493ba82 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:17.192124 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38989ca2-12d9-4b52-965f-555d8493ba82 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:17.196390 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 404/785] 10.222.0.40 () {56 vars in 1096 bytes} [Thu Jul 14 09:25:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:25:17.197302 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a74958-86df-4178-8f69-b90252dff8da None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:17.250959 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38989ca2-12d9-4b52-965f-555d8493ba82 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:25:17.267627 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:17.269351 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-38989ca2-12d9-4b52-965f-555d8493ba82 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 09:25:17.269351 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:25:17.269351 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:25:17.269351 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:25:17.269351 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:25:17.269351 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:25:17.269351 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:25:17.269351 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:25:17.269351 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:25:17.269351 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:25:17.269351 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:25:17.269351 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:25:17.269351 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:25:17.269351 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:25:17.269351 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:25:17.269351 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:25:17.270519 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:25:17.270519 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:25:17.270519 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:25:17.270519 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:25:17.270519 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:25:17.270519 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:25:17.270519 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:25:17.270519 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:25:17.270519 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:25:17.270519 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:25:17.270519 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:25:17.270519 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( Jul 14 09:25:17.270519 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:25:17.270519 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:25:17.270519 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:25:17.270519 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:25:17.271920 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:25:17.271920 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:25:17.271920 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:25:17.271920 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:25:17.271920 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:25:17.271920 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:25:17.271920 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:25:17.271920 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:25:17.271920 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:25:17.271920 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:25:17.271920 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 09:25:17.271920 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:25:17.271920 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 382/786] 10.222.0.40 () {56 vars in 1096 bytes} [Thu Jul 14 09:25:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:25:17.283261 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38989ca2-12d9-4b52-965f-555d8493ba82 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:17.318754 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a74958-86df-4178-8f69-b90252dff8da None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:17.360297 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6593af-0dab-4335-800e-b501a016ed88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:17.360996 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6593af-0dab-4335-800e-b501a016ed88 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:17.361284 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6593af-0dab-4335-800e-b501a016ed88 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:17.361627 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6593af-0dab-4335-800e-b501a016ed88 None admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:17.362600 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6593af-0dab-4335-800e-b501a016ed88 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:17.362923 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6593af-0dab-4335-800e-b501a016ed88 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:17.364310 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6593af-0dab-4335-800e-b501a016ed88 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:17.378795 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 405/787] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 14 09:25:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:25:17.380337 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6593af-0dab-4335-800e-b501a016ed88 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:17.496425 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6593af-0dab-4335-800e-b501a016ed88 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:17.523199 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:17.542708 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f3311c-df51-4ec9-a157-72340d5b66c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:17.543533 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f3311c-df51-4ec9-a157-72340d5b66c6 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:17.544004 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f3311c-df51-4ec9-a157-72340d5b66c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:17.544291 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f3311c-df51-4ec9-a157-72340d5b66c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:17.562066 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f3311c-df51-4ec9-a157-72340d5b66c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:17.563786 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f3311c-df51-4ec9-a157-72340d5b66c6 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:17.582361 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-54f3311c-df51-4ec9-a157-72340d5b66c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:25:17.582361 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:25:17.582361 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:25:17.582361 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:25:17.582361 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:25:17.582361 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:25:17.582361 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:25:17.582361 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:25:17.582361 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:25:17.582361 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:25:17.582361 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:25:17.582361 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:25:17.582361 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 09:25:17.582361 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 09:25:17.582361 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 09:25:17.583367 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 09:25:17.583367 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:25:17.583367 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:25:17.583367 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:25:17.583367 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:25:17.583367 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:25:17.583367 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:25:17.583367 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:25:17.583367 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( Jul 14 09:25:17.583367 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:25:17.583367 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:25:17.583367 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:25:17.583367 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:25:17.583367 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:25:17.583367 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:25:17.583367 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:25:17.583367 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:25:17.584807 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 09:25:17.584807 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 09:25:17.584807 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:25:17.584807 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Jul 14 09:25:17.591380 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 406/788] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 09:25:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 09:25:17.592887 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f3311c-df51-4ec9-a157-72340d5b66c6 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:17.601665 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38989ca2-12d9-4b52-965f-555d8493ba82 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:17.670941 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eead5437-adb8-4244-b43e-6a2ba36fdb46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:17.671688 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eead5437-adb8-4244-b43e-6a2ba36fdb46 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:17.671925 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eead5437-adb8-4244-b43e-6a2ba36fdb46 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:17.672204 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eead5437-adb8-4244-b43e-6a2ba36fdb46 None admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:17.672983 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eead5437-adb8-4244-b43e-6a2ba36fdb46 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:17.673293 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eead5437-adb8-4244-b43e-6a2ba36fdb46 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:17.674755 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eead5437-adb8-4244-b43e-6a2ba36fdb46 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:17.685540 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 383/789] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 14 09:25:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 403 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:25:17.689444 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c7077a-bc6e-45a1-b74c-411d47cff711 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:17.689444 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c7077a-bc6e-45a1-b74c-411d47cff711 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:17.689444 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c7077a-bc6e-45a1-b74c-411d47cff711 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:17.689444 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 384/790] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:25:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:25:17.695323 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c7077a-bc6e-45a1-b74c-411d47cff711 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:17.716968 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:17.717633 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f3311c-df51-4ec9-a157-72340d5b66c6 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:17.759323 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfee784-3c55-44be-819d-c54ccdd242aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:17.760105 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfee784-3c55-44be-819d-c54ccdd242aa None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:17.760394 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfee784-3c55-44be-819d-c54ccdd242aa None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:17.760672 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfee784-3c55-44be-819d-c54ccdd242aa None admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:17.761472 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfee784-3c55-44be-819d-c54ccdd242aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:17.761782 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfee784-3c55-44be-819d-c54ccdd242aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:17.763455 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfee784-3c55-44be-819d-c54ccdd242aa None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:17.778132 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 407/791] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 14 09:25:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:25:17.779753 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c391fc63-2241-409a-90f9-c97ab959a761 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:17.780050 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c391fc63-2241-409a-90f9-c97ab959a761 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:17.780371 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c391fc63-2241-409a-90f9-c97ab959a761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:17.798763 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-c391fc63-2241-409a-90f9-c97ab959a761 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:25:17.800179 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-c391fc63-2241-409a-90f9-c97ab959a761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:17.817126 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c7077a-bc6e-45a1-b74c-411d47cff711 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:17.835452 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:17.857224 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e55f21-c08f-4da6-942b-0ec92e4851b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:17.858078 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e55f21-c08f-4da6-942b-0ec92e4851b4 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:17.858446 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e55f21-c08f-4da6-942b-0ec92e4851b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:17.858893 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e55f21-c08f-4da6-942b-0ec92e4851b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:17.871700 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e55f21-c08f-4da6-942b-0ec92e4851b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:17.873344 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e55f21-c08f-4da6-942b-0ec92e4851b4 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:17.885822 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 408/792] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:25:17 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 09:25:17.887011 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c391fc63-2241-409a-90f9-c97ab959a761 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:17.893541 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-98e55f21-c08f-4da6-942b-0ec92e4851b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:25:17.893541 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:25:17.893541 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:25:17.893541 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:25:17.893541 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:25:17.893541 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:25:17.893541 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:25:17.893541 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:25:17.893541 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:25:17.893541 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:25:17.893541 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:25:17.893541 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:25:17.893541 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 09:25:17.893541 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 09:25:17.893541 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 09:25:17.894469 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 09:25:17.894469 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:25:17.894469 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:25:17.894469 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:25:17.894469 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:25:17.894469 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:25:17.894469 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:25:17.894469 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:25:17.894469 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( Jul 14 09:25:17.894469 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:25:17.894469 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:25:17.894469 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:25:17.894469 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:25:17.894469 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:25:17.894469 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:25:17.894469 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:25:17.894469 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:25:17.895921 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 09:25:17.895921 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 09:25:17.895921 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:25:17.895921 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:25:17.895921 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 385/793] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 09:25:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:25:17.903291 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e55f21-c08f-4da6-942b-0ec92e4851b4 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:17.982850 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:18.016922 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c391fc63-2241-409a-90f9-c97ab959a761 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:18.017633 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e55f21-c08f-4da6-942b-0ec92e4851b4 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:18.054331 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7cbd91-64fe-4faf-a233-cde0681d2e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:18.054929 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7cbd91-64fe-4faf-a233-cde0681d2e55 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:18.055215 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7cbd91-64fe-4faf-a233-cde0681d2e55 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:18.055488 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7cbd91-64fe-4faf-a233-cde0681d2e55 None admin] PATH_INFO: `/v3/domains` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:18.056172 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f286c1cc-2a4c-49d9-a9ed-63014983da8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:18.056295 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7cbd91-64fe-4faf-a233-cde0681d2e55 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:18.056514 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7cbd91-64fe-4faf-a233-cde0681d2e55 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:18.057514 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f286c1cc-2a4c-49d9-a9ed-63014983da8f None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:18.057885 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7cbd91-64fe-4faf-a233-cde0681d2e55 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:18.058238 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f286c1cc-2a4c-49d9-a9ed-63014983da8f None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:18.058719 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f286c1cc-2a4c-49d9-a9ed-63014983da8f None admin] PATH_INFO: `/v3/users/nova` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:18.067016 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f286c1cc-2a4c-49d9-a9ed-63014983da8f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:18.069381 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f286c1cc-2a4c-49d9-a9ed-63014983da8f None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:18.076393 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 386/794] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 14 09:25:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:25:18.077622 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7cbd91-64fe-4faf-a233-cde0681d2e55 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:18.086915 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-f286c1cc-2a4c-49d9-a9ed-63014983da8f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 14 09:25:18.086915 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:25:18.086915 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:25:18.086915 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:25:18.086915 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:25:18.086915 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:25:18.086915 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:25:18.086915 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:25:18.086915 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:25:18.086915 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:25:18.086915 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:25:18.086915 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:25:18.086915 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 09:25:18.086915 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 09:25:18.086915 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 09:25:18.086915 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 09:25:18.087890 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:25:18.087890 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:25:18.087890 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 09:25:18.087890 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 09:25:18.087890 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 09:25:18.087890 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 09:25:18.087890 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:25:18.087890 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:25:18.087890 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:25:18.087890 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:25:18.087890 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:25:18.087890 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( Jul 14 09:25:18.087890 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:25:18.087890 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:25:18.087890 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:25:18.087890 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:25:18.087890 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:25:18.087890 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:25:18.088809 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:25:18.088809 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:25:18.088809 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 09:25:18.088809 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 09:25:18.088809 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 09:25:18.088809 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 09:25:18.088809 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 09:25:18.088809 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 09:25:18.088809 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 14 09:25:18.088809 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Jul 14 09:25:18.091446 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 409/795] 10.222.0.40 () {56 vars in 1093 bytes} [Thu Jul 14 09:25:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:25:18.092463 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f286c1cc-2a4c-49d9-a9ed-63014983da8f None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:18.122354 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:18.188140 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7cbd91-64fe-4faf-a233-cde0681d2e55 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:18.204048 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f286c1cc-2a4c-49d9-a9ed-63014983da8f None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:18.219521 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:18.229269 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41c5b98-6563-439d-a4b5-6aab66fd4a76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:18.229788 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41c5b98-6563-439d-a4b5-6aab66fd4a76 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:18.230073 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41c5b98-6563-439d-a4b5-6aab66fd4a76 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:18.230386 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41c5b98-6563-439d-a4b5-6aab66fd4a76 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:18.243476 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41c5b98-6563-439d-a4b5-6aab66fd4a76 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:25:18.247481 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17620c77-1627-4745-ac7e-d78413708905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:18.248537 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17620c77-1627-4745-ac7e-d78413708905 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:18.249033 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17620c77-1627-4745-ac7e-d78413708905 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:18.249512 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17620c77-1627-4745-ac7e-d78413708905 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:18.251360 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-c41c5b98-6563-439d-a4b5-6aab66fd4a76 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 09:25:18.251360 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:25:18.251360 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:25:18.251360 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:25:18.251360 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:25:18.251360 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:25:18.251360 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:25:18.251360 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:25:18.251360 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:25:18.251360 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:25:18.251360 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:25:18.251360 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:25:18.251360 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:25:18.251360 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:25:18.251360 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:25:18.251360 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:25:18.252306 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:25:18.252306 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:25:18.252306 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:25:18.252306 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:25:18.252306 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:25:18.252306 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:25:18.252306 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:25:18.252306 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:25:18.252306 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:25:18.252306 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:25:18.252306 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:25:18.252306 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( Jul 14 09:25:18.252306 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:25:18.252306 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:25:18.252306 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:25:18.252306 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:25:18.253133 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:25:18.253133 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:25:18.253133 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:25:18.253133 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:25:18.253133 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:25:18.253133 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:25:18.253133 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:25:18.253133 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:25:18.253133 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:25:18.253133 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:25:18.253133 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 09:25:18.253133 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:25:18.258114 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 387/796] 10.222.0.40 () {56 vars in 1102 bytes} [Thu Jul 14 09:25:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:25:18.259049 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41c5b98-6563-439d-a4b5-6aab66fd4a76 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:18.262141 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17620c77-1627-4745-ac7e-d78413708905 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:18.263870 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17620c77-1627-4745-ac7e-d78413708905 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:18.279918 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-17620c77-1627-4745-ac7e-d78413708905 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 14 09:25:18.279918 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:25:18.279918 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:25:18.279918 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:25:18.279918 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:25:18.279918 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:25:18.279918 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:25:18.279918 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:25:18.279918 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:25:18.279918 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:25:18.279918 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:25:18.279918 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:25:18.279918 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 09:25:18.279918 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 09:25:18.279918 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 09:25:18.279918 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 09:25:18.280903 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:25:18.280903 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:25:18.280903 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 09:25:18.280903 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 09:25:18.280903 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 09:25:18.280903 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 09:25:18.280903 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:25:18.280903 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:25:18.280903 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:25:18.280903 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:25:18.280903 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:25:18.280903 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( Jul 14 09:25:18.280903 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:25:18.280903 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:25:18.280903 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:25:18.280903 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:25:18.280903 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:25:18.280903 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:25:18.281827 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:25:18.281827 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:25:18.281827 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 09:25:18.281827 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 09:25:18.281827 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 09:25:18.281827 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 09:25:18.281827 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 09:25:18.281827 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 09:25:18.281827 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 14 09:25:18.281827 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Jul 14 09:25:18.284636 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 410/797] 10.222.0.40 () {56 vars in 1096 bytes} [Thu Jul 14 09:25:18 2022] GET /identity/v3/users/swift => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:25:18.285689 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17620c77-1627-4745-ac7e-d78413708905 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:18.383243 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41c5b98-6563-439d-a4b5-6aab66fd4a76 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:18.408829 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:18.419910 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c97dbc-36c6-462d-b4b9-b25706428d21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:18.420589 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c97dbc-36c6-462d-b4b9-b25706428d21 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:18.420894 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c97dbc-36c6-462d-b4b9-b25706428d21 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:18.421179 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c97dbc-36c6-462d-b4b9-b25706428d21 None admin] PATH_INFO: `/v3/users` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:18.421998 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c97dbc-36c6-462d-b4b9-b25706428d21 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:18.422393 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c97dbc-36c6-462d-b4b9-b25706428d21 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:18.424191 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c97dbc-36c6-462d-b4b9-b25706428d21 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:18.431959 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17620c77-1627-4745-ac7e-d78413708905 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:18.445186 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 388/798] 10.222.0.40 () {56 vars in 1133 bytes} [Thu Jul 14 09:25:18 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:25:18.446073 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c97dbc-36c6-462d-b4b9-b25706428d21 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:18.471576 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b14f35f-fb2d-426f-85ae-0b7bb0fd4578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:18.472247 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b14f35f-fb2d-426f-85ae-0b7bb0fd4578 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:18.472530 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b14f35f-fb2d-426f-85ae-0b7bb0fd4578 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:18.472866 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b14f35f-fb2d-426f-85ae-0b7bb0fd4578 None admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:18.473622 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b14f35f-fb2d-426f-85ae-0b7bb0fd4578 None admin] RBAC: Adding query filter params (name=service) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:18.473981 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b14f35f-fb2d-426f-85ae-0b7bb0fd4578 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:18.476108 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b14f35f-fb2d-426f-85ae-0b7bb0fd4578 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:18.484679 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 411/799] 10.222.0.40 () {56 vars in 1103 bytes} [Thu Jul 14 09:25:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:25:18.485486 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b14f35f-fb2d-426f-85ae-0b7bb0fd4578 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:18.512255 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:18.577222 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c97dbc-36c6-462d-b4b9-b25706428d21 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:18.594182 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b14f35f-fb2d-426f-85ae-0b7bb0fd4578 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:18.618370 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cade5f-2077-4223-bba7-515fbd40ac15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:18.619162 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cade5f-2077-4223-bba7-515fbd40ac15 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:18.619445 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cade5f-2077-4223-bba7-515fbd40ac15 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:18.619929 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cade5f-2077-4223-bba7-515fbd40ac15 None admin] PATH_INFO: `/v3/users` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:18.620556 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cade5f-2077-4223-bba7-515fbd40ac15 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:18.620861 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cade5f-2077-4223-bba7-515fbd40ac15 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:18.622323 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cade5f-2077-4223-bba7-515fbd40ac15 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:18.631393 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19337941-7a35-493f-bcff-41d1735f5bb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:18.632049 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19337941-7a35-493f-bcff-41d1735f5bb4 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:18.632332 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19337941-7a35-493f-bcff-41d1735f5bb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:18.632612 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19337941-7a35-493f-bcff-41d1735f5bb4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:18.644738 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 389/800] 10.222.0.40 () {56 vars in 1135 bytes} [Thu Jul 14 09:25:18 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:25:18.644738 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05f2a13-4b65-4b06-804f-80117e835998 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:18.644738 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05f2a13-4b65-4b06-804f-80117e835998 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:18.644738 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05f2a13-4b65-4b06-804f-80117e835998 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:18.644738 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 390/801] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:25:18 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:25:18.644738 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05f2a13-4b65-4b06-804f-80117e835998 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:18.657599 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:18.714061 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19337941-7a35-493f-bcff-41d1735f5bb4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:18.716219 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19337941-7a35-493f-bcff-41d1735f5bb4 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:18.757822 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05f2a13-4b65-4b06-804f-80117e835998 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:18.766434 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:18.805108 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa9301f-4a5e-463e-9b76-5bd3fc18dc81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:18.806337 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa9301f-4a5e-463e-9b76-5bd3fc18dc81 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:18.806941 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa9301f-4a5e-463e-9b76-5bd3fc18dc81 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:18.807547 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa9301f-4a5e-463e-9b76-5bd3fc18dc81 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:18.820215 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa9301f-4a5e-463e-9b76-5bd3fc18dc81 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:18.822213 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa9301f-4a5e-463e-9b76-5bd3fc18dc81 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:18.823333 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 412/802] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 14 09:25:18 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 09:25:18.824205 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19337941-7a35-493f-bcff-41d1735f5bb4 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:18.845745 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-bfa9301f-4a5e-463e-9b76-5bd3fc18dc81 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:25:18.845745 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:25:18.845745 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:25:18.845745 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:25:18.845745 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:25:18.845745 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:25:18.845745 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:25:18.845745 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:25:18.845745 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:25:18.845745 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:25:18.845745 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:25:18.845745 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:25:18.845745 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 09:25:18.845745 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 09:25:18.845745 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 09:25:18.846738 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 09:25:18.846738 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:25:18.846738 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:25:18.846738 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:25:18.846738 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:25:18.846738 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:25:18.846738 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:25:18.846738 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:25:18.846738 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( Jul 14 09:25:18.846738 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:25:18.846738 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:25:18.846738 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:25:18.846738 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:25:18.846738 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:25:18.846738 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:25:18.846738 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:25:18.846738 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:25:18.848372 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 09:25:18.848372 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 09:25:18.848372 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:25:18.848372 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:25:18.848372 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 391/803] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 09:25:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:25:18.849159 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5679e76-bdba-4ee7-97ba-50450e4d2352 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:18.850043 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5679e76-bdba-4ee7-97ba-50450e4d2352 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:18.850421 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5679e76-bdba-4ee7-97ba-50450e4d2352 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:18.867889 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-a5679e76-bdba-4ee7-97ba-50450e4d2352 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:25:18.869166 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-a5679e76-bdba-4ee7-97ba-50450e4d2352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:18.881817 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:18.944057 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19337941-7a35-493f-bcff-41d1735f5bb4 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:18.947584 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 392/804] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:25:18 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 09:25:18.951085 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5679e76-bdba-4ee7-97ba-50450e4d2352 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:18.981993 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8745c6b-cf6e-4379-9708-b8e9e0e566aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:18.982908 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8745c6b-cf6e-4379-9708-b8e9e0e566aa None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:18.983182 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8745c6b-cf6e-4379-9708-b8e9e0e566aa None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:18.983447 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8745c6b-cf6e-4379-9708-b8e9e0e566aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:18.995183 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8745c6b-cf6e-4379-9708-b8e9e0e566aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:18.996643 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8745c6b-cf6e-4379-9708-b8e9e0e566aa None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:19.020634 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-d8745c6b-cf6e-4379-9708-b8e9e0e566aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:25:19.020634 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:25:19.020634 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:25:19.020634 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:25:19.020634 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:25:19.020634 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:25:19.020634 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:25:19.020634 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:25:19.020634 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:25:19.020634 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:25:19.020634 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:25:19.020634 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:25:19.020634 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 09:25:19.020634 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 09:25:19.020634 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 09:25:19.022169 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 09:25:19.022169 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:25:19.022169 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:25:19.022169 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:25:19.022169 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:25:19.022169 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:25:19.022169 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:25:19.022169 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:25:19.022169 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( Jul 14 09:25:19.022169 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:25:19.022169 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:25:19.022169 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:25:19.022169 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:25:19.022169 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:25:19.022169 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:25:19.022169 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:25:19.022169 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:25:19.023097 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 09:25:19.023097 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 09:25:19.023097 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:25:19.023097 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Jul 14 09:25:19.023097 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 413/805] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 09:25:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:25:19.023799 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8745c6b-cf6e-4379-9708-b8e9e0e566aa None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:19.086366 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:19.103002 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5679e76-bdba-4ee7-97ba-50450e4d2352 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:19.131704 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:19.136194 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8745c6b-cf6e-4379-9708-b8e9e0e566aa None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:19.141350 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3681d3-be14-400f-8e67-8802654b6264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:19.142151 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3681d3-be14-400f-8e67-8802654b6264 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:19.142461 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3681d3-be14-400f-8e67-8802654b6264 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:19.142735 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3681d3-be14-400f-8e67-8802654b6264 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:19.154542 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3681d3-be14-400f-8e67-8802654b6264 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:19.156384 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3681d3-be14-400f-8e67-8802654b6264 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:19.175321 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-5a3681d3-be14-400f-8e67-8802654b6264 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:25:19.175321 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:25:19.175321 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:25:19.175321 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:25:19.175321 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:25:19.175321 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:25:19.175321 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:25:19.175321 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:25:19.175321 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:25:19.175321 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:25:19.175321 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:25:19.175321 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:25:19.175321 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 09:25:19.175321 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 09:25:19.175321 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 09:25:19.176445 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 09:25:19.176445 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:25:19.176445 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:25:19.176445 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:25:19.176445 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:25:19.176445 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:25:19.176445 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:25:19.176445 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:25:19.176445 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( Jul 14 09:25:19.176445 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:25:19.176445 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:25:19.176445 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:25:19.176445 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:25:19.176445 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:25:19.176445 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:25:19.176445 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:25:19.176445 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:25:19.177585 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 09:25:19.177585 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 09:25:19.177585 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:25:19.177585 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:25:19.177585 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 393/806] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 09:25:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:25:19.177585 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3681d3-be14-400f-8e67-8802654b6264 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:19.182385 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04642d03-b63d-4503-a193-7f02f075767d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:19.182385 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04642d03-b63d-4503-a193-7f02f075767d None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:19.182655 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04642d03-b63d-4503-a193-7f02f075767d None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:19.182773 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04642d03-b63d-4503-a193-7f02f075767d None admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:19.183510 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04642d03-b63d-4503-a193-7f02f075767d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:19.183820 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04642d03-b63d-4503-a193-7f02f075767d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:19.185191 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04642d03-b63d-4503-a193-7f02f075767d None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:19.197637 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 414/807] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 14 09:25:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:25:19.198533 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04642d03-b63d-4503-a193-7f02f075767d None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:19.302843 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3681d3-be14-400f-8e67-8802654b6264 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:19.308302 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04642d03-b63d-4503-a193-7f02f075767d None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:19.342157 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd621b8-fc93-4515-8f06-76c00152defb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:19.342988 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd621b8-fc93-4515-8f06-76c00152defb None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:19.343275 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd621b8-fc93-4515-8f06-76c00152defb None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:19.343512 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be3aee8-c3d3-43a4-a79c-2123e7153a7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:19.343651 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd621b8-fc93-4515-8f06-76c00152defb None admin] PATH_INFO: `/v3/services/network` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:19.344180 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be3aee8-c3d3-43a4-a79c-2123e7153a7b None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:19.344279 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd621b8-fc93-4515-8f06-76c00152defb None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:19.344463 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be3aee8-c3d3-43a4-a79c-2123e7153a7b None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:19.344739 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be3aee8-c3d3-43a4-a79c-2123e7153a7b None admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:19.345467 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be3aee8-c3d3-43a4-a79c-2123e7153a7b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:19.345576 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd621b8-fc93-4515-8f06-76c00152defb None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:19.345773 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be3aee8-c3d3-43a4-a79c-2123e7153a7b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:19.347154 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be3aee8-c3d3-43a4-a79c-2123e7153a7b None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:19.357903 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-afd621b8-fc93-4515-8f06-76c00152defb None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 14 09:25:19.357903 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:25:19.357903 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 09:25:19.357903 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 09:25:19.357903 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 09:25:19.357903 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 09:25:19.357903 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 09:25:19.357903 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 09:25:19.357903 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 14 09:25:19.357903 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:25:19.357903 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 09:25:19.357903 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:25:19.357903 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:25:19.357903 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:25:19.357903 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:25:19.357903 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:25:19.357903 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:25:19.359212 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:25:19.359212 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:25:19.359212 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:25:19.359212 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:25:19.359212 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:25:19.359212 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:25:19.359212 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 09:25:19.359212 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 09:25:19.359212 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 09:25:19.359212 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 09:25:19.359212 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:25:19.359212 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:25:19.359212 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:25:19.359212 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:25:19.359212 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:25:19.359212 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:25:19.360053 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:25:19.360053 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( Jul 14 09:25:19.360053 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:25:19.360053 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:25:19.360053 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:25:19.360053 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:25:19.360053 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:25:19.360053 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:25:19.360053 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:25:19.360053 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:25:19.360053 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 09:25:19.360053 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 09:25:19.360053 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 14 09:25:19.360053 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:25:19.360053 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 394/808] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jul 14 09:25:19 2022] GET /identity/v3/services/network => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:25:19.360836 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480e776b-63d2-498e-9b03-3cf29a0fec0f None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:19.360836 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480e776b-63d2-498e-9b03-3cf29a0fec0f None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:19.361062 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480e776b-63d2-498e-9b03-3cf29a0fec0f None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:19.362438 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 395/809] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:25:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:25:19.362961 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480e776b-63d2-498e-9b03-3cf29a0fec0f None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:19.366750 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 415/810] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 14 09:25:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:25:19.367860 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be3aee8-c3d3-43a4-a79c-2123e7153a7b None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:19.368943 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:19.391650 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:19.473540 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480e776b-63d2-498e-9b03-3cf29a0fec0f None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:19.477604 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be3aee8-c3d3-43a4-a79c-2123e7153a7b None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:19.508794 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a3d64b-c924-454c-8e93-91e7f122add7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:19.509461 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a3d64b-c924-454c-8e93-91e7f122add7 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:19.509742 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a3d64b-c924-454c-8e93-91e7f122add7 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:19.510016 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a3d64b-c924-454c-8e93-91e7f122add7 None admin] PATH_INFO: `/v3/domains` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:19.510771 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a3d64b-c924-454c-8e93-91e7f122add7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:19.511077 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a3d64b-c924-454c-8e93-91e7f122add7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:19.512436 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a3d64b-c924-454c-8e93-91e7f122add7 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:19.512709 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99949faf-bfcd-42a1-ba1e-146c76606eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:19.513526 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99949faf-bfcd-42a1-ba1e-146c76606eff None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:19.513820 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99949faf-bfcd-42a1-ba1e-146c76606eff None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:19.514099 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99949faf-bfcd-42a1-ba1e-146c76606eff None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:19.522143 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99949faf-bfcd-42a1-ba1e-146c76606eff None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:19.523622 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99949faf-bfcd-42a1-ba1e-146c76606eff None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:19.525427 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 396/811] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 14 09:25:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:25:19.526834 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5906ce53-e216-4f0b-9f7a-29de3e8f54d8 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:19.527125 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5906ce53-e216-4f0b-9f7a-29de3e8f54d8 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:19.527395 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5906ce53-e216-4f0b-9f7a-29de3e8f54d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:19.541932 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-99949faf-bfcd-42a1-ba1e-146c76606eff None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 14 09:25:19.541932 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:25:19.541932 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:25:19.541932 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:25:19.541932 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:25:19.541932 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:25:19.541932 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:25:19.541932 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:25:19.541932 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:25:19.541932 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:25:19.541932 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:25:19.541932 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:25:19.541932 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 09:25:19.541932 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 09:25:19.541932 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 09:25:19.541932 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 09:25:19.543101 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:25:19.543101 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:25:19.543101 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 09:25:19.543101 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 09:25:19.543101 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 09:25:19.543101 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 09:25:19.543101 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:25:19.543101 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:25:19.543101 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:25:19.543101 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:25:19.543101 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:25:19.543101 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( Jul 14 09:25:19.543101 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:25:19.543101 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:25:19.543101 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:25:19.543101 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:25:19.543101 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:25:19.543101 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:25:19.544016 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:25:19.544016 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:25:19.544016 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 09:25:19.544016 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 09:25:19.544016 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 09:25:19.544016 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 09:25:19.544016 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 09:25:19.544016 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 09:25:19.544016 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 14 09:25:19.544016 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Jul 14 09:25:19.544016 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 416/812] 10.222.0.40 () {56 vars in 1117 bytes} [Thu Jul 14 09:25:19 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:25:19.544016 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99949faf-bfcd-42a1-ba1e-146c76606eff None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:19.546005 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-5906ce53-e216-4f0b-9f7a-29de3e8f54d8 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:25:19.547244 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-5906ce53-e216-4f0b-9f7a-29de3e8f54d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:19.609695 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:19.619591 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 397/813] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:25:19 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 09:25:19.620512 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5906ce53-e216-4f0b-9f7a-29de3e8f54d8 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:19.637177 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:19.660557 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99949faf-bfcd-42a1-ba1e-146c76606eff None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:19.695265 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3f20ce-1a37-4599-80b3-41d8bf3d008a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:19.695936 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3f20ce-1a37-4599-80b3-41d8bf3d008a None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:19.696226 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3f20ce-1a37-4599-80b3-41d8bf3d008a None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:19.696504 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3f20ce-1a37-4599-80b3-41d8bf3d008a None admin] PATH_INFO: `/v3/services` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:19.697214 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3f20ce-1a37-4599-80b3-41d8bf3d008a None admin] RBAC: Adding query filter params (name=network) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:19.697523 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3f20ce-1a37-4599-80b3-41d8bf3d008a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:19.698923 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3f20ce-1a37-4599-80b3-41d8bf3d008a None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:19.703534 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 417/814] 10.222.0.40 () {56 vars in 1112 bytes} [Thu Jul 14 09:25:19 2022] GET /identity/v3/services?name=network => generated 124 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:25:19.704425 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3f20ce-1a37-4599-80b3-41d8bf3d008a None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:19.727372 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5906ce53-e216-4f0b-9f7a-29de3e8f54d8 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:19.766213 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef77d1c8-6cbe-4761-b379-e890f5e951f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:19.767026 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef77d1c8-6cbe-4761-b379-e890f5e951f4 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:19.767305 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef77d1c8-6cbe-4761-b379-e890f5e951f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:19.767580 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef77d1c8-6cbe-4761-b379-e890f5e951f4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:19.775287 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef77d1c8-6cbe-4761-b379-e890f5e951f4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:19.776738 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef77d1c8-6cbe-4761-b379-e890f5e951f4 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:19.790952 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-ef77d1c8-6cbe-4761-b379-e890f5e951f4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 09:25:19.790952 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:25:19.790952 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:25:19.790952 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:25:19.790952 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:25:19.790952 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:25:19.790952 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:25:19.790952 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:25:19.790952 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:25:19.790952 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:25:19.790952 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:25:19.790952 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:25:19.790952 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 09:25:19.790952 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 09:25:19.790952 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 09:25:19.792065 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 09:25:19.792065 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:25:19.792065 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:25:19.792065 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:25:19.792065 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:25:19.792065 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:25:19.792065 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:25:19.792065 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:25:19.792065 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( Jul 14 09:25:19.792065 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:25:19.792065 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:25:19.792065 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:25:19.792065 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:25:19.792065 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:25:19.792065 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:25:19.792065 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:25:19.792065 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:25:19.793000 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 09:25:19.793000 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 09:25:19.793000 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 09:25:19.793000 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 09:25:19.793000 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 09:25:19.793000 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 09:25:19.793000 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 09:25:19.793000 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:25:19.793000 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 398/815] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jul 14 09:25:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:25:19.793479 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef77d1c8-6cbe-4761-b379-e890f5e951f4 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:19.808729 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3f20ce-1a37-4599-80b3-41d8bf3d008a None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:19.843505 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3eb10c-3bb5-4bc7-9696-8a7720c9d90d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:19.844316 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3eb10c-3bb5-4bc7-9696-8a7720c9d90d None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:19.844604 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3eb10c-3bb5-4bc7-9696-8a7720c9d90d None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:19.844884 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3eb10c-3bb5-4bc7-9696-8a7720c9d90d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:19.850544 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:19.851891 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3eb10c-3bb5-4bc7-9696-8a7720c9d90d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:19.853343 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3eb10c-3bb5-4bc7-9696-8a7720c9d90d None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:19.868255 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-bb3eb10c-3bb5-4bc7-9696-8a7720c9d90d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 09:25:19.868255 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:25:19.868255 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:25:19.868255 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:25:19.868255 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:25:19.868255 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:25:19.868255 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:25:19.868255 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:25:19.868255 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:25:19.868255 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:25:19.868255 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:25:19.868255 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:25:19.868255 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 09:25:19.868255 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 09:25:19.868255 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 09:25:19.869317 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 09:25:19.869317 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:25:19.869317 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:25:19.869317 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:25:19.869317 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:25:19.869317 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:25:19.869317 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:25:19.869317 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:25:19.869317 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( Jul 14 09:25:19.869317 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:25:19.869317 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:25:19.869317 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:25:19.869317 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:25:19.869317 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:25:19.869317 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:25:19.869317 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:25:19.869317 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:25:19.870225 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 09:25:19.870225 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 09:25:19.870225 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 09:25:19.870225 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 09:25:19.870225 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 09:25:19.870225 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 09:25:19.870225 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 09:25:19.870225 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Jul 14 09:25:19.870225 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 418/816] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jul 14 09:25:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:25:19.870225 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3eb10c-3bb5-4bc7-9696-8a7720c9d90d None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:19.874905 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:19.897482 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef77d1c8-6cbe-4761-b379-e890f5e951f4 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:19.931281 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3190cfa1-2dc2-4ae2-a94c-0c0b3fb2d391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:19.931953 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3190cfa1-2dc2-4ae2-a94c-0c0b3fb2d391 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:19.932239 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3190cfa1-2dc2-4ae2-a94c-0c0b3fb2d391 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:19.932513 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3190cfa1-2dc2-4ae2-a94c-0c0b3fb2d391 None admin] PATH_INFO: `/v3/users` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:19.933347 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3190cfa1-2dc2-4ae2-a94c-0c0b3fb2d391 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:19.933654 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3190cfa1-2dc2-4ae2-a94c-0c0b3fb2d391 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:19.935231 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3190cfa1-2dc2-4ae2-a94c-0c0b3fb2d391 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:19.952102 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 399/817] 10.222.0.40 () {56 vars in 1149 bytes} [Thu Jul 14 09:25:19 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:25:19.952940 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3190cfa1-2dc2-4ae2-a94c-0c0b3fb2d391 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:19.977170 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3eb10c-3bb5-4bc7-9696-8a7720c9d90d None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:20.012184 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f952fe-619b-4288-9916-9ed16264d4ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:20.012914 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f952fe-619b-4288-9916-9ed16264d4ca None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:20.013284 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f952fe-619b-4288-9916-9ed16264d4ca None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:20.013562 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f952fe-619b-4288-9916-9ed16264d4ca None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:20.014313 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f952fe-619b-4288-9916-9ed16264d4ca None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:20.015680 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f952fe-619b-4288-9916-9ed16264d4ca None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:20.027820 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-d8f952fe-619b-4288-9916-9ed16264d4ca None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 14 09:25:20.027820 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:25:20.027820 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 09:25:20.027820 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 09:25:20.027820 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 09:25:20.027820 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 09:25:20.027820 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 09:25:20.027820 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 09:25:20.027820 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 14 09:25:20.027820 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Jul 14 09:25:20.027820 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 09:25:20.027820 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Jul 14 09:25:20.027820 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:25:20.027820 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:25:20.027820 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:25:20.027820 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:25:20.028781 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:25:20.028781 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:25:20.028781 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:25:20.028781 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:25:20.028781 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:25:20.028781 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:25:20.028781 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:25:20.028781 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 09:25:20.028781 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 09:25:20.028781 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 09:25:20.028781 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 09:25:20.028781 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:25:20.028781 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:25:20.028781 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:25:20.028781 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:25:20.028781 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:25:20.029592 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:25:20.029592 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:25:20.029592 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( Jul 14 09:25:20.029592 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:25:20.029592 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:25:20.029592 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:25:20.029592 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:25:20.029592 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:25:20.029592 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:25:20.029592 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:25:20.029592 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:25:20.029592 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 09:25:20.029592 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 09:25:20.029592 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 14 09:25:20.029592 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Jul 14 09:25:20.029592 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 419/818] 10.222.0.40 () {56 vars in 1129 bytes} [Thu Jul 14 09:25:19 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:25:20.030568 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f952fe-619b-4288-9916-9ed16264d4ca None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:20.057382 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3190cfa1-2dc2-4ae2-a94c-0c0b3fb2d391 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:20.070509 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:20.091229 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1001900-720f-423b-95cf-69fe6e81155f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:20.091896 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1001900-720f-423b-95cf-69fe6e81155f None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:20.092178 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1001900-720f-423b-95cf-69fe6e81155f None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:20.092460 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1001900-720f-423b-95cf-69fe6e81155f None admin] PATH_INFO: `/v3/services` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:20.093173 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1001900-720f-423b-95cf-69fe6e81155f None admin] RBAC: Adding query filter params (type=network) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:20.093481 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1001900-720f-423b-95cf-69fe6e81155f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:20.094885 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1001900-720f-423b-95cf-69fe6e81155f None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:20.100237 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 400/819] 10.222.0.40 () {56 vars in 1112 bytes} [Thu Jul 14 09:25:19 2022] GET /identity/v3/services?type=network => generated 350 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:25:20.100366 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:20.101008 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1001900-720f-423b-95cf-69fe6e81155f None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:20.139060 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f952fe-619b-4288-9916-9ed16264d4ca None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:20.174326 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0b26ba-25fd-4f7d-a18f-3a4966ed0904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:20.174994 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0b26ba-25fd-4f7d-a18f-3a4966ed0904 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:20.175276 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0b26ba-25fd-4f7d-a18f-3a4966ed0904 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:20.175550 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0b26ba-25fd-4f7d-a18f-3a4966ed0904 None admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:20.176339 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0b26ba-25fd-4f7d-a18f-3a4966ed0904 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:20.176661 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0b26ba-25fd-4f7d-a18f-3a4966ed0904 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:20.178720 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0b26ba-25fd-4f7d-a18f-3a4966ed0904 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:20.191123 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 420/820] 10.222.0.40 () {56 vars in 1148 bytes} [Thu Jul 14 09:25:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:25:20.192306 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0b26ba-25fd-4f7d-a18f-3a4966ed0904 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:20.199831 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1001900-720f-423b-95cf-69fe6e81155f None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:20.236235 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ed17b8-485c-4ef1-bd4b-1a1b16cbcee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:20.236899 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ed17b8-485c-4ef1-bd4b-1a1b16cbcee6 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:20.237184 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ed17b8-485c-4ef1-bd4b-1a1b16cbcee6 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:20.237466 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ed17b8-485c-4ef1-bd4b-1a1b16cbcee6 None admin] PATH_INFO: `/v3/projects` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:20.238283 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ed17b8-485c-4ef1-bd4b-1a1b16cbcee6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:20.238597 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ed17b8-485c-4ef1-bd4b-1a1b16cbcee6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:20.240596 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ed17b8-485c-4ef1-bd4b-1a1b16cbcee6 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:20.254112 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 401/821] 10.222.0.40 () {56 vars in 1148 bytes} [Thu Jul 14 09:25:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:25:20.254982 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ed17b8-485c-4ef1-bd4b-1a1b16cbcee6 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:20.296779 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:20.300565 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0b26ba-25fd-4f7d-a18f-3a4966ed0904 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:20.329554 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:20.339087 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b7e9d5-8363-4bfb-b4c6-3794cddf07d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:20.339898 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b7e9d5-8363-4bfb-b4c6-3794cddf07d5 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:20.340188 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b7e9d5-8363-4bfb-b4c6-3794cddf07d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:20.340468 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b7e9d5-8363-4bfb-b4c6-3794cddf07d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:20.352183 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b7e9d5-8363-4bfb-b4c6-3794cddf07d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:20.353636 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b7e9d5-8363-4bfb-b4c6-3794cddf07d5 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:20.363617 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ed17b8-485c-4ef1-bd4b-1a1b16cbcee6 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:20.372273 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-70b7e9d5-8363-4bfb-b4c6-3794cddf07d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:25:20.372273 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:25:20.372273 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:25:20.372273 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:25:20.372273 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:25:20.372273 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:25:20.372273 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:25:20.372273 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:25:20.372273 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:25:20.372273 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:25:20.372273 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:25:20.372273 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:25:20.372273 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 09:25:20.372273 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 09:25:20.372273 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 09:25:20.373162 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 09:25:20.373162 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:25:20.373162 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:25:20.373162 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:25:20.373162 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:25:20.373162 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:25:20.373162 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:25:20.373162 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:25:20.373162 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( Jul 14 09:25:20.373162 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:25:20.373162 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:25:20.373162 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:25:20.373162 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:25:20.373162 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:25:20.373162 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:25:20.373162 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:25:20.373162 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:25:20.374293 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 09:25:20.374293 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 09:25:20.374293 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:25:20.374293 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Jul 14 09:25:20.374293 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 421/822] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 09:25:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:25:20.374293 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b7e9d5-8363-4bfb-b4c6-3794cddf07d5 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:20.402570 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211840b6-17bd-4081-b22e-676ea256c377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:20.403243 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211840b6-17bd-4081-b22e-676ea256c377 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:20.403531 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211840b6-17bd-4081-b22e-676ea256c377 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:20.403810 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211840b6-17bd-4081-b22e-676ea256c377 None admin] PATH_INFO: `/v3/services` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:20.404555 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211840b6-17bd-4081-b22e-676ea256c377 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:20.404872 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211840b6-17bd-4081-b22e-676ea256c377 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:20.406354 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211840b6-17bd-4081-b22e-676ea256c377 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:20.411130 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 402/823] 10.222.0.40 () {56 vars in 1124 bytes} [Thu Jul 14 09:25:20 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:25:20.412485 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211840b6-17bd-4081-b22e-676ea256c377 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:20.488549 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b7e9d5-8363-4bfb-b4c6-3794cddf07d5 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:20.524240 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:20.528194 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211840b6-17bd-4081-b22e-676ea256c377 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:20.533624 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710671b3-a8bb-4fd8-b3e6-013698aabe6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:20.534394 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710671b3-a8bb-4fd8-b3e6-013698aabe6f None admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:20.534624 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710671b3-a8bb-4fd8-b3e6-013698aabe6f None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:20.534887 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710671b3-a8bb-4fd8-b3e6-013698aabe6f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:20.536244 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710671b3-a8bb-4fd8-b3e6-013698aabe6f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:20.538243 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710671b3-a8bb-4fd8-b3e6-013698aabe6f None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:20.562545 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 422/824] 10.222.0.40 () {60 vars in 1144 bytes} [Thu Jul 14 09:25:20 2022] POST /identity/v3/endpoints => generated 327 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:25:20.563475 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710671b3-a8bb-4fd8-b3e6-013698aabe6f None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:20.602671 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c41fbe0-b7b9-49bd-84bc-dedc4629501e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:20.604111 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c41fbe0-b7b9-49bd-84bc-dedc4629501e None admin] REQUEST_METHOD: `PUT` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:20.604406 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c41fbe0-b7b9-49bd-84bc-dedc4629501e None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:20.604690 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c41fbe0-b7b9-49bd-84bc-dedc4629501e None admin] PATH_INFO: `/v3/projects/a478e76f04dd413f89ddfba7b0cdc9cc/users/302c0f7dd3bf4829aad0b29bd0c091a5/roles/e3965bd0d5f1427a86a313c0c90bfef3` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:20.606935 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c41fbe0-b7b9-49bd-84bc-dedc4629501e None admin] RBAC: Authorizing `identity:create_grant(project_id=a478e76f04dd413f89ddfba7b0cdc9cc, user_id=302c0f7dd3bf4829aad0b29bd0c091a5, role_id=e3965bd0d5f1427a86a313c0c90bfef3)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:20.608460 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c41fbe0-b7b9-49bd-84bc-dedc4629501e None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:20.614745 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:20.641287 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 403/825] 10.222.0.40 () {58 vars in 1439 bytes} [Thu Jul 14 09:25:20 2022] PUT /identity/v3/projects/a478e76f04dd413f89ddfba7b0cdc9cc/users/302c0f7dd3bf4829aad0b29bd0c091a5/roles/e3965bd0d5f1427a86a313c0c90bfef3 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:25:20.641287 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c41fbe0-b7b9-49bd-84bc-dedc4629501e None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:20.712140 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710671b3-a8bb-4fd8-b3e6-013698aabe6f None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:20.753269 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0220fe8-6fb7-443b-8aec-1f7184715d9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:20.754375 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0220fe8-6fb7-443b-8aec-1f7184715d9e None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:20.754661 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0220fe8-6fb7-443b-8aec-1f7184715d9e None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:20.755145 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0220fe8-6fb7-443b-8aec-1f7184715d9e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:20.758399 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0220fe8-6fb7-443b-8aec-1f7184715d9e None admin] RBAC: Adding query filter params (role.id=e3965bd0d5f1427a86a313c0c90bfef3, scope.project.id=a478e76f04dd413f89ddfba7b0cdc9cc, user.id=1f6962106dfa4c4c9af551053f8095e9) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:20.758998 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0220fe8-6fb7-443b-8aec-1f7184715d9e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:20.761708 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0220fe8-6fb7-443b-8aec-1f7184715d9e None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:20.769135 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 423/826] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jul 14 09:25:20 2022] GET /identity/v3/role_assignments?user.id=1f6962106dfa4c4c9af551053f8095e9&scope.project.id=a478e76f04dd413f89ddfba7b0cdc9cc&role.id=e3965bd0d5f1427a86a313c0c90bfef3 => generated 608 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:25:20.770371 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0220fe8-6fb7-443b-8aec-1f7184715d9e None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:20.771804 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c41fbe0-b7b9-49bd-84bc-dedc4629501e None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:20.839615 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4476b88e-b84b-4b8d-b81d-55d27773b9e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:20.840402 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4476b88e-b84b-4b8d-b81d-55d27773b9e0 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:20.840696 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4476b88e-b84b-4b8d-b81d-55d27773b9e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:20.840979 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4476b88e-b84b-4b8d-b81d-55d27773b9e0 None admin] PATH_INFO: `/v3/domains` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:20.841768 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4476b88e-b84b-4b8d-b81d-55d27773b9e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:20.842091 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4476b88e-b84b-4b8d-b81d-55d27773b9e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:20.844516 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4476b88e-b84b-4b8d-b81d-55d27773b9e0 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:20.864416 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 404/827] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 14 09:25:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:25:20.874031 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4476b88e-b84b-4b8d-b81d-55d27773b9e0 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:20.904269 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:20.953087 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:20.958261 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0220fe8-6fb7-443b-8aec-1f7184715d9e None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:21.008671 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945a6657-1fb5-4b83-92cf-4d79de6fee3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:21.009073 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945a6657-1fb5-4b83-92cf-4d79de6fee3c None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:21.009550 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945a6657-1fb5-4b83-92cf-4d79de6fee3c None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:21.010032 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945a6657-1fb5-4b83-92cf-4d79de6fee3c None admin] PATH_INFO: `/v3/services` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:21.012232 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945a6657-1fb5-4b83-92cf-4d79de6fee3c None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:21.012559 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945a6657-1fb5-4b83-92cf-4d79de6fee3c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:21.014652 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945a6657-1fb5-4b83-92cf-4d79de6fee3c None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:21.026602 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 424/828] 10.222.0.40 () {56 vars in 1124 bytes} [Thu Jul 14 09:25:20 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:25:21.028649 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945a6657-1fb5-4b83-92cf-4d79de6fee3c None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:21.061607 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4476b88e-b84b-4b8d-b81d-55d27773b9e0 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:21.120051 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb4214c-a34b-4db0-aa0f-035f661716b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:21.120923 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb4214c-a34b-4db0-aa0f-035f661716b7 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:21.121210 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb4214c-a34b-4db0-aa0f-035f661716b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:21.121485 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb4214c-a34b-4db0-aa0f-035f661716b7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:21.129912 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb4214c-a34b-4db0-aa0f-035f661716b7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:21.131576 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb4214c-a34b-4db0-aa0f-035f661716b7 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:21.147489 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-1cb4214c-a34b-4db0-aa0f-035f661716b7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 09:25:21.147489 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:25:21.147489 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:25:21.147489 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:25:21.147489 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:25:21.147489 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:25:21.147489 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:25:21.147489 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:25:21.147489 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:25:21.147489 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:25:21.147489 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:25:21.147489 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:25:21.147489 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 09:25:21.147489 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 09:25:21.147489 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 09:25:21.148527 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 09:25:21.148527 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:25:21.148527 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:25:21.148527 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:25:21.148527 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:25:21.148527 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:25:21.148527 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:25:21.148527 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:25:21.148527 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( Jul 14 09:25:21.148527 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:25:21.148527 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:25:21.148527 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:25:21.148527 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:25:21.148527 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:25:21.148527 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:25:21.148527 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:25:21.148527 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:25:21.149426 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 09:25:21.149426 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 09:25:21.149426 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 09:25:21.149426 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 09:25:21.149426 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 09:25:21.149426 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 09:25:21.149426 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 09:25:21.149426 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:25:21.149426 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 405/829] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jul 14 09:25:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 09:25:21.154656 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb4214c-a34b-4db0-aa0f-035f661716b7 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:21.180223 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945a6657-1fb5-4b83-92cf-4d79de6fee3c None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:21.218586 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b68c094-30d4-4ba0-a788-849abded36a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:21.219383 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b68c094-30d4-4ba0-a788-849abded36a4 None admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:21.219735 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b68c094-30d4-4ba0-a788-849abded36a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:21.220081 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b68c094-30d4-4ba0-a788-849abded36a4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:21.220908 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b68c094-30d4-4ba0-a788-849abded36a4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:21.222411 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b68c094-30d4-4ba0-a788-849abded36a4 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:21.248447 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:21.250688 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 425/830] 10.222.0.40 () {60 vars in 1144 bytes} [Thu Jul 14 09:25:21 2022] POST /identity/v3/endpoints => generated 346 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 09:25:21.290816 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb4214c-a34b-4db0-aa0f-035f661716b7 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:21.340883 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05605a92-ede1-4432-842a-fd0d3d9c12a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:21.341934 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05605a92-ede1-4432-842a-fd0d3d9c12a6 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:21.342439 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05605a92-ede1-4432-842a-fd0d3d9c12a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:21.342934 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05605a92-ede1-4432-842a-fd0d3d9c12a6 None admin] PATH_INFO: `/v3/projects` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:21.343947 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05605a92-ede1-4432-842a-fd0d3d9c12a6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:21.344431 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05605a92-ede1-4432-842a-fd0d3d9c12a6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:21.346145 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05605a92-ede1-4432-842a-fd0d3d9c12a6 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:21.361418 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 406/831] 10.222.0.40 () {56 vars in 1148 bytes} [Thu Jul 14 09:25:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:25:21.368022 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b68c094-30d4-4ba0-a788-849abded36a4 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:21.396557 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:21.490615 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b68c094-30d4-4ba0-a788-849abded36a4 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:21.527958 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f232c0c-54f8-4ec5-bd20-d945c0297f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:21.528978 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f232c0c-54f8-4ec5-bd20-d945c0297f75 None admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:21.529271 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f232c0c-54f8-4ec5-bd20-d945c0297f75 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:21.529553 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f232c0c-54f8-4ec5-bd20-d945c0297f75 None admin] PATH_INFO: `/v3/projects/a478e76f04dd413f89ddfba7b0cdc9cc/users/6cf35868f9ff46e2835a6cc023641da6/roles/c12236aebd8048ba991da4671b44935f` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:21.546415 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f232c0c-54f8-4ec5-bd20-d945c0297f75 None admin] RBAC: Authorizing `identity:create_grant(project_id=a478e76f04dd413f89ddfba7b0cdc9cc, user_id=6cf35868f9ff46e2835a6cc023641da6, role_id=c12236aebd8048ba991da4671b44935f)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:21.547876 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f232c0c-54f8-4ec5-bd20-d945c0297f75 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:21.572320 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 426/832] 10.222.0.40 () {58 vars in 1439 bytes} [Thu Jul 14 09:25:21 2022] PUT /identity/v3/projects/a478e76f04dd413f89ddfba7b0cdc9cc/users/6cf35868f9ff46e2835a6cc023641da6/roles/c12236aebd8048ba991da4671b44935f => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:25:22.874639 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f426e6e-eedf-493f-a6a9-ffcd4e41f904 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:22.875358 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f426e6e-eedf-493f-a6a9-ffcd4e41f904 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:22.875358 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f426e6e-eedf-493f-a6a9-ffcd4e41f904 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:22.876746 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 407/833] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:25:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:25:22.882672 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7e7cf2-bdef-4c1a-9d69-143963555b7a None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:22.883307 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7e7cf2-bdef-4c1a-9d69-143963555b7a None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:22.883307 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7e7cf2-bdef-4c1a-9d69-143963555b7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:22.908364 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-af7e7cf2-bdef-4c1a-9d69-143963555b7a None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:25:22.910926 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-af7e7cf2-bdef-4c1a-9d69-143963555b7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:22.993313 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:22.997923 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 427/834] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:25:22 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 09:25:23.022098 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f426e6e-eedf-493f-a6a9-ffcd4e41f904 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:23.124284 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8288f26-ae83-46d9-9126-9adaf902dc96 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:23.124569 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8288f26-ae83-46d9-9126-9adaf902dc96 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:23.124958 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8288f26-ae83-46d9-9126-9adaf902dc96 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:23.126577 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 428/835] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:25:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 09:25:23.133775 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bffa054-14a4-4bb5-974d-9c5dbc1b8b98 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:23.134150 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bffa054-14a4-4bb5-974d-9c5dbc1b8b98 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:23.134437 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bffa054-14a4-4bb5-974d-9c5dbc1b8b98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:23.138539 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f426e6e-eedf-493f-a6a9-ffcd4e41f904 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:23.159753 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-3bffa054-14a4-4bb5-974d-9c5dbc1b8b98 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:25:23.161108 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-3bffa054-14a4-4bb5-974d-9c5dbc1b8b98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:23.171402 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:23.176784 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61a3d04-616a-481e-9211-4b3c6bc9bd2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:23.177818 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61a3d04-616a-481e-9211-4b3c6bc9bd2a None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:23.178143 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61a3d04-616a-481e-9211-4b3c6bc9bd2a None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:23.178622 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61a3d04-616a-481e-9211-4b3c6bc9bd2a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:23.189770 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61a3d04-616a-481e-9211-4b3c6bc9bd2a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:25:23.198137 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-d61a3d04-616a-481e-9211-4b3c6bc9bd2a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 09:25:23.198137 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:25:23.198137 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:25:23.198137 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:25:23.198137 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:25:23.198137 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:25:23.198137 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:25:23.198137 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:25:23.198137 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:25:23.198137 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:25:23.198137 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:25:23.198137 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:25:23.198137 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:25:23.198137 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:25:23.198137 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:25:23.198137 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:25:23.199148 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:25:23.199148 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:25:23.199148 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:25:23.199148 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:25:23.199148 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:25:23.199148 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:25:23.199148 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:25:23.199148 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:25:23.199148 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:25:23.199148 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:25:23.199148 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:25:23.199148 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( Jul 14 09:25:23.199148 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:25:23.199148 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:25:23.199148 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:25:23.199148 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:25:23.199991 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:25:23.199991 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:25:23.199991 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:25:23.199991 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:25:23.199991 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:25:23.199991 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:25:23.199991 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:25:23.199991 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:25:23.199991 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:25:23.199991 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:25:23.199991 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 09:25:23.199991 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:25:23.202259 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 408/836] 10.222.0.40 () {56 vars in 1096 bytes} [Thu Jul 14 09:25:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:25:23.205844 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61a3d04-616a-481e-9211-4b3c6bc9bd2a None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:23.254304 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 429/837] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:25:23 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 09:25:23.270703 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bffa054-14a4-4bb5-974d-9c5dbc1b8b98 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:23.316225 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61a3d04-616a-481e-9211-4b3c6bc9bd2a None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:23.351776 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dd1e31-e142-430d-a5e4-430f2f892bef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:23.352810 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dd1e31-e142-430d-a5e4-430f2f892bef None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:23.353294 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dd1e31-e142-430d-a5e4-430f2f892bef None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:23.353790 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dd1e31-e142-430d-a5e4-430f2f892bef None admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:23.354802 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dd1e31-e142-430d-a5e4-430f2f892bef None admin] RBAC: Adding query filter params (name=admin) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:23.355310 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dd1e31-e142-430d-a5e4-430f2f892bef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:23.356883 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dd1e31-e142-430d-a5e4-430f2f892bef None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:23.371541 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 409/838] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 14 09:25:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:25:23.373188 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dd1e31-e142-430d-a5e4-430f2f892bef None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:23.396943 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bffa054-14a4-4bb5-974d-9c5dbc1b8b98 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:23.429549 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:23.436146 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8ee6b6-a65f-4a06-9880-19cb583ffac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:23.436973 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8ee6b6-a65f-4a06-9880-19cb583ffac5 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:23.437258 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8ee6b6-a65f-4a06-9880-19cb583ffac5 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:23.437532 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8ee6b6-a65f-4a06-9880-19cb583ffac5 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:23.438206 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8ee6b6-a65f-4a06-9880-19cb583ffac5 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:23.439702 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8ee6b6-a65f-4a06-9880-19cb583ffac5 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:23.446942 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:23.454569 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-5f8ee6b6-a65f-4a06-9880-19cb583ffac5 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 14 09:25:23.454569 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:25:23.454569 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 09:25:23.454569 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 09:25:23.454569 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 09:25:23.454569 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 09:25:23.454569 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 09:25:23.454569 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 09:25:23.454569 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 14 09:25:23.454569 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Jul 14 09:25:23.454569 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 09:25:23.454569 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Jul 14 09:25:23.454569 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:25:23.454569 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:25:23.454569 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:25:23.454569 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:25:23.455530 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:25:23.455530 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:25:23.455530 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:25:23.455530 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:25:23.455530 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:25:23.455530 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:25:23.455530 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:25:23.455530 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 09:25:23.455530 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 09:25:23.455530 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 09:25:23.455530 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 09:25:23.455530 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:25:23.455530 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:25:23.455530 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:25:23.455530 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:25:23.455530 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:25:23.456340 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:25:23.456340 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:25:23.456340 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( Jul 14 09:25:23.456340 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:25:23.456340 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:25:23.456340 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:25:23.456340 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:25:23.456340 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:25:23.456340 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:25:23.456340 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:25:23.456340 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:25:23.456340 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 09:25:23.456340 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 09:25:23.456340 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 14 09:25:23.456340 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Jul 14 09:25:23.456340 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 430/839] 10.222.0.40 () {56 vars in 1132 bytes} [Thu Jul 14 09:25:23 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 09:25:23.458109 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0c42fc-74a3-47a2-b709-952d59234ff5 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:23.458109 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0c42fc-74a3-47a2-b709-952d59234ff5 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:23.458109 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0c42fc-74a3-47a2-b709-952d59234ff5 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:23.459071 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 431/840] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:25:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:25:23.464038 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6697da51-7c6d-4388-93dd-8dbfe6c69050 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:23.464366 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6697da51-7c6d-4388-93dd-8dbfe6c69050 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:23.464634 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6697da51-7c6d-4388-93dd-8dbfe6c69050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:23.482391 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-6697da51-7c6d-4388-93dd-8dbfe6c69050 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:25:23.483581 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-6697da51-7c6d-4388-93dd-8dbfe6c69050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:23.517870 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dd1e31-e142-430d-a5e4-430f2f892bef None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:23.554496 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9863e982-f485-430f-a333-c2e4f8e9e7a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:23.555309 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9863e982-f485-430f-a333-c2e4f8e9e7a4 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:23.555594 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9863e982-f485-430f-a333-c2e4f8e9e7a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:23.555869 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9863e982-f485-430f-a333-c2e4f8e9e7a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:23.567585 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9863e982-f485-430f-a333-c2e4f8e9e7a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:23.569639 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9863e982-f485-430f-a333-c2e4f8e9e7a4 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:23.578443 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 432/841] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:25:23 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 09:25:23.578443 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6697da51-7c6d-4388-93dd-8dbfe6c69050 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:23.592641 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-9863e982-f485-430f-a333-c2e4f8e9e7a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:25:23.592641 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:25:23.592641 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:25:23.592641 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:25:23.592641 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:25:23.592641 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:25:23.592641 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:25:23.592641 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:25:23.592641 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:25:23.592641 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:25:23.592641 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:25:23.592641 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:25:23.592641 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 09:25:23.592641 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 09:25:23.592641 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 09:25:23.593593 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 09:25:23.593593 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:25:23.593593 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:25:23.593593 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:25:23.593593 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:25:23.593593 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:25:23.593593 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:25:23.593593 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:25:23.593593 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( Jul 14 09:25:23.593593 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:25:23.593593 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:25:23.593593 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:25:23.593593 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:25:23.593593 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:25:23.593593 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:25:23.593593 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:25:23.593593 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:25:23.594520 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 09:25:23.594520 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 09:25:23.594520 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:25:23.594520 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:25:23.594520 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 410/842] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 09:25:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 09:25:23.599429 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9863e982-f485-430f-a333-c2e4f8e9e7a4 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:23.698456 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6697da51-7c6d-4388-93dd-8dbfe6c69050 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:23.720881 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9863e982-f485-430f-a333-c2e4f8e9e7a4 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:23.727540 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:23.729314 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:23.745473 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1727d77-9fcf-45f0-8424-0c52186c86a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:23.746593 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1727d77-9fcf-45f0-8424-0c52186c86a1 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:23.747082 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1727d77-9fcf-45f0-8424-0c52186c86a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:23.747548 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1727d77-9fcf-45f0-8424-0c52186c86a1 None admin] PATH_INFO: `/v3/services` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:23.748743 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1727d77-9fcf-45f0-8424-0c52186c86a1 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:23.749246 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1727d77-9fcf-45f0-8424-0c52186c86a1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:23.750746 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1727d77-9fcf-45f0-8424-0c52186c86a1 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:23.760333 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 433/843] 10.222.0.40 () {56 vars in 1126 bytes} [Thu Jul 14 09:25:23 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:25:23.760333 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1727d77-9fcf-45f0-8424-0c52186c86a1 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:23.765916 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0c875c-87b2-4ac5-a02b-3a064e2ed33b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:23.766750 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0c875c-87b2-4ac5-a02b-3a064e2ed33b None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:23.767030 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0c875c-87b2-4ac5-a02b-3a064e2ed33b None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:23.767303 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0c875c-87b2-4ac5-a02b-3a064e2ed33b None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:23.767970 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0c875c-87b2-4ac5-a02b-3a064e2ed33b None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:23.769341 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0c875c-87b2-4ac5-a02b-3a064e2ed33b None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:23.781838 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-0f0c875c-87b2-4ac5-a02b-3a064e2ed33b None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 14 09:25:23.781838 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:25:23.781838 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 09:25:23.781838 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 09:25:23.781838 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 09:25:23.781838 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 09:25:23.781838 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 09:25:23.781838 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 09:25:23.781838 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 14 09:25:23.781838 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:25:23.781838 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 09:25:23.781838 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:25:23.781838 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:25:23.781838 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:25:23.781838 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:25:23.781838 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:25:23.781838 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:25:23.783024 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:25:23.783024 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:25:23.783024 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:25:23.783024 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:25:23.783024 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:25:23.783024 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:25:23.783024 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 09:25:23.783024 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 09:25:23.783024 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 09:25:23.783024 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 09:25:23.783024 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:25:23.783024 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:25:23.783024 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:25:23.783024 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:25:23.783024 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:25:23.783024 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:25:23.784009 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:25:23.784009 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( Jul 14 09:25:23.784009 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:25:23.784009 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:25:23.784009 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:25:23.784009 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:25:23.784009 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:25:23.784009 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:25:23.784009 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:25:23.784009 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:25:23.784009 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 09:25:23.784009 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 09:25:23.784009 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 14 09:25:23.784009 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:25:23.784009 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 411/844] 10.222.0.40 () {56 vars in 1114 bytes} [Thu Jul 14 09:25:23 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:25:23.784963 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb2dc20-bed2-49c2-8a8f-4a2f5e392055 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:23.784963 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb2dc20-bed2-49c2-8a8f-4a2f5e392055 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:23.784963 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb2dc20-bed2-49c2-8a8f-4a2f5e392055 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:23.786959 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 412/845] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:25:23 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:25:23.787452 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb2dc20-bed2-49c2-8a8f-4a2f5e392055 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:23.872601 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1727d77-9fcf-45f0-8424-0c52186c86a1 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:23.904876 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb2dc20-bed2-49c2-8a8f-4a2f5e392055 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:23.907614 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88800716-54d0-4b1b-95af-70559e83b84e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:23.908522 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88800716-54d0-4b1b-95af-70559e83b84e None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:23.908974 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88800716-54d0-4b1b-95af-70559e83b84e None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:23.909416 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88800716-54d0-4b1b-95af-70559e83b84e None admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:23.910679 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88800716-54d0-4b1b-95af-70559e83b84e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:23.911176 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88800716-54d0-4b1b-95af-70559e83b84e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:23.914600 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88800716-54d0-4b1b-95af-70559e83b84e None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:23.928649 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 434/846] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 14 09:25:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:25:23.929514 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88800716-54d0-4b1b-95af-70559e83b84e None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:23.946928 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d22dc3c-aa39-48cf-a41d-a9772d4a28d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:23.947582 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d22dc3c-aa39-48cf-a41d-a9772d4a28d9 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:23.947864 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d22dc3c-aa39-48cf-a41d-a9772d4a28d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:23.948144 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d22dc3c-aa39-48cf-a41d-a9772d4a28d9 None admin] PATH_INFO: `/v3/services` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:23.948923 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d22dc3c-aa39-48cf-a41d-a9772d4a28d9 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:23.949168 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d22dc3c-aa39-48cf-a41d-a9772d4a28d9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:23.950601 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d22dc3c-aa39-48cf-a41d-a9772d4a28d9 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:23.955437 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 413/847] 10.222.0.40 () {56 vars in 1126 bytes} [Thu Jul 14 09:25:23 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:25:23.956605 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2ded52-7064-4b48-8fb2-3d977f3c29ad None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:23.956892 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2ded52-7064-4b48-8fb2-3d977f3c29ad None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:23.957180 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2ded52-7064-4b48-8fb2-3d977f3c29ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:23.984491 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-1c2ded52-7064-4b48-8fb2-3d977f3c29ad None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:25:23.985737 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-1c2ded52-7064-4b48-8fb2-3d977f3c29ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:24.005928 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:24.026299 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:24.074250 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 414/848] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:25:23 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 09:25:24.078654 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2ded52-7064-4b48-8fb2-3d977f3c29ad None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:24.102117 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88800716-54d0-4b1b-95af-70559e83b84e None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:24.156638 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa4a91d-8315-4499-a86f-2de267721c9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:24.157317 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa4a91d-8315-4499-a86f-2de267721c9b None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:24.157659 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa4a91d-8315-4499-a86f-2de267721c9b None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:24.157943 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa4a91d-8315-4499-a86f-2de267721c9b None admin] PATH_INFO: `/v3/services` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:24.158644 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa4a91d-8315-4499-a86f-2de267721c9b None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:24.158956 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa4a91d-8315-4499-a86f-2de267721c9b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:24.160585 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa4a91d-8315-4499-a86f-2de267721c9b None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:24.166432 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 435/849] 10.222.0.40 () {56 vars in 1114 bytes} [Thu Jul 14 09:25:23 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:25:24.167175 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa4a91d-8315-4499-a86f-2de267721c9b None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:24.212186 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2ded52-7064-4b48-8fb2-3d977f3c29ad None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:24.264132 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1433f46-7a6f-4e37-a9e4-c17d88acc64e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:24.264966 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1433f46-7a6f-4e37-a9e4-c17d88acc64e None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:24.265226 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1433f46-7a6f-4e37-a9e4-c17d88acc64e None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:24.265506 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1433f46-7a6f-4e37-a9e4-c17d88acc64e None admin] PATH_INFO: `/v3/users/swift` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:24.274290 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1433f46-7a6f-4e37-a9e4-c17d88acc64e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:24.275769 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1433f46-7a6f-4e37-a9e4-c17d88acc64e None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:24.291819 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-e1433f46-7a6f-4e37-a9e4-c17d88acc64e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 14 09:25:24.291819 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:25:24.291819 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:25:24.291819 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:25:24.291819 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:25:24.291819 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:25:24.291819 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:25:24.291819 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:25:24.291819 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:25:24.291819 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:25:24.291819 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:25:24.291819 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:25:24.291819 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 09:25:24.291819 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 09:25:24.291819 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 09:25:24.291819 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 09:25:24.292814 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:25:24.292814 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:25:24.292814 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 09:25:24.292814 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 09:25:24.292814 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 09:25:24.292814 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 09:25:24.292814 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:25:24.292814 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:25:24.292814 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:25:24.292814 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:25:24.292814 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:25:24.292814 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( Jul 14 09:25:24.292814 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:25:24.292814 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:25:24.292814 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:25:24.292814 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:25:24.292814 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:25:24.292814 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:25:24.293724 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:25:24.293724 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:25:24.293724 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 09:25:24.293724 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 09:25:24.293724 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 09:25:24.293724 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 09:25:24.293724 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 09:25:24.293724 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 09:25:24.293724 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 14 09:25:24.293724 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:25:24.293724 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 415/850] 10.222.0.40 () {56 vars in 1096 bytes} [Thu Jul 14 09:25:24 2022] GET /identity/v3/users/swift => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:25:24.294320 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1433f46-7a6f-4e37-a9e4-c17d88acc64e None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:24.301477 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa4a91d-8315-4499-a86f-2de267721c9b None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:24.326974 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:24.333095 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:24.352241 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4d6e76-d20b-4883-8ee2-5218334bffa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:24.353161 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4d6e76-d20b-4883-8ee2-5218334bffa4 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:24.353450 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4d6e76-d20b-4883-8ee2-5218334bffa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:24.353725 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4d6e76-d20b-4883-8ee2-5218334bffa4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:24.364834 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4d6e76-d20b-4883-8ee2-5218334bffa4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:25:24.373219 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-5f4d6e76-d20b-4883-8ee2-5218334bffa4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 09:25:24.373219 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:25:24.373219 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:25:24.373219 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:25:24.373219 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:25:24.373219 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:25:24.373219 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:25:24.373219 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:25:24.373219 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:25:24.373219 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:25:24.373219 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:25:24.373219 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:25:24.373219 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:25:24.373219 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:25:24.373219 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:25:24.373219 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:25:24.374413 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:25:24.374413 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:25:24.374413 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:25:24.374413 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:25:24.374413 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:25:24.374413 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:25:24.374413 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:25:24.374413 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:25:24.374413 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:25:24.374413 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:25:24.374413 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:25:24.374413 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( Jul 14 09:25:24.374413 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:25:24.374413 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:25:24.374413 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:25:24.374413 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:25:24.375265 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:25:24.375265 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:25:24.375265 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:25:24.375265 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:25:24.375265 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:25:24.375265 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:25:24.375265 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:25:24.375265 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:25:24.375265 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:25:24.375265 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:25:24.375265 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 09:25:24.375265 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Jul 14 09:25:24.375265 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 436/851] 10.222.0.40 () {56 vars in 1102 bytes} [Thu Jul 14 09:25:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:25:24.375265 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4d6e76-d20b-4883-8ee2-5218334bffa4 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:24.439818 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1433f46-7a6f-4e37-a9e4-c17d88acc64e None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:24.479271 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7521a3e-fc75-4546-8fdd-4bd7df9e4ca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:24.479874 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7521a3e-fc75-4546-8fdd-4bd7df9e4ca9 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:24.480159 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7521a3e-fc75-4546-8fdd-4bd7df9e4ca9 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:24.480437 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7521a3e-fc75-4546-8fdd-4bd7df9e4ca9 None admin] PATH_INFO: `/v3/services` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:24.481160 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7521a3e-fc75-4546-8fdd-4bd7df9e4ca9 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:24.481472 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7521a3e-fc75-4546-8fdd-4bd7df9e4ca9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:24.482885 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7521a3e-fc75-4546-8fdd-4bd7df9e4ca9 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:24.494513 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 416/852] 10.222.0.40 () {56 vars in 1114 bytes} [Thu Jul 14 09:25:24 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:25:24.495565 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4d6e76-d20b-4883-8ee2-5218334bffa4 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:24.496535 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7521a3e-fc75-4546-8fdd-4bd7df9e4ca9 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:24.550781 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7deb01a-994f-42c7-b545-2627c1bdd438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:24.551491 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7deb01a-994f-42c7-b545-2627c1bdd438 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:24.551779 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7deb01a-994f-42c7-b545-2627c1bdd438 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:24.552149 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7deb01a-994f-42c7-b545-2627c1bdd438 None admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:24.557313 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7deb01a-994f-42c7-b545-2627c1bdd438 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:24.557313 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7deb01a-994f-42c7-b545-2627c1bdd438 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:24.561164 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7deb01a-994f-42c7-b545-2627c1bdd438 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:24.585801 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 437/853] 10.222.0.40 () {56 vars in 1135 bytes} [Thu Jul 14 09:25:24 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:25:24.591310 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7deb01a-994f-42c7-b545-2627c1bdd438 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:24.628543 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:24.644325 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:24.661081 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7521a3e-fc75-4546-8fdd-4bd7df9e4ca9 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:24.709849 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a144f774-7448-4426-9452-31b711407615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:24.711038 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a144f774-7448-4426-9452-31b711407615 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:24.711524 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a144f774-7448-4426-9452-31b711407615 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:24.712024 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a144f774-7448-4426-9452-31b711407615 None admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:24.713040 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a144f774-7448-4426-9452-31b711407615 None admin] RBAC: Adding query filter params (name=service) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:24.713552 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a144f774-7448-4426-9452-31b711407615 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:24.715572 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a144f774-7448-4426-9452-31b711407615 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:24.729947 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 417/854] 10.222.0.40 () {56 vars in 1103 bytes} [Thu Jul 14 09:25:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:25:24.731558 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a144f774-7448-4426-9452-31b711407615 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:24.736524 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7deb01a-994f-42c7-b545-2627c1bdd438 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:24.781381 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affebb55-ac81-428d-a804-7a8b2ffe01bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:24.782013 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affebb55-ac81-428d-a804-7a8b2ffe01bd None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:24.782426 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affebb55-ac81-428d-a804-7a8b2ffe01bd None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:24.782713 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affebb55-ac81-428d-a804-7a8b2ffe01bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:24.846454 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a144f774-7448-4426-9452-31b711407615 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:24.869612 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affebb55-ac81-428d-a804-7a8b2ffe01bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:24.871126 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affebb55-ac81-428d-a804-7a8b2ffe01bd None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:24.885645 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6731c75c-d131-4745-b7c1-85bc891d8839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:24.886885 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6731c75c-d131-4745-b7c1-85bc891d8839 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:24.887384 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6731c75c-d131-4745-b7c1-85bc891d8839 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:24.888020 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6731c75c-d131-4745-b7c1-85bc891d8839 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:24.900487 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6731c75c-d131-4745-b7c1-85bc891d8839 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:24.902398 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6731c75c-d131-4745-b7c1-85bc891d8839 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:24.906000 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:24.923816 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-6731c75c-d131-4745-b7c1-85bc891d8839 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:25:24.923816 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:25:24.923816 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:25:24.923816 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:25:24.923816 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:25:24.923816 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:25:24.923816 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:25:24.923816 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:25:24.923816 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:25:24.923816 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:25:24.923816 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:25:24.923816 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:25:24.923816 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 09:25:24.923816 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 09:25:24.923816 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 09:25:24.925114 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 09:25:24.925114 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:25:24.925114 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:25:24.925114 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:25:24.925114 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:25:24.925114 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:25:24.925114 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:25:24.925114 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:25:24.925114 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( Jul 14 09:25:24.925114 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:25:24.925114 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:25:24.925114 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:25:24.925114 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:25:24.925114 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:25:24.925114 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:25:24.925114 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:25:24.925114 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:25:24.926008 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 09:25:24.926008 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 09:25:24.926008 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:25:24.926008 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:25:24.933243 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 418/855] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 09:25:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 09:25:24.934999 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6731c75c-d131-4745-b7c1-85bc891d8839 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:24.938446 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:24.995784 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 438/856] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 14 09:25:24 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 09:25:24.996666 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affebb55-ac81-428d-a804-7a8b2ffe01bd None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:25.051226 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6731c75c-d131-4745-b7c1-85bc891d8839 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:25.107045 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220e96cd-e730-43a6-a75c-f9bf0a026cb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:25.108195 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220e96cd-e730-43a6-a75c-f9bf0a026cb7 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:25.108700 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220e96cd-e730-43a6-a75c-f9bf0a026cb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:25.109196 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220e96cd-e730-43a6-a75c-f9bf0a026cb7 None admin] PATH_INFO: `/v3/domains` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:25.110626 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220e96cd-e730-43a6-a75c-f9bf0a026cb7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:25.111185 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220e96cd-e730-43a6-a75c-f9bf0a026cb7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:25.113826 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220e96cd-e730-43a6-a75c-f9bf0a026cb7 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:25.137903 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 419/857] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 14 09:25:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:25:25.144260 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220e96cd-e730-43a6-a75c-f9bf0a026cb7 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:25.144622 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affebb55-ac81-428d-a804-7a8b2ffe01bd None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:25.179718 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:25.187641 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af89a519-3172-440d-94df-af9df8bf09c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:25.188817 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af89a519-3172-440d-94df-af9df8bf09c4 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:25.189355 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af89a519-3172-440d-94df-af9df8bf09c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:25.189844 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af89a519-3172-440d-94df-af9df8bf09c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:25.201861 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af89a519-3172-440d-94df-af9df8bf09c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:25.203781 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af89a519-3172-440d-94df-af9df8bf09c4 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:25.223207 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-af89a519-3172-440d-94df-af9df8bf09c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:25:25.223207 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:25:25.223207 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:25:25.223207 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:25:25.223207 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:25:25.223207 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:25:25.223207 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:25:25.223207 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:25:25.223207 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:25:25.223207 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:25:25.223207 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:25:25.223207 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:25:25.223207 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 09:25:25.223207 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 09:25:25.223207 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 09:25:25.224767 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 09:25:25.224767 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:25:25.224767 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:25:25.224767 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:25:25.224767 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:25:25.224767 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:25:25.224767 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:25:25.224767 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:25:25.224767 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( Jul 14 09:25:25.224767 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:25:25.224767 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:25:25.224767 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:25:25.224767 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:25:25.224767 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:25:25.224767 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:25:25.224767 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:25:25.224767 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:25:25.225717 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 09:25:25.225717 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 09:25:25.225717 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:25:25.225717 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Jul 14 09:25:25.228033 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 439/858] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 09:25:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 09:25:25.233386 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af89a519-3172-440d-94df-af9df8bf09c4 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:25.245316 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:25.304078 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220e96cd-e730-43a6-a75c-f9bf0a026cb7 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:25.342793 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f0485f-6548-462e-8e7f-f5d250adcbd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:25.343987 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f0485f-6548-462e-8e7f-f5d250adcbd3 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:25.344477 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f0485f-6548-462e-8e7f-f5d250adcbd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:25.344984 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f0485f-6548-462e-8e7f-f5d250adcbd3 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:25.354294 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f0485f-6548-462e-8e7f-f5d250adcbd3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:25.356256 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f0485f-6548-462e-8e7f-f5d250adcbd3 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:25.367837 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af89a519-3172-440d-94df-af9df8bf09c4 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:25.374040 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-c7f0485f-6548-462e-8e7f-f5d250adcbd3 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 14 09:25:25.374040 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:25:25.374040 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:25:25.374040 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:25:25.374040 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:25:25.374040 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:25:25.374040 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:25:25.374040 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:25:25.374040 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:25:25.374040 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:25:25.374040 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:25:25.374040 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:25:25.374040 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 09:25:25.374040 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 09:25:25.374040 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 09:25:25.374040 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 09:25:25.375052 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:25:25.375052 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:25:25.375052 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 09:25:25.375052 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 09:25:25.375052 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 09:25:25.375052 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 09:25:25.375052 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:25:25.375052 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:25:25.375052 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:25:25.375052 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:25:25.375052 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:25:25.375052 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( Jul 14 09:25:25.375052 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:25:25.375052 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:25:25.375052 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:25:25.375052 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:25:25.375052 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:25:25.375052 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:25:25.376011 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:25:25.376011 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:25:25.376011 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 09:25:25.376011 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 09:25:25.376011 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 09:25:25.376011 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 09:25:25.376011 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 09:25:25.376011 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 09:25:25.376011 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 14 09:25:25.376011 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:25:25.383445 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 420/859] 10.222.0.40 () {56 vars in 1117 bytes} [Thu Jul 14 09:25:25 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:25:25.384706 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f0485f-6548-462e-8e7f-f5d250adcbd3 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:25.412893 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3075af1-eeed-4e63-bd22-0986d481b676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:25.413633 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3075af1-eeed-4e63-bd22-0986d481b676 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:25.414004 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3075af1-eeed-4e63-bd22-0986d481b676 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:25.414906 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3075af1-eeed-4e63-bd22-0986d481b676 None admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:25.416059 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3075af1-eeed-4e63-bd22-0986d481b676 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:25.416451 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3075af1-eeed-4e63-bd22-0986d481b676 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:25.418392 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3075af1-eeed-4e63-bd22-0986d481b676 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:25.438241 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 440/860] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 14 09:25:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:25:25.443804 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3075af1-eeed-4e63-bd22-0986d481b676 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:25.509279 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f0485f-6548-462e-8e7f-f5d250adcbd3 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:25.509894 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:25.551288 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:25.577901 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea60fb4-84e9-4b02-892f-46c821c4d54a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:25.579074 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea60fb4-84e9-4b02-892f-46c821c4d54a None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:25.579554 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea60fb4-84e9-4b02-892f-46c821c4d54a None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:25.580019 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea60fb4-84e9-4b02-892f-46c821c4d54a None admin] PATH_INFO: `/v3/users` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:25.581083 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea60fb4-84e9-4b02-892f-46c821c4d54a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:25.581632 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea60fb4-84e9-4b02-892f-46c821c4d54a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:25.583939 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea60fb4-84e9-4b02-892f-46c821c4d54a None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:25.592502 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3075af1-eeed-4e63-bd22-0986d481b676 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:25.618352 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 421/861] 10.222.0.40 () {56 vars in 1149 bytes} [Thu Jul 14 09:25:25 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:25:25.621351 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea60fb4-84e9-4b02-892f-46c821c4d54a None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:25.651051 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2a2036-4299-47e3-84a3-a39958255d47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:25.651876 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2a2036-4299-47e3-84a3-a39958255d47 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:25.652170 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2a2036-4299-47e3-84a3-a39958255d47 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:25.652438 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2a2036-4299-47e3-84a3-a39958255d47 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:25.660205 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2a2036-4299-47e3-84a3-a39958255d47 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:25.662268 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2a2036-4299-47e3-84a3-a39958255d47 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:25.677340 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-ba2a2036-4299-47e3-84a3-a39958255d47 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 09:25:25.677340 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:25:25.677340 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:25:25.677340 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:25:25.677340 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:25:25.677340 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:25:25.677340 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:25:25.677340 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:25:25.677340 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:25:25.677340 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:25:25.677340 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:25:25.677340 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:25:25.677340 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 09:25:25.677340 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 09:25:25.677340 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 09:25:25.679713 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 09:25:25.679713 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:25:25.679713 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:25:25.679713 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:25:25.679713 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:25:25.679713 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:25:25.679713 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:25:25.679713 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:25:25.679713 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( Jul 14 09:25:25.679713 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:25:25.679713 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:25:25.679713 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:25:25.679713 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:25:25.679713 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:25:25.679713 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:25:25.679713 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:25:25.679713 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:25:25.681539 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 09:25:25.681539 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 09:25:25.681539 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 09:25:25.681539 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 09:25:25.681539 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 09:25:25.681539 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 09:25:25.681539 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 09:25:25.681539 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Jul 14 09:25:25.681539 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 441/862] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jul 14 09:25:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 09:25:25.684545 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2a2036-4299-47e3-84a3-a39958255d47 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:25.798457 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2a2036-4299-47e3-84a3-a39958255d47 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:25.800022 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:25.806093 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea60fb4-84e9-4b02-892f-46c821c4d54a None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:25.841114 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59758a2-2a1e-448c-8974-bcfa59283edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:25.841753 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59758a2-2a1e-448c-8974-bcfa59283edb None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:25.842101 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59758a2-2a1e-448c-8974-bcfa59283edb None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:25.842415 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59758a2-2a1e-448c-8974-bcfa59283edb None admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:25.843445 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59758a2-2a1e-448c-8974-bcfa59283edb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:25.843771 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59758a2-2a1e-448c-8974-bcfa59283edb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:25.845363 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59758a2-2a1e-448c-8974-bcfa59283edb None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:25.866496 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 442/863] 10.222.0.40 () {56 vars in 1148 bytes} [Thu Jul 14 09:25:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:25:25.867807 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59758a2-2a1e-448c-8974-bcfa59283edb None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:25.978421 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a599af-6e04-4317-8f13-75ee3e66eb2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:25.979963 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a599af-6e04-4317-8f13-75ee3e66eb2f None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:25.980549 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a599af-6e04-4317-8f13-75ee3e66eb2f None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:25.981082 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a599af-6e04-4317-8f13-75ee3e66eb2f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:25.983429 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59758a2-2a1e-448c-8974-bcfa59283edb None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:26.019444 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccf9c63-806f-47df-b23c-09d78fadc8bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:26.020303 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccf9c63-806f-47df-b23c-09d78fadc8bc None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:26.021225 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccf9c63-806f-47df-b23c-09d78fadc8bc None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:26.021538 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccf9c63-806f-47df-b23c-09d78fadc8bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:26.022447 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccf9c63-806f-47df-b23c-09d78fadc8bc None admin] RBAC: Adding query filter params (role.id=e3965bd0d5f1427a86a313c0c90bfef3, scope.project.id=a478e76f04dd413f89ddfba7b0cdc9cc, user.id=302c0f7dd3bf4829aad0b29bd0c091a5) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:26.022767 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccf9c63-806f-47df-b23c-09d78fadc8bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:26.024207 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccf9c63-806f-47df-b23c-09d78fadc8bc None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:26.038758 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 443/864] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jul 14 09:25:25 2022] GET /identity/v3/role_assignments?user.id=302c0f7dd3bf4829aad0b29bd0c091a5&scope.project.id=a478e76f04dd413f89ddfba7b0cdc9cc&role.id=e3965bd0d5f1427a86a313c0c90bfef3 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:25:26.044499 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:26.070499 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a599af-6e04-4317-8f13-75ee3e66eb2f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:26.072428 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a599af-6e04-4317-8f13-75ee3e66eb2f None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:26.162768 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7524d588-9613-4b53-8b85-8ca9543fae66 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:26.163148 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7524d588-9613-4b53-8b85-8ca9543fae66 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:26.163434 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7524d588-9613-4b53-8b85-8ca9543fae66 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:26.165299 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 444/865] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:25:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:25:26.171104 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4933f0c-39d3-47d2-afa1-0ade47c69c4c None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:26.171441 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4933f0c-39d3-47d2-afa1-0ade47c69c4c None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:26.171673 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4933f0c-39d3-47d2-afa1-0ade47c69c4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:26.189992 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-b4933f0c-39d3-47d2-afa1-0ade47c69c4c None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:25:26.191263 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-b4933f0c-39d3-47d2-afa1-0ade47c69c4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:26.198526 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 422/866] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 14 09:25:25 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 578 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 14 09:25:26.204357 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a599af-6e04-4317-8f13-75ee3e66eb2f None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:26.217600 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:26.284349 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 445/867] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:25:26 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 09:25:26.309564 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4933f0c-39d3-47d2-afa1-0ade47c69c4c None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:26.316523 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:26.349396 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a599af-6e04-4317-8f13-75ee3e66eb2f None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:26.414655 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b3860a-79df-4559-a170-da50e99e9399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:26.415713 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b3860a-79df-4559-a170-da50e99e9399 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:26.416193 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b3860a-79df-4559-a170-da50e99e9399 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:26.416477 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b3860a-79df-4559-a170-da50e99e9399 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:26.432748 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b3860a-79df-4559-a170-da50e99e9399 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:26.434254 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b3860a-79df-4559-a170-da50e99e9399 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:26.435327 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4933f0c-39d3-47d2-afa1-0ade47c69c4c None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:26.458388 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-b6b3860a-79df-4559-a170-da50e99e9399 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:25:26.458388 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:25:26.458388 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:25:26.458388 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:25:26.458388 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:25:26.458388 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:25:26.458388 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:25:26.458388 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:25:26.458388 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:25:26.458388 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:25:26.458388 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:25:26.458388 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:25:26.458388 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 09:25:26.458388 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 09:25:26.458388 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 09:25:26.459386 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 09:25:26.459386 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:25:26.459386 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:25:26.459386 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:25:26.459386 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:25:26.459386 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:25:26.459386 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:25:26.459386 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:25:26.459386 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( Jul 14 09:25:26.459386 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:25:26.459386 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:25:26.459386 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:25:26.459386 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:25:26.459386 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:25:26.459386 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:25:26.459386 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:25:26.459386 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:25:26.460306 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 09:25:26.460306 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 09:25:26.460306 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:25:26.460306 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:25:26.460536 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 423/868] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 09:25:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:25:26.466421 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b3860a-79df-4559-a170-da50e99e9399 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:26.492821 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507c0f3e-d9d3-4625-805b-302298286e08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:26.493998 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507c0f3e-d9d3-4625-805b-302298286e08 None admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:26.495124 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507c0f3e-d9d3-4625-805b-302298286e08 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:26.495646 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507c0f3e-d9d3-4625-805b-302298286e08 None admin] PATH_INFO: `/v3/services` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:26.496896 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507c0f3e-d9d3-4625-805b-302298286e08 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:26.499492 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507c0f3e-d9d3-4625-805b-302298286e08 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:26.530509 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 446/869] 10.222.0.40 () {60 vars in 1141 bytes} [Thu Jul 14 09:25:26 2022] POST /identity/v3/services => generated 269 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:25:26.615478 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b3860a-79df-4559-a170-da50e99e9399 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:26.655017 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:26.667301 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2b1443-0c17-4b48-91c0-116350411806 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:26.667554 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2b1443-0c17-4b48-91c0-116350411806 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:26.667941 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2b1443-0c17-4b48-91c0-116350411806 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:26.669565 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 447/870] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:25:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:25:26.672587 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402e2815-0fd3-472a-97ec-aec333608a02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:26.673396 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402e2815-0fd3-472a-97ec-aec333608a02 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:26.673591 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402e2815-0fd3-472a-97ec-aec333608a02 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:26.673843 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402e2815-0fd3-472a-97ec-aec333608a02 None admin] PATH_INFO: `/v3/domains` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:26.674674 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402e2815-0fd3-472a-97ec-aec333608a02 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:26.674989 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402e2815-0fd3-472a-97ec-aec333608a02 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:26.675955 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b4f413-eb5d-46af-abb3-c7e6c6323536 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:26.676473 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402e2815-0fd3-472a-97ec-aec333608a02 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:26.676595 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b4f413-eb5d-46af-abb3-c7e6c6323536 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:26.677637 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b4f413-eb5d-46af-abb3-c7e6c6323536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:26.701181 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 424/871] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 14 09:25:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:25:26.703267 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402e2815-0fd3-472a-97ec-aec333608a02 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:26.707134 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-a0b4f413-eb5d-46af-abb3-c7e6c6323536 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:25:26.709111 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-a0b4f413-eb5d-46af-abb3-c7e6c6323536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:26.723344 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:26.795347 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 448/872] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:25:26 2022] POST /identity/v3/auth/tokens => generated 1261 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 09:25:26.818902 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b4f413-eb5d-46af-abb3-c7e6c6323536 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:26.842980 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402e2815-0fd3-472a-97ec-aec333608a02 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:26.891410 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224810a8-dbba-467b-9ec8-31289d13a56e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:26.892349 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224810a8-dbba-467b-9ec8-31289d13a56e None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:26.892695 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224810a8-dbba-467b-9ec8-31289d13a56e None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:26.893171 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224810a8-dbba-467b-9ec8-31289d13a56e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:26.902463 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224810a8-dbba-467b-9ec8-31289d13a56e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:26.904648 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224810a8-dbba-467b-9ec8-31289d13a56e None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:26.928150 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-224810a8-dbba-467b-9ec8-31289d13a56e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 09:25:26.928150 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:25:26.928150 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:25:26.928150 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:25:26.928150 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:25:26.928150 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:25:26.928150 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:25:26.928150 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:25:26.928150 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:25:26.928150 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:25:26.928150 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:25:26.928150 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:25:26.928150 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 09:25:26.928150 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 09:25:26.928150 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 09:25:26.929089 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 09:25:26.929089 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:25:26.929089 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:25:26.929089 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:25:26.929089 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:25:26.929089 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:25:26.929089 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:25:26.929089 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:25:26.929089 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( Jul 14 09:25:26.929089 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:25:26.929089 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:25:26.929089 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:25:26.929089 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:25:26.929089 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:25:26.929089 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:25:26.929089 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:25:26.929089 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:25:26.929980 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 09:25:26.929980 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 09:25:26.929980 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 09:25:26.929980 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 09:25:26.929980 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 09:25:26.929980 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 09:25:26.929980 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 09:25:26.929980 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:25:26.937424 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 425/873] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jul 14 09:25:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:25:26.938216 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224810a8-dbba-467b-9ec8-31289d13a56e None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:26.971365 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b4f413-eb5d-46af-abb3-c7e6c6323536 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:27.012029 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:27.034152 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996e75dc-0e4c-468e-922f-11c3f5541cad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:27.035613 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996e75dc-0e4c-468e-922f-11c3f5541cad None admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:27.036180 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996e75dc-0e4c-468e-922f-11c3f5541cad None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:27.037448 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996e75dc-0e4c-468e-922f-11c3f5541cad None admin] PATH_INFO: `/v3/services` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:27.039088 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996e75dc-0e4c-468e-922f-11c3f5541cad None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:27.042161 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996e75dc-0e4c-468e-922f-11c3f5541cad None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:27.074284 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 449/874] 10.222.0.40 () {60 vars in 1141 bytes} [Thu Jul 14 09:25:26 2022] POST /identity/v3/services => generated 251 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:25:27.083164 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224810a8-dbba-467b-9ec8-31289d13a56e None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:27.129605 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189316aa-d550-431d-8ff8-fc1a28eacc1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:27.130892 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189316aa-d550-431d-8ff8-fc1a28eacc1a None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:27.131181 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189316aa-d550-431d-8ff8-fc1a28eacc1a None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:27.131460 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189316aa-d550-431d-8ff8-fc1a28eacc1a None admin] PATH_INFO: `/v3/projects` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:27.132283 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189316aa-d550-431d-8ff8-fc1a28eacc1a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:27.132596 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189316aa-d550-431d-8ff8-fc1a28eacc1a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:27.134092 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189316aa-d550-431d-8ff8-fc1a28eacc1a None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:27.148383 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 426/875] 10.222.0.40 () {56 vars in 1148 bytes} [Thu Jul 14 09:25:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:25:27.154542 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996e75dc-0e4c-468e-922f-11c3f5541cad None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:27.167778 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:27.290685 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996e75dc-0e4c-468e-922f-11c3f5541cad None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:27.329794 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d220228c-5ced-43d4-b5c6-adeeb6911770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:27.330554 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d220228c-5ced-43d4-b5c6-adeeb6911770 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:27.330842 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d220228c-5ced-43d4-b5c6-adeeb6911770 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:27.331125 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d220228c-5ced-43d4-b5c6-adeeb6911770 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:27.331983 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d220228c-5ced-43d4-b5c6-adeeb6911770 None admin] RBAC: Adding query filter params (role.id=c12236aebd8048ba991da4671b44935f, scope.project.id=a478e76f04dd413f89ddfba7b0cdc9cc, user.id=6cf35868f9ff46e2835a6cc023641da6) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:27.332303 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d220228c-5ced-43d4-b5c6-adeeb6911770 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:27.333789 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d220228c-5ced-43d4-b5c6-adeeb6911770 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:27.341685 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 450/876] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jul 14 09:25:27 2022] GET /identity/v3/role_assignments?user.id=6cf35868f9ff46e2835a6cc023641da6&scope.project.id=a478e76f04dd413f89ddfba7b0cdc9cc&role.id=c12236aebd8048ba991da4671b44935f => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:25:28.461096 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b4267a-788b-4d82-9747-bc61dee7e6c9 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:28.462130 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b4267a-788b-4d82-9747-bc61dee7e6c9 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:28.462683 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b4267a-788b-4d82-9747-bc61dee7e6c9 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:28.464545 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 427/877] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:25:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:25:28.471260 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf528e1-dc0d-41f2-8523-1ba467bcd905 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:28.472643 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf528e1-dc0d-41f2-8523-1ba467bcd905 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:28.473421 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf528e1-dc0d-41f2-8523-1ba467bcd905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:28.496979 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-caf528e1-dc0d-41f2-8523-1ba467bcd905 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:25:28.498661 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-caf528e1-dc0d-41f2-8523-1ba467bcd905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:28.585816 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:28.591333 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 451/878] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:25:28 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 09:25:28.614808 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b4267a-788b-4d82-9747-bc61dee7e6c9 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:28.712498 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ebf4eb-c22f-4e2e-8e28-294e4569d1f7 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:28.712689 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ebf4eb-c22f-4e2e-8e28-294e4569d1f7 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:28.713067 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ebf4eb-c22f-4e2e-8e28-294e4569d1f7 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:28.714961 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 452/879] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:25:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 09:25:28.720910 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d800f81-8b85-434e-a8bc-383e61e104fa None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:28.721219 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d800f81-8b85-434e-a8bc-383e61e104fa None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:28.721470 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d800f81-8b85-434e-a8bc-383e61e104fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:28.740204 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b4267a-788b-4d82-9747-bc61dee7e6c9 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:28.740437 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-6d800f81-8b85-434e-a8bc-383e61e104fa None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:25:28.741845 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-6d800f81-8b85-434e-a8bc-383e61e104fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:28.745210 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:28.789559 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531257af-09f0-40bf-b239-fe76579efb2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:28.790544 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531257af-09f0-40bf-b239-fe76579efb2a None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:28.790900 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531257af-09f0-40bf-b239-fe76579efb2a None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:28.791254 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531257af-09f0-40bf-b239-fe76579efb2a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:28.792104 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531257af-09f0-40bf-b239-fe76579efb2a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:28.793867 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531257af-09f0-40bf-b239-fe76579efb2a None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:28.807838 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-531257af-09f0-40bf-b239-fe76579efb2a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 09:25:28.807838 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:25:28.807838 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 09:25:28.807838 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 09:25:28.807838 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 09:25:28.807838 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 09:25:28.807838 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 09:25:28.807838 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 09:25:28.807838 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 09:25:28.807838 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:25:28.807838 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 09:25:28.807838 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:25:28.807838 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:25:28.807838 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:25:28.807838 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:25:28.807838 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:25:28.807838 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:25:28.808932 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:25:28.808932 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:25:28.808932 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:25:28.808932 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:25:28.808932 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:25:28.808932 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:25:28.808932 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 09:25:28.808932 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 09:25:28.808932 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 09:25:28.808932 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 09:25:28.808932 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:25:28.808932 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:25:28.808932 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:25:28.808932 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:25:28.808932 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:25:28.808932 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:25:28.810512 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:25:28.810512 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( Jul 14 09:25:28.810512 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:25:28.810512 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:25:28.810512 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:25:28.810512 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:25:28.810512 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:25:28.810512 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:25:28.810512 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:25:28.810512 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:25:28.810512 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 09:25:28.810512 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 09:25:28.810512 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 09:25:28.810512 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:25:28.810512 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 428/880] 10.222.0.40 () {56 vars in 1126 bytes} [Thu Jul 14 09:25:28 2022] GET /identity/v3/services/object-store => generated 93 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:25:28.815402 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531257af-09f0-40bf-b239-fe76579efb2a None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:28.843816 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 453/881] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:25:28 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 09:25:28.875830 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d800f81-8b85-434e-a8bc-383e61e104fa None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:28.957541 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531257af-09f0-40bf-b239-fe76579efb2a None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:28.996307 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d800f81-8b85-434e-a8bc-383e61e104fa None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:29.005263 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2ce82e-9b39-4455-bb65-85848a395484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:29.006453 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2ce82e-9b39-4455-bb65-85848a395484 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:29.006760 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2ce82e-9b39-4455-bb65-85848a395484 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:29.007045 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2ce82e-9b39-4455-bb65-85848a395484 None admin] PATH_INFO: `/v3/services` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:29.007785 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2ce82e-9b39-4455-bb65-85848a395484 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:29.008106 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2ce82e-9b39-4455-bb65-85848a395484 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:29.009499 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2ce82e-9b39-4455-bb65-85848a395484 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:29.019986 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 429/882] 10.222.0.40 () {56 vars in 1122 bytes} [Thu Jul 14 09:25:28 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:25:29.021123 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2ce82e-9b39-4455-bb65-85848a395484 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:29.045948 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:29.053885 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e872dea-06f6-4347-9d5d-4c3593ccdc1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:29.055013 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e872dea-06f6-4347-9d5d-4c3593ccdc1f None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:29.055739 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e872dea-06f6-4347-9d5d-4c3593ccdc1f None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:29.056588 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e872dea-06f6-4347-9d5d-4c3593ccdc1f None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:29.057982 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e872dea-06f6-4347-9d5d-4c3593ccdc1f None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:29.060873 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e872dea-06f6-4347-9d5d-4c3593ccdc1f None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:29.069409 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:29.075468 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-7e872dea-06f6-4347-9d5d-4c3593ccdc1f None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 14 09:25:29.075468 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:25:29.075468 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 09:25:29.075468 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 09:25:29.075468 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 09:25:29.075468 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 09:25:29.075468 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 09:25:29.075468 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 09:25:29.075468 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 14 09:25:29.075468 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Jul 14 09:25:29.075468 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 09:25:29.075468 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Jul 14 09:25:29.075468 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:25:29.075468 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:25:29.075468 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:25:29.075468 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:25:29.077512 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:25:29.077512 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:25:29.077512 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:25:29.077512 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:25:29.077512 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:25:29.077512 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:25:29.077512 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:25:29.077512 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 09:25:29.077512 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 09:25:29.077512 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 09:25:29.077512 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 09:25:29.077512 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:25:29.077512 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:25:29.077512 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:25:29.077512 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:25:29.077512 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:25:29.079358 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:25:29.079358 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:25:29.079358 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( Jul 14 09:25:29.079358 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:25:29.079358 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:25:29.079358 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:25:29.079358 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:25:29.079358 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:25:29.079358 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:25:29.079358 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:25:29.079358 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:25:29.079358 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 09:25:29.079358 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 09:25:29.079358 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 14 09:25:29.079358 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Jul 14 09:25:29.084996 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 454/883] 10.222.0.40 () {56 vars in 1132 bytes} [Thu Jul 14 09:25:28 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 09:25:29.086259 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e872dea-06f6-4347-9d5d-4c3593ccdc1f None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:29.184280 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2ce82e-9b39-4455-bb65-85848a395484 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:29.229709 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e872dea-06f6-4347-9d5d-4c3593ccdc1f None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:29.235609 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e00aa9c-6f07-4b8c-a62f-2bbd05893779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:29.236550 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e00aa9c-6f07-4b8c-a62f-2bbd05893779 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:29.236980 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e00aa9c-6f07-4b8c-a62f-2bbd05893779 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:29.237416 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e00aa9c-6f07-4b8c-a62f-2bbd05893779 None admin] PATH_INFO: `/v3/services` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:29.238309 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e00aa9c-6f07-4b8c-a62f-2bbd05893779 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:29.238760 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e00aa9c-6f07-4b8c-a62f-2bbd05893779 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:29.243646 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e00aa9c-6f07-4b8c-a62f-2bbd05893779 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:29.250079 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 430/884] 10.222.0.40 () {56 vars in 1122 bytes} [Thu Jul 14 09:25:29 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:25:29.252321 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60553d3e-6ac9-4dca-b3db-722163144669 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:29.252768 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60553d3e-6ac9-4dca-b3db-722163144669 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:29.253196 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60553d3e-6ac9-4dca-b3db-722163144669 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:29.255521 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 431/885] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:25:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:25:29.264059 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8577b34b-b41d-419d-9eb2-119266be607e None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:29.264059 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8577b34b-b41d-419d-9eb2-119266be607e None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:29.264059 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8577b34b-b41d-419d-9eb2-119266be607e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:29.285179 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-8577b34b-b41d-419d-9eb2-119266be607e None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:25:29.287198 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-8577b34b-b41d-419d-9eb2-119266be607e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:29.291784 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6f0972-f5e3-4ad6-9dba-b71f68383057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:29.292615 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6f0972-f5e3-4ad6-9dba-b71f68383057 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:29.292970 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6f0972-f5e3-4ad6-9dba-b71f68383057 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:29.293334 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6f0972-f5e3-4ad6-9dba-b71f68383057 None admin] PATH_INFO: `/v3/services` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:29.294139 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6f0972-f5e3-4ad6-9dba-b71f68383057 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:29.294563 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6f0972-f5e3-4ad6-9dba-b71f68383057 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:29.296211 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6f0972-f5e3-4ad6-9dba-b71f68383057 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:29.306732 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 455/886] 10.222.0.40 () {56 vars in 1126 bytes} [Thu Jul 14 09:25:29 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:25:29.308035 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6f0972-f5e3-4ad6-9dba-b71f68383057 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:29.370380 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 432/887] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:25:29 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 09:25:29.394576 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:29.401323 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8577b34b-b41d-419d-9eb2-119266be607e None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:29.435037 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:29.450533 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6f0972-f5e3-4ad6-9dba-b71f68383057 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:29.495168 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e240cd-65ea-4b38-83bf-77ea1631a350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:29.495168 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e240cd-65ea-4b38-83bf-77ea1631a350 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:29.495168 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e240cd-65ea-4b38-83bf-77ea1631a350 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:29.495168 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e240cd-65ea-4b38-83bf-77ea1631a350 None admin] PATH_INFO: `/v3/services` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:29.500464 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e240cd-65ea-4b38-83bf-77ea1631a350 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:29.500464 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e240cd-65ea-4b38-83bf-77ea1631a350 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:29.501280 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e240cd-65ea-4b38-83bf-77ea1631a350 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:29.508099 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 456/888] 10.222.0.40 () {56 vars in 1126 bytes} [Thu Jul 14 09:25:29 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:25:29.515267 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e240cd-65ea-4b38-83bf-77ea1631a350 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:29.543386 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8577b34b-b41d-419d-9eb2-119266be607e None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:29.597016 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c06a00-e67b-47f4-a083-1d0509461d7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:29.599514 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c06a00-e67b-47f4-a083-1d0509461d7f None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:29.600195 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c06a00-e67b-47f4-a083-1d0509461d7f None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:29.600926 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c06a00-e67b-47f4-a083-1d0509461d7f None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:29.601819 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c06a00-e67b-47f4-a083-1d0509461d7f None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:29.604559 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c06a00-e67b-47f4-a083-1d0509461d7f None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:29.620379 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-a4c06a00-e67b-47f4-a083-1d0509461d7f None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 14 09:25:29.620379 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:25:29.620379 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 09:25:29.620379 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 09:25:29.620379 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 09:25:29.620379 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 09:25:29.620379 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 09:25:29.620379 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 09:25:29.620379 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 14 09:25:29.620379 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:25:29.620379 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 09:25:29.620379 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:25:29.620379 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:25:29.620379 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:25:29.620379 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:25:29.620379 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:25:29.620379 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:25:29.621434 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:25:29.621434 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:25:29.621434 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:25:29.621434 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:25:29.621434 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:25:29.621434 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:25:29.621434 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 09:25:29.621434 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 09:25:29.621434 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 09:25:29.621434 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 09:25:29.621434 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:25:29.621434 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:25:29.621434 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:25:29.621434 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:25:29.621434 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:25:29.621434 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:25:29.622286 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:25:29.622286 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( Jul 14 09:25:29.622286 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:25:29.622286 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:25:29.622286 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:25:29.622286 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:25:29.622286 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:25:29.622286 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:25:29.622286 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:25:29.622286 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:25:29.622286 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 09:25:29.622286 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 09:25:29.622286 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 14 09:25:29.622286 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:25:29.632158 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 433/889] 10.222.0.40 () {56 vars in 1114 bytes} [Thu Jul 14 09:25:29 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 09:25:29.633103 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c06a00-e67b-47f4-a083-1d0509461d7f None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:29.655043 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e240cd-65ea-4b38-83bf-77ea1631a350 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:29.678903 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:29.691505 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eaddbb-9f94-4290-8d97-653b645341b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:29.691844 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eaddbb-9f94-4290-8d97-653b645341b2 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:29.692133 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eaddbb-9f94-4290-8d97-653b645341b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:29.693085 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eaddbb-9f94-4290-8d97-653b645341b2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:29.693946 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92eaddbb-9f94-4290-8d97-653b645341b2 None admin] RBAC: Adding query filter params (interface=public, service_id=76b5e73226a7483f9ac970f183dad0ad, region_id=RegionOne) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:29.694384 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92eaddbb-9f94-4290-8d97-653b645341b2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:29.695712 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92eaddbb-9f94-4290-8d97-653b645341b2 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:29.702019 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 457/890] 10.222.0.40 () {56 vars in 1251 bytes} [Thu Jul 14 09:25:29 2022] GET /identity/v3/endpoints?service_id=76b5e73226a7483f9ac970f183dad0ad&interface=public®ion_id=RegionOne => generated 194 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:25:29.709842 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eaddbb-9f94-4290-8d97-653b645341b2 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:29.752770 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:29.764221 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c06a00-e67b-47f4-a083-1d0509461d7f None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:29.803056 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78133cf3-98b5-4467-9254-997593c3a2dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:29.805066 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78133cf3-98b5-4467-9254-997593c3a2dd None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:29.805066 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78133cf3-98b5-4467-9254-997593c3a2dd None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:29.805066 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78133cf3-98b5-4467-9254-997593c3a2dd None admin] PATH_INFO: `/v3/services` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:29.805066 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78133cf3-98b5-4467-9254-997593c3a2dd None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:29.805461 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78133cf3-98b5-4467-9254-997593c3a2dd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:29.806679 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78133cf3-98b5-4467-9254-997593c3a2dd None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:29.817829 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 434/891] 10.222.0.40 () {56 vars in 1114 bytes} [Thu Jul 14 09:25:29 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:25:29.819403 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d521c5e-9bc0-49cf-8e16-9e816207a243 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:29.819697 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d521c5e-9bc0-49cf-8e16-9e816207a243 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:29.819971 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d521c5e-9bc0-49cf-8e16-9e816207a243 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:29.825212 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 435/892] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:25:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:25:29.825212 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d521c5e-9bc0-49cf-8e16-9e816207a243 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:29.842872 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eaddbb-9f94-4290-8d97-653b645341b2 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:29.887150 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5b9352-3c3f-4963-b860-3edaca263c09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:29.887857 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5b9352-3c3f-4963-b860-3edaca263c09 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:29.888144 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5b9352-3c3f-4963-b860-3edaca263c09 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:29.888424 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5b9352-3c3f-4963-b860-3edaca263c09 None admin] PATH_INFO: `/v3/services` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:29.889125 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5b9352-3c3f-4963-b860-3edaca263c09 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:29.890546 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5b9352-3c3f-4963-b860-3edaca263c09 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:29.897800 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 458/893] 10.222.0.40 () {56 vars in 1087 bytes} [Thu Jul 14 09:25:29 2022] GET /identity/v3/services => generated 1268 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:25:29.900059 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f6fb63-7252-4470-ba69-c4eb111a650a None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:29.900785 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f6fb63-7252-4470-ba69-c4eb111a650a None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:29.901383 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f6fb63-7252-4470-ba69-c4eb111a650a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:29.919802 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-33f6fb63-7252-4470-ba69-c4eb111a650a None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:25:29.921385 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-33f6fb63-7252-4470-ba69-c4eb111a650a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:29.960906 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d521c5e-9bc0-49cf-8e16-9e816207a243 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:29.976719 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:30.001896 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 459/894] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:25:29 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 09:25:30.015896 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f40c81-04d1-4d2b-ab7e-334a7f36d6f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:30.016712 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f40c81-04d1-4d2b-ab7e-334a7f36d6f4 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:30.017075 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f40c81-04d1-4d2b-ab7e-334a7f36d6f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:30.017430 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f40c81-04d1-4d2b-ab7e-334a7f36d6f4 None admin] PATH_INFO: `/v3/services` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:30.018265 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f40c81-04d1-4d2b-ab7e-334a7f36d6f4 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:30.018655 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f40c81-04d1-4d2b-ab7e-334a7f36d6f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:30.020271 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f40c81-04d1-4d2b-ab7e-334a7f36d6f4 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:30.025804 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f6fb63-7252-4470-ba69-c4eb111a650a None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:30.027558 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 436/895] 10.222.0.40 () {56 vars in 1114 bytes} [Thu Jul 14 09:25:29 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:25:30.036629 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f40c81-04d1-4d2b-ab7e-334a7f36d6f4 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:30.060290 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:30.163191 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f6fb63-7252-4470-ba69-c4eb111a650a None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:30.174533 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f40c81-04d1-4d2b-ab7e-334a7f36d6f4 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:30.211927 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a764563d-5683-4c9c-a15a-70a30e5c446e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:30.212752 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a764563d-5683-4c9c-a15a-70a30e5c446e None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:30.213038 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a764563d-5683-4c9c-a15a-70a30e5c446e None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:30.213372 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a764563d-5683-4c9c-a15a-70a30e5c446e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:30.215074 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99148630-c4bc-4fae-a15c-d69218c54a02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:30.215869 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99148630-c4bc-4fae-a15c-d69218c54a02 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:30.216262 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99148630-c4bc-4fae-a15c-d69218c54a02 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:30.216645 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99148630-c4bc-4fae-a15c-d69218c54a02 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:30.217557 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99148630-c4bc-4fae-a15c-d69218c54a02 None admin] RBAC: Adding query filter params (interface=public, service_id=463f0d81d5134e18a27cb39e5f7cc29f, region_id=RegionOne) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:30.217982 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99148630-c4bc-4fae-a15c-d69218c54a02 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:30.219632 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99148630-c4bc-4fae-a15c-d69218c54a02 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:30.225463 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a764563d-5683-4c9c-a15a-70a30e5c446e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:25:30.228497 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 437/896] 10.222.0.40 () {56 vars in 1251 bytes} [Thu Jul 14 09:25:30 2022] GET /identity/v3/endpoints?service_id=463f0d81d5134e18a27cb39e5f7cc29f&interface=public®ion_id=RegionOne => generated 194 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:25:30.233842 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99148630-c4bc-4fae-a15c-d69218c54a02 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:30.234273 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-a764563d-5683-4c9c-a15a-70a30e5c446e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 14 09:25:30.234273 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:25:30.234273 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:25:30.234273 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:25:30.234273 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:25:30.234273 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:25:30.234273 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:25:30.234273 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:25:30.234273 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:25:30.234273 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:25:30.234273 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:25:30.234273 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:25:30.234273 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:25:30.234273 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:25:30.234273 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:25:30.234273 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:25:30.235212 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:25:30.235212 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:25:30.235212 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:25:30.235212 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:25:30.235212 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:25:30.235212 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:25:30.235212 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:25:30.235212 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:25:30.235212 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:25:30.235212 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:25:30.235212 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:25:30.235212 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( Jul 14 09:25:30.235212 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:25:30.235212 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:25:30.235212 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:25:30.235212 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:25:30.236031 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:25:30.236031 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:25:30.236031 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:25:30.236031 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:25:30.236031 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:25:30.236031 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:25:30.236031 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:25:30.236031 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:25:30.236031 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:25:30.236031 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:25:30.236031 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 14 09:25:30.236031 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Jul 14 09:25:30.236031 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 460/897] 10.222.0.40 () {56 vars in 1120 bytes} [Thu Jul 14 09:25:30 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 09:25:30.242733 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a764563d-5683-4c9c-a15a-70a30e5c446e None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:30.297095 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:30.358991 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:30.385305 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99148630-c4bc-4fae-a15c-d69218c54a02 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:30.392198 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a764563d-5683-4c9c-a15a-70a30e5c446e None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:30.429392 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df9a772-33a6-45ae-b716-803118f8a564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:30.430053 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df9a772-33a6-45ae-b716-803118f8a564 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:30.430369 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df9a772-33a6-45ae-b716-803118f8a564 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:30.430647 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df9a772-33a6-45ae-b716-803118f8a564 None admin] PATH_INFO: `/v3/services` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:30.431340 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df9a772-33a6-45ae-b716-803118f8a564 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:30.433585 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df9a772-33a6-45ae-b716-803118f8a564 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:30.439761 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 438/898] 10.222.0.40 () {56 vars in 1087 bytes} [Thu Jul 14 09:25:30 2022] GET /identity/v3/services => generated 1268 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:25:30.452195 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87c98d2-8259-49cf-ab8b-0e1ff0c4a600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:30.452899 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87c98d2-8259-49cf-ab8b-0e1ff0c4a600 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:30.453182 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87c98d2-8259-49cf-ab8b-0e1ff0c4a600 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:30.453527 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87c98d2-8259-49cf-ab8b-0e1ff0c4a600 None admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:30.454414 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87c98d2-8259-49cf-ab8b-0e1ff0c4a600 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:30.454738 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87c98d2-8259-49cf-ab8b-0e1ff0c4a600 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:30.456185 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87c98d2-8259-49cf-ab8b-0e1ff0c4a600 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:30.467103 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 461/899] 10.222.0.40 () {56 vars in 1115 bytes} [Thu Jul 14 09:25:30 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:25:30.473008 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df9a772-33a6-45ae-b716-803118f8a564 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:30.619439 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df9a772-33a6-45ae-b716-803118f8a564 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:30.662716 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c5be68-7085-408f-af9a-10c4a8d555dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:30.663924 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c5be68-7085-408f-af9a-10c4a8d555dc None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:30.664440 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c5be68-7085-408f-af9a-10c4a8d555dc None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:30.664940 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c5be68-7085-408f-af9a-10c4a8d555dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:30.678516 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c5be68-7085-408f-af9a-10c4a8d555dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:30.680410 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c5be68-7085-408f-af9a-10c4a8d555dc None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:30.687946 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:30.700316 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-d0c5be68-7085-408f-af9a-10c4a8d555dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:25:30.700316 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:25:30.700316 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:25:30.700316 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:25:30.700316 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:25:30.700316 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:25:30.700316 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:25:30.700316 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:25:30.700316 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:25:30.700316 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:25:30.700316 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:25:30.700316 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:25:30.700316 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 09:25:30.700316 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 09:25:30.700316 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 09:25:30.701219 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 09:25:30.701219 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:25:30.701219 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:25:30.701219 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:25:30.701219 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:25:30.701219 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:25:30.701219 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:25:30.701219 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:25:30.701219 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( Jul 14 09:25:30.701219 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:25:30.701219 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:25:30.701219 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:25:30.701219 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:25:30.701219 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:25:30.701219 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:25:30.701219 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:25:30.701219 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:25:30.702236 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 09:25:30.702236 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 09:25:30.702236 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:25:30.702236 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:25:30.704515 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 439/900] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 09:25:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:25:30.709796 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87c98d2-8259-49cf-ab8b-0e1ff0c4a600 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:30.822354 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87c98d2-8259-49cf-ab8b-0e1ff0c4a600 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:30.823896 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:30.860513 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9a7f60-f6b2-4fc7-b9dd-043df0663d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:30.861194 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9a7f60-f6b2-4fc7-b9dd-043df0663d53 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:30.861483 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9a7f60-f6b2-4fc7-b9dd-043df0663d53 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:30.861764 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9a7f60-f6b2-4fc7-b9dd-043df0663d53 None admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:30.862549 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9a7f60-f6b2-4fc7-b9dd-043df0663d53 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:30.862862 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9a7f60-f6b2-4fc7-b9dd-043df0663d53 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:30.864284 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9a7f60-f6b2-4fc7-b9dd-043df0663d53 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:30.877824 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 462/901] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 14 09:25:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:25:30.883078 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c5be68-7085-408f-af9a-10c4a8d555dc None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:31.002846 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c5be68-7085-408f-af9a-10c4a8d555dc None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:31.041912 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b5b47f-50b3-4296-9b80-5ccced79ca00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:31.042779 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b5b47f-50b3-4296-9b80-5ccced79ca00 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:31.043107 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b5b47f-50b3-4296-9b80-5ccced79ca00 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:31.043387 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b5b47f-50b3-4296-9b80-5ccced79ca00 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:31.051960 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b5b47f-50b3-4296-9b80-5ccced79ca00 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:31.053423 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b5b47f-50b3-4296-9b80-5ccced79ca00 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:31.069391 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-b0b5b47f-50b3-4296-9b80-5ccced79ca00 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 14 09:25:31.069391 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:25:31.069391 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:25:31.069391 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:25:31.069391 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:25:31.069391 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:25:31.069391 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:25:31.069391 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:25:31.069391 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:25:31.069391 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:25:31.069391 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:25:31.069391 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:25:31.069391 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 09:25:31.069391 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 09:25:31.069391 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 09:25:31.069391 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 09:25:31.070412 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:25:31.070412 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:25:31.070412 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 09:25:31.070412 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 09:25:31.070412 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 09:25:31.070412 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 09:25:31.070412 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:25:31.070412 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:25:31.070412 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:25:31.070412 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:25:31.070412 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:25:31.070412 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( Jul 14 09:25:31.070412 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:25:31.070412 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:25:31.070412 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:25:31.070412 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:25:31.070412 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:25:31.070412 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:25:31.071982 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:25:31.071982 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:25:31.071982 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 09:25:31.071982 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 09:25:31.071982 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 09:25:31.071982 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 09:25:31.071982 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 09:25:31.071982 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 09:25:31.071982 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 14 09:25:31.071982 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:25:31.071982 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 440/902] 10.222.0.40 () {56 vars in 1117 bytes} [Thu Jul 14 09:25:30 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:25:31.076592 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9a7f60-f6b2-4fc7-b9dd-043df0663d53 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:31.209149 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9a7f60-f6b2-4fc7-b9dd-043df0663d53 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:31.246346 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c977189-ea5d-4acc-8b76-d8583e289d84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:31.247041 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c977189-ea5d-4acc-8b76-d8583e289d84 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:31.247326 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c977189-ea5d-4acc-8b76-d8583e289d84 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:31.247602 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c977189-ea5d-4acc-8b76-d8583e289d84 None admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:31.248458 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c977189-ea5d-4acc-8b76-d8583e289d84 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:31.248772 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c977189-ea5d-4acc-8b76-d8583e289d84 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:31.250356 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c977189-ea5d-4acc-8b76-d8583e289d84 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:31.271445 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 463/903] 10.222.0.40 () {56 vars in 1149 bytes} [Thu Jul 14 09:25:31 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:25:31.276837 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b5b47f-50b3-4296-9b80-5ccced79ca00 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:31.354408 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:31.410400 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b5b47f-50b3-4296-9b80-5ccced79ca00 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:31.452230 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c708cf-88cb-4c9a-9b6b-b14a1625e8b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:31.452955 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c708cf-88cb-4c9a-9b6b-b14a1625e8b5 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:31.453248 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c708cf-88cb-4c9a-9b6b-b14a1625e8b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:31.453528 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c708cf-88cb-4c9a-9b6b-b14a1625e8b5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:31.509605 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8d2226-89ed-454e-ba3b-05418aa951fe None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:31.509934 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8d2226-89ed-454e-ba3b-05418aa951fe None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:31.510163 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8d2226-89ed-454e-ba3b-05418aa951fe None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:31.512197 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 464/904] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:25:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:25:31.519763 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e672e03b-227f-44cd-8b37-61b047436edd None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:31.520225 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e672e03b-227f-44cd-8b37-61b047436edd None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:31.521255 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e672e03b-227f-44cd-8b37-61b047436edd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:31.543785 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-e672e03b-227f-44cd-8b37-61b047436edd None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:25:31.545267 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-e672e03b-227f-44cd-8b37-61b047436edd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:31.545454 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c708cf-88cb-4c9a-9b6b-b14a1625e8b5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:31.546871 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c708cf-88cb-4c9a-9b6b-b14a1625e8b5 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:31.566608 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:31.625126 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:31.658470 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 465/905] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:25:31 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 09:25:31.683122 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e672e03b-227f-44cd-8b37-61b047436edd None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:31.684488 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 441/906] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 14 09:25:31 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 09:25:31.689750 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c708cf-88cb-4c9a-9b6b-b14a1625e8b5 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:31.796396 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e672e03b-227f-44cd-8b37-61b047436edd None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:31.824348 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c708cf-88cb-4c9a-9b6b-b14a1625e8b5 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:31.834686 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954f3eab-fdba-4afa-9944-d6bea55113dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:31.835772 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954f3eab-fdba-4afa-9944-d6bea55113dc None admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:31.836256 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954f3eab-fdba-4afa-9944-d6bea55113dc None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:31.836739 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954f3eab-fdba-4afa-9944-d6bea55113dc None admin] PATH_INFO: `/v3/services` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:31.837674 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954f3eab-fdba-4afa-9944-d6bea55113dc None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:31.840024 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954f3eab-fdba-4afa-9944-d6bea55113dc None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:31.862578 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 466/907] 10.222.0.40 () {60 vars in 1141 bytes} [Thu Jul 14 09:25:31 2022] POST /identity/v3/services => generated 241 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 09:25:31.873716 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0433d1bb-c829-4535-8264-fd4c256c76cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:31.874588 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0433d1bb-c829-4535-8264-fd4c256c76cb None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:31.874874 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0433d1bb-c829-4535-8264-fd4c256c76cb None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:31.875204 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0433d1bb-c829-4535-8264-fd4c256c76cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:31.888695 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0433d1bb-c829-4535-8264-fd4c256c76cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:31.890283 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0433d1bb-c829-4535-8264-fd4c256c76cb None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:31.911470 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-0433d1bb-c829-4535-8264-fd4c256c76cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:25:31.911470 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:25:31.911470 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:25:31.911470 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:25:31.911470 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:25:31.911470 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:25:31.911470 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:25:31.911470 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:25:31.911470 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:25:31.911470 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:25:31.911470 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:25:31.911470 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:25:31.911470 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 09:25:31.911470 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 09:25:31.911470 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 09:25:31.912441 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 09:25:31.912441 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:25:31.912441 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:25:31.912441 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:25:31.912441 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:25:31.912441 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:25:31.912441 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:25:31.912441 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:25:31.912441 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( Jul 14 09:25:31.912441 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:25:31.912441 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:25:31.912441 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:25:31.912441 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:25:31.912441 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:25:31.912441 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:25:31.912441 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:25:31.912441 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:25:31.913349 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 09:25:31.913349 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 09:25:31.913349 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:25:31.913349 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:25:31.913349 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 442/908] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 09:25:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:25:31.919613 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954f3eab-fdba-4afa-9944-d6bea55113dc None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:31.935172 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:32.049630 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954f3eab-fdba-4afa-9944-d6bea55113dc None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:32.088484 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3f1b19-1234-4c3e-a880-c1e66b126cd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:32.089609 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3f1b19-1234-4c3e-a880-c1e66b126cd2 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:32.090141 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3f1b19-1234-4c3e-a880-c1e66b126cd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:32.090639 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3f1b19-1234-4c3e-a880-c1e66b126cd2 None admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:32.091595 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3f1b19-1234-4c3e-a880-c1e66b126cd2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:32.092142 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3f1b19-1234-4c3e-a880-c1e66b126cd2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:32.093834 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3f1b19-1234-4c3e-a880-c1e66b126cd2 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:32.108482 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 467/909] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 14 09:25:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:25:32.113704 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0433d1bb-c829-4535-8264-fd4c256c76cb None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:32.126214 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:32.197783 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f758cfa-a36d-469d-ba49-0b4b3f2b793e None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:32.198119 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f758cfa-a36d-469d-ba49-0b4b3f2b793e None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:32.198386 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f758cfa-a36d-469d-ba49-0b4b3f2b793e None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:32.201155 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 468/910] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:25:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 09:25:32.205644 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d441e2df-c74b-40bd-ba0d-0053223477b5 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:32.205940 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d441e2df-c74b-40bd-ba0d-0053223477b5 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:32.206245 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d441e2df-c74b-40bd-ba0d-0053223477b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:32.224556 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-d441e2df-c74b-40bd-ba0d-0053223477b5 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:25:32.225803 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-d441e2df-c74b-40bd-ba0d-0053223477b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:32.250772 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0433d1bb-c829-4535-8264-fd4c256c76cb None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:32.294313 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a62378-c68b-42c6-aab2-f326ffa66340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:32.296200 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a62378-c68b-42c6-aab2-f326ffa66340 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:32.297014 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a62378-c68b-42c6-aab2-f326ffa66340 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:32.297802 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a62378-c68b-42c6-aab2-f326ffa66340 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:32.307657 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a62378-c68b-42c6-aab2-f326ffa66340 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:32.309825 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a62378-c68b-42c6-aab2-f326ffa66340 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:32.316171 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:32.322271 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 469/911] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:25:32 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 09:25:32.338397 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-54a62378-c68b-42c6-aab2-f326ffa66340 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 09:25:32.338397 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:25:32.338397 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:25:32.338397 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:25:32.338397 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:25:32.338397 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:25:32.338397 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:25:32.338397 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:25:32.338397 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:25:32.338397 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:25:32.338397 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:25:32.338397 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:25:32.338397 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 09:25:32.338397 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 09:25:32.338397 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 09:25:32.339349 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 09:25:32.339349 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:25:32.339349 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:25:32.339349 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:25:32.339349 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:25:32.339349 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:25:32.339349 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:25:32.339349 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:25:32.339349 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( Jul 14 09:25:32.339349 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:25:32.339349 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:25:32.339349 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:25:32.339349 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:25:32.339349 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:25:32.339349 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:25:32.339349 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:25:32.339349 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:25:32.340311 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 09:25:32.340311 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 09:25:32.340311 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 09:25:32.340311 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 09:25:32.340311 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 09:25:32.340311 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 09:25:32.340311 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 09:25:32.340311 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:25:32.343000 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 443/912] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jul 14 09:25:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 09:25:32.349811 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d441e2df-c74b-40bd-ba0d-0053223477b5 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:32.350051 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a62378-c68b-42c6-aab2-f326ffa66340 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:32.436418 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:32.493369 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a62378-c68b-42c6-aab2-f326ffa66340 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:32.507162 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d441e2df-c74b-40bd-ba0d-0053223477b5 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:32.545338 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b683bc59-2309-444a-ba40-6204ad56c74c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:32.546224 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b683bc59-2309-444a-ba40-6204ad56c74c None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:32.546852 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b683bc59-2309-444a-ba40-6204ad56c74c None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:32.547013 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b683bc59-2309-444a-ba40-6204ad56c74c None admin] PATH_INFO: `/v3/projects` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:32.547917 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b683bc59-2309-444a-ba40-6204ad56c74c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:32.548333 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b683bc59-2309-444a-ba40-6204ad56c74c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:32.549871 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b683bc59-2309-444a-ba40-6204ad56c74c None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:32.566005 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 444/913] 10.222.0.40 () {56 vars in 1148 bytes} [Thu Jul 14 09:25:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:25:32.567795 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c117a2f-ffd7-45fd-8d43-6ee1930ff8c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:32.568641 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c117a2f-ffd7-45fd-8d43-6ee1930ff8c3 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:32.568924 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c117a2f-ffd7-45fd-8d43-6ee1930ff8c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:32.569197 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c117a2f-ffd7-45fd-8d43-6ee1930ff8c3 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:32.569868 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c117a2f-ffd7-45fd-8d43-6ee1930ff8c3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:32.574362 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c117a2f-ffd7-45fd-8d43-6ee1930ff8c3 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:32.574530 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b683bc59-2309-444a-ba40-6204ad56c74c None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:32.589489 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-5c117a2f-ffd7-45fd-8d43-6ee1930ff8c3 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 14 09:25:32.589489 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:25:32.589489 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 09:25:32.589489 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 09:25:32.589489 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 09:25:32.589489 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 09:25:32.589489 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 09:25:32.589489 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 09:25:32.589489 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 14 09:25:32.589489 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Jul 14 09:25:32.589489 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 09:25:32.589489 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Jul 14 09:25:32.589489 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:25:32.589489 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:25:32.589489 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:25:32.589489 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:25:32.590756 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:25:32.590756 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:25:32.590756 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:25:32.590756 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:25:32.590756 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:25:32.590756 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:25:32.590756 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:25:32.590756 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 09:25:32.590756 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 09:25:32.590756 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 09:25:32.590756 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 09:25:32.590756 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:25:32.590756 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:25:32.590756 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:25:32.590756 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:25:32.590756 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:25:32.591709 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:25:32.591709 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:25:32.591709 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( Jul 14 09:25:32.591709 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:25:32.591709 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:25:32.591709 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:25:32.591709 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:25:32.591709 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:25:32.591709 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:25:32.591709 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:25:32.591709 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:25:32.591709 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 09:25:32.591709 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 09:25:32.591709 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 14 09:25:32.591709 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Jul 14 09:25:32.596206 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 470/914] 10.222.0.40 () {56 vars in 1132 bytes} [Thu Jul 14 09:25:32 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:25:32.597306 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c117a2f-ffd7-45fd-8d43-6ee1930ff8c3 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:32.683280 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:32.720683 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b683bc59-2309-444a-ba40-6204ad56c74c None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:32.745128 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c117a2f-ffd7-45fd-8d43-6ee1930ff8c3 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:32.759348 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:32.771224 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2082af26-4d17-4056-b922-3fdb92ec9d86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:32.771794 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2082af26-4d17-4056-b922-3fdb92ec9d86 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:32.772344 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2082af26-4d17-4056-b922-3fdb92ec9d86 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:32.772454 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2082af26-4d17-4056-b922-3fdb92ec9d86 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:32.773405 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2082af26-4d17-4056-b922-3fdb92ec9d86 None admin] RBAC: Adding query filter params (role.id=717b56da664944778c6bfc5e1c95909f, scope.project.id=a478e76f04dd413f89ddfba7b0cdc9cc, user.id=6cf35868f9ff46e2835a6cc023641da6) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:32.773580 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2082af26-4d17-4056-b922-3fdb92ec9d86 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:32.775107 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2082af26-4d17-4056-b922-3fdb92ec9d86 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:32.781435 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 445/915] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jul 14 09:25:32 2022] GET /identity/v3/role_assignments?user.id=6cf35868f9ff46e2835a6cc023641da6&scope.project.id=a478e76f04dd413f89ddfba7b0cdc9cc&role.id=717b56da664944778c6bfc5e1c95909f => generated 259 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:25:32.787899 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68765004-d77d-480e-a740-50fb9d75fb24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:32.787899 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68765004-d77d-480e-a740-50fb9d75fb24 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:32.787899 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68765004-d77d-480e-a740-50fb9d75fb24 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:32.787899 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68765004-d77d-480e-a740-50fb9d75fb24 None admin] PATH_INFO: `/v3/services` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:32.788762 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4054a57-fa59-4c8c-8324-75f1d8f2eb55 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:32.788762 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4054a57-fa59-4c8c-8324-75f1d8f2eb55 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:32.788904 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68765004-d77d-480e-a740-50fb9d75fb24 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:32.788976 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4054a57-fa59-4c8c-8324-75f1d8f2eb55 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:32.789264 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68765004-d77d-480e-a740-50fb9d75fb24 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:32.794271 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68765004-d77d-480e-a740-50fb9d75fb24 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:32.794476 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 446/916] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:25:32 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:25:32.796746 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5354f64b-93fd-4d50-940e-d2536d704029 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:32.797042 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5354f64b-93fd-4d50-940e-d2536d704029 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:32.797325 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5354f64b-93fd-4d50-940e-d2536d704029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:32.804773 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 471/917] 10.222.0.40 () {56 vars in 1126 bytes} [Thu Jul 14 09:25:32 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:25:32.807069 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68765004-d77d-480e-a740-50fb9d75fb24 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:32.824531 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-5354f64b-93fd-4d50-940e-d2536d704029 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:25:32.825950 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-5354f64b-93fd-4d50-940e-d2536d704029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:32.908804 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 447/918] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:25:32 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 09:25:32.933292 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68765004-d77d-480e-a740-50fb9d75fb24 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:32.935800 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5354f64b-93fd-4d50-940e-d2536d704029 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:32.973570 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:32.982525 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bad7af-9eb6-49be-a015-9558e2363e36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:32.983390 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bad7af-9eb6-49be-a015-9558e2363e36 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:32.983749 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bad7af-9eb6-49be-a015-9558e2363e36 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:32.984573 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bad7af-9eb6-49be-a015-9558e2363e36 None admin] PATH_INFO: `/v3/services` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:32.984873 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bad7af-9eb6-49be-a015-9558e2363e36 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:32.985186 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bad7af-9eb6-49be-a015-9558e2363e36 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:32.986692 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bad7af-9eb6-49be-a015-9558e2363e36 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:32.995613 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 472/919] 10.222.0.40 () {56 vars in 1126 bytes} [Thu Jul 14 09:25:32 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:25:33.001241 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bad7af-9eb6-49be-a015-9558e2363e36 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:33.103412 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5354f64b-93fd-4d50-940e-d2536d704029 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:33.138720 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bad7af-9eb6-49be-a015-9558e2363e36 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:33.145152 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:33.167077 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b95249-c5ad-4b04-98e2-c1060f940ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:33.168056 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b95249-c5ad-4b04-98e2-c1060f940ac3 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:33.168478 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b95249-c5ad-4b04-98e2-c1060f940ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:33.169351 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b95249-c5ad-4b04-98e2-c1060f940ac3 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:33.169803 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b95249-c5ad-4b04-98e2-c1060f940ac3 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:33.171436 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b95249-c5ad-4b04-98e2-c1060f940ac3 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:33.186365 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db46484-bf75-49a0-846e-4d8d6d2ab519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:33.186803 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-96b95249-c5ad-4b04-98e2-c1060f940ac3 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 14 09:25:33.186803 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:25:33.186803 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 09:25:33.186803 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 09:25:33.186803 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 09:25:33.186803 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 09:25:33.186803 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 09:25:33.186803 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 09:25:33.186803 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 14 09:25:33.186803 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:25:33.186803 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 09:25:33.186803 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:25:33.186803 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:25:33.186803 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:25:33.186803 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:25:33.186803 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:25:33.186803 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:25:33.187808 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:25:33.187808 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:25:33.187808 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:25:33.187808 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:25:33.187808 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:25:33.187808 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:25:33.187808 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 09:25:33.187808 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 09:25:33.187808 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 09:25:33.187808 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 09:25:33.187808 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:25:33.187808 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:25:33.187808 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:25:33.187808 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:25:33.187808 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:25:33.187808 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:25:33.188641 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:25:33.188641 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( Jul 14 09:25:33.188641 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:25:33.188641 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:25:33.188641 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:25:33.188641 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:25:33.188641 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:25:33.188641 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:25:33.188641 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:25:33.188641 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:25:33.188641 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 09:25:33.188641 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 09:25:33.188641 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 14 09:25:33.188641 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:25:33.190481 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db46484-bf75-49a0-846e-4d8d6d2ab519 None admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:33.190941 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db46484-bf75-49a0-846e-4d8d6d2ab519 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:33.191404 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db46484-bf75-49a0-846e-4d8d6d2ab519 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:33.192906 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db46484-bf75-49a0-846e-4d8d6d2ab519 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:33.193946 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 448/920] 10.222.0.40 () {56 vars in 1114 bytes} [Thu Jul 14 09:25:32 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 09:25:33.195050 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b95249-c5ad-4b04-98e2-c1060f940ac3 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:33.195410 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db46484-bf75-49a0-846e-4d8d6d2ab519 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:33.220968 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 473/921] 10.222.0.40 () {60 vars in 1144 bytes} [Thu Jul 14 09:25:33 2022] POST /identity/v3/endpoints => generated 347 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 09:25:33.343397 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b95249-c5ad-4b04-98e2-c1060f940ac3 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:33.391277 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa85c3c-3e8f-4fda-a234-d8d260cd6da0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:33.392036 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa85c3c-3e8f-4fda-a234-d8d260cd6da0 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:33.392325 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa85c3c-3e8f-4fda-a234-d8d260cd6da0 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:33.392606 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa85c3c-3e8f-4fda-a234-d8d260cd6da0 None admin] PATH_INFO: `/v3/services` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:33.393321 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa85c3c-3e8f-4fda-a234-d8d260cd6da0 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:33.393631 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa85c3c-3e8f-4fda-a234-d8d260cd6da0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:33.395054 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa85c3c-3e8f-4fda-a234-d8d260cd6da0 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:33.400837 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 449/922] 10.222.0.40 () {56 vars in 1114 bytes} [Thu Jul 14 09:25:33 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:25:33.407453 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db46484-bf75-49a0-846e-4d8d6d2ab519 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:33.482457 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:33.570534 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db46484-bf75-49a0-846e-4d8d6d2ab519 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:33.613830 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6ee8bc-efe5-4c7d-8467-3b272626ca9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:33.615483 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6ee8bc-efe5-4c7d-8467-3b272626ca9d None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:33.615981 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6ee8bc-efe5-4c7d-8467-3b272626ca9d None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:33.616720 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6ee8bc-efe5-4c7d-8467-3b272626ca9d None admin] PATH_INFO: `/v3/services` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:33.618063 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6ee8bc-efe5-4c7d-8467-3b272626ca9d None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:33.618652 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6ee8bc-efe5-4c7d-8467-3b272626ca9d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:33.621249 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6ee8bc-efe5-4c7d-8467-3b272626ca9d None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:33.631801 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 474/923] 10.222.0.40 () {56 vars in 1114 bytes} [Thu Jul 14 09:25:33 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:25:33.643811 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa85c3c-3e8f-4fda-a234-d8d260cd6da0 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:33.696518 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:33.757393 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa85c3c-3e8f-4fda-a234-d8d260cd6da0 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:33.803499 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b660262-2731-4b52-8bd8-fd8457ff3d6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:33.804517 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b660262-2731-4b52-8bd8-fd8457ff3d6a None admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:33.804961 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b660262-2731-4b52-8bd8-fd8457ff3d6a None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:33.805418 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b660262-2731-4b52-8bd8-fd8457ff3d6a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:33.806853 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b660262-2731-4b52-8bd8-fd8457ff3d6a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:33.809284 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b660262-2731-4b52-8bd8-fd8457ff3d6a None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:33.836985 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 450/924] 10.222.0.40 () {60 vars in 1144 bytes} [Thu Jul 14 09:25:33 2022] POST /identity/v3/endpoints => generated 346 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:25:34.089736 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22c2ae3-5fe7-4539-847e-37fb1a5fd9be None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:34.090662 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22c2ae3-5fe7-4539-847e-37fb1a5fd9be None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:34.091103 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22c2ae3-5fe7-4539-847e-37fb1a5fd9be None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:34.092922 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 475/925] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:25:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:25:34.099342 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4830b12-0141-41db-9fef-e1908c9dfd40 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:34.099780 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4830b12-0141-41db-9fef-e1908c9dfd40 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:34.100160 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4830b12-0141-41db-9fef-e1908c9dfd40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:34.118914 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-a4830b12-0141-41db-9fef-e1908c9dfd40 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:25:34.120272 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-a4830b12-0141-41db-9fef-e1908c9dfd40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:34.218408 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 451/926] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:25:34 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 09:25:34.240980 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22c2ae3-5fe7-4539-847e-37fb1a5fd9be None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:34.350219 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22c2ae3-5fe7-4539-847e-37fb1a5fd9be None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:34.364126 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:34.387405 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eda6f2b-a85e-4e19-8152-d8bb7719d2ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:34.388239 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eda6f2b-a85e-4e19-8152-d8bb7719d2ff None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:34.388530 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eda6f2b-a85e-4e19-8152-d8bb7719d2ff None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:34.388811 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eda6f2b-a85e-4e19-8152-d8bb7719d2ff None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:34.389482 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eda6f2b-a85e-4e19-8152-d8bb7719d2ff None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:34.390906 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eda6f2b-a85e-4e19-8152-d8bb7719d2ff None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:34.404322 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-8eda6f2b-a85e-4e19-8152-d8bb7719d2ff None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 09:25:34.404322 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:25:34.404322 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 09:25:34.404322 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 09:25:34.404322 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 09:25:34.404322 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 09:25:34.404322 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 09:25:34.404322 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 09:25:34.404322 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 09:25:34.404322 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Jul 14 09:25:34.404322 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 09:25:34.404322 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Jul 14 09:25:34.404322 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:25:34.404322 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:25:34.404322 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:25:34.404322 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:25:34.404322 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:25:34.405611 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:25:34.405611 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:25:34.405611 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:25:34.405611 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:25:34.405611 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:25:34.405611 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:25:34.405611 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 09:25:34.405611 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 09:25:34.405611 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 09:25:34.405611 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 09:25:34.405611 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:25:34.405611 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:25:34.405611 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:25:34.405611 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:25:34.405611 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:25:34.405611 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:25:34.406522 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:25:34.406522 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( Jul 14 09:25:34.406522 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:25:34.406522 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:25:34.406522 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:25:34.406522 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:25:34.406522 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:25:34.406522 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:25:34.406522 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:25:34.406522 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:25:34.406522 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 09:25:34.406522 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 09:25:34.406522 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 09:25:34.406522 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Jul 14 09:25:34.406522 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 476/927] 10.222.0.40 () {56 vars in 1126 bytes} [Thu Jul 14 09:25:34 2022] GET /identity/v3/services/object-store => generated 93 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:25:34.413269 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4830b12-0141-41db-9fef-e1908c9dfd40 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:34.442884 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:34.522992 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4830b12-0141-41db-9fef-e1908c9dfd40 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:34.563547 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3cac13-c9d7-4480-b27b-92d5c36fe3dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:34.564248 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3cac13-c9d7-4480-b27b-92d5c36fe3dd None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:34.564537 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3cac13-c9d7-4480-b27b-92d5c36fe3dd None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:34.564816 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3cac13-c9d7-4480-b27b-92d5c36fe3dd None admin] PATH_INFO: `/v3/services` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:34.565559 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3cac13-c9d7-4480-b27b-92d5c36fe3dd None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:34.565874 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3cac13-c9d7-4480-b27b-92d5c36fe3dd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:34.567945 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3cac13-c9d7-4480-b27b-92d5c36fe3dd None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:34.574016 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 452/928] 10.222.0.40 () {56 vars in 1122 bytes} [Thu Jul 14 09:25:34 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:25:34.580136 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eda6f2b-a85e-4e19-8152-d8bb7719d2ff None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:34.689188 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eda6f2b-a85e-4e19-8152-d8bb7719d2ff None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:34.725395 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb21f871-a272-425c-a4ce-06643a2b5dcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:34.726079 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb21f871-a272-425c-a4ce-06643a2b5dcf None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:34.726432 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb21f871-a272-425c-a4ce-06643a2b5dcf None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:34.726716 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb21f871-a272-425c-a4ce-06643a2b5dcf None admin] PATH_INFO: `/v3/services` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:34.727445 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb21f871-a272-425c-a4ce-06643a2b5dcf None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:34.727761 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb21f871-a272-425c-a4ce-06643a2b5dcf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:34.729212 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb21f871-a272-425c-a4ce-06643a2b5dcf None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:34.734771 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 477/929] 10.222.0.40 () {56 vars in 1122 bytes} [Thu Jul 14 09:25:34 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:25:34.741595 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3cac13-c9d7-4480-b27b-92d5c36fe3dd None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:34.839473 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:34.849380 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3cac13-c9d7-4480-b27b-92d5c36fe3dd None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:34.887356 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d87014-5f09-42fd-be9a-4435034dd23f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:34.888044 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d87014-5f09-42fd-be9a-4435034dd23f None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:34.888327 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d87014-5f09-42fd-be9a-4435034dd23f None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:34.888603 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d87014-5f09-42fd-be9a-4435034dd23f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:34.889418 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d87014-5f09-42fd-be9a-4435034dd23f None admin] RBAC: Adding query filter params (interface=public, service_id=b422ae8997e24e089abbd6022a979430, region_id=RegionOne) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:34.889734 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d87014-5f09-42fd-be9a-4435034dd23f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:34.894451 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d87014-5f09-42fd-be9a-4435034dd23f None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:34.899155 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 453/930] 10.222.0.40 () {56 vars in 1251 bytes} [Thu Jul 14 09:25:34 2022] GET /identity/v3/endpoints?service_id=b422ae8997e24e089abbd6022a979430&interface=public®ion_id=RegionOne => generated 194 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:25:34.906237 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb21f871-a272-425c-a4ce-06643a2b5dcf None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:34.957679 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:35.020109 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb21f871-a272-425c-a4ce-06643a2b5dcf None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:35.058079 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4c9c7d-c351-4ec4-9bde-c32117820bd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:35.058811 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4c9c7d-c351-4ec4-9bde-c32117820bd8 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:35.059239 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4c9c7d-c351-4ec4-9bde-c32117820bd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:35.059563 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4c9c7d-c351-4ec4-9bde-c32117820bd8 None admin] PATH_INFO: `/v3/services` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:35.060274 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4c9c7d-c351-4ec4-9bde-c32117820bd8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:35.061666 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4c9c7d-c351-4ec4-9bde-c32117820bd8 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:35.068845 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 478/931] 10.222.0.40 () {56 vars in 1087 bytes} [Thu Jul 14 09:25:34 2022] GET /identity/v3/services => generated 1497 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:25:35.084148 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb74830-c2c5-4934-90ff-3f5e9c87f9be None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:35.084586 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb74830-c2c5-4934-90ff-3f5e9c87f9be None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:35.084995 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb74830-c2c5-4934-90ff-3f5e9c87f9be None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:35.086883 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 454/932] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:25:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:25:35.092874 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08979e2-77c9-4447-a8da-dbc679e34f40 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:35.093393 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08979e2-77c9-4447-a8da-dbc679e34f40 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:35.093494 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08979e2-77c9-4447-a8da-dbc679e34f40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:35.112145 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-a08979e2-77c9-4447-a8da-dbc679e34f40 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:25:35.113471 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-a08979e2-77c9-4447-a8da-dbc679e34f40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:35.202778 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 479/933] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:25:35 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 09:25:35.225787 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb74830-c2c5-4934-90ff-3f5e9c87f9be None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:35.336971 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb74830-c2c5-4934-90ff-3f5e9c87f9be None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:35.373052 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f66825-399d-4fe9-8db6-ae5ad31ba396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:35.373876 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f66825-399d-4fe9-8db6-ae5ad31ba396 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:35.374160 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f66825-399d-4fe9-8db6-ae5ad31ba396 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:35.374468 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f66825-399d-4fe9-8db6-ae5ad31ba396 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:35.385307 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f66825-399d-4fe9-8db6-ae5ad31ba396 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:25:35.393654 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-11f66825-399d-4fe9-8db6-ae5ad31ba396 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 14 09:25:35.393654 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:25:35.393654 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:25:35.393654 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:25:35.393654 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:25:35.393654 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:25:35.393654 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:25:35.393654 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:25:35.393654 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:25:35.393654 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:25:35.393654 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:25:35.393654 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:25:35.393654 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:25:35.393654 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:25:35.393654 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:25:35.393654 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:25:35.394644 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:25:35.394644 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:25:35.394644 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:25:35.394644 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:25:35.394644 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:25:35.394644 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:25:35.394644 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:25:35.394644 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:25:35.394644 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:25:35.394644 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:25:35.394644 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:25:35.394644 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( Jul 14 09:25:35.394644 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:25:35.394644 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:25:35.394644 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:25:35.394644 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:25:35.396478 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:25:35.396478 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:25:35.396478 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:25:35.396478 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:25:35.396478 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:25:35.396478 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:25:35.396478 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:25:35.396478 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:25:35.396478 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:25:35.396478 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:25:35.396478 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 14 09:25:35.396478 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:25:35.396478 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 455/934] 10.222.0.40 () {56 vars in 1120 bytes} [Thu Jul 14 09:25:35 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:25:35.401770 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08979e2-77c9-4447-a8da-dbc679e34f40 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:35.458894 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:35.516613 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08979e2-77c9-4447-a8da-dbc679e34f40 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:35.558799 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e04d75b-57a6-4b70-bb44-f6aeb7908ab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:35.559510 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e04d75b-57a6-4b70-bb44-f6aeb7908ab3 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:35.559802 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e04d75b-57a6-4b70-bb44-f6aeb7908ab3 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:35.560084 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e04d75b-57a6-4b70-bb44-f6aeb7908ab3 None admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:35.560862 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e04d75b-57a6-4b70-bb44-f6aeb7908ab3 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:35.561177 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e04d75b-57a6-4b70-bb44-f6aeb7908ab3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:35.562611 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e04d75b-57a6-4b70-bb44-f6aeb7908ab3 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:35.572295 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 480/935] 10.222.0.40 () {56 vars in 1115 bytes} [Thu Jul 14 09:25:35 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:25:35.577755 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f66825-399d-4fe9-8db6-ae5ad31ba396 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:35.583207 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0f7813-bb98-4eb5-8af4-8cdb979b8931 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:35.583528 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0f7813-bb98-4eb5-8af4-8cdb979b8931 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:35.583784 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0f7813-bb98-4eb5-8af4-8cdb979b8931 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:35.585354 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 481/936] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:25:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:25:35.590594 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43516181-9a9c-4830-b6a9-66a4247f2a83 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:35.590887 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43516181-9a9c-4830-b6a9-66a4247f2a83 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:35.591184 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43516181-9a9c-4830-b6a9-66a4247f2a83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:35.599117 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:35.610900 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-43516181-9a9c-4830-b6a9-66a4247f2a83 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:25:35.613025 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-43516181-9a9c-4830-b6a9-66a4247f2a83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:35.694841 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f66825-399d-4fe9-8db6-ae5ad31ba396 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:35.701683 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 482/937] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:25:35 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 09:25:35.725137 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43516181-9a9c-4830-b6a9-66a4247f2a83 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:35.743281 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6112373e-fb82-40f7-833c-6cf55b4cbdcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:35.744904 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6112373e-fb82-40f7-833c-6cf55b4cbdcd None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:35.745338 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6112373e-fb82-40f7-833c-6cf55b4cbdcd None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:35.745774 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6112373e-fb82-40f7-833c-6cf55b4cbdcd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:35.757612 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:35.768478 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6112373e-fb82-40f7-833c-6cf55b4cbdcd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:35.769882 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6112373e-fb82-40f7-833c-6cf55b4cbdcd None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:35.794786 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-6112373e-fb82-40f7-833c-6cf55b4cbdcd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:25:35.794786 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:25:35.794786 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:25:35.794786 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:25:35.794786 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:25:35.794786 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:25:35.794786 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:25:35.794786 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:25:35.794786 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:25:35.794786 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:25:35.794786 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:25:35.794786 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:25:35.794786 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 09:25:35.794786 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 09:25:35.794786 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 09:25:35.796583 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 09:25:35.796583 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:25:35.796583 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:25:35.796583 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:25:35.796583 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:25:35.796583 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:25:35.796583 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:25:35.796583 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:25:35.796583 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( Jul 14 09:25:35.796583 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:25:35.796583 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:25:35.796583 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:25:35.796583 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:25:35.796583 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:25:35.796583 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:25:35.796583 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:25:35.796583 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:25:35.798382 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 09:25:35.798382 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 09:25:35.798382 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:25:35.798382 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:25:35.801324 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 456/938] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 09:25:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:25:35.802237 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6112373e-fb82-40f7-833c-6cf55b4cbdcd None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:35.881881 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:35.896069 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43516181-9a9c-4830-b6a9-66a4247f2a83 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:35.923094 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6112373e-fb82-40f7-833c-6cf55b4cbdcd None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:35.961930 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e752f22-7523-4789-9bbc-c568a90a9fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:35.963781 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057744ae-9823-44aa-8c85-381e20bc43d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:35.963990 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e752f22-7523-4789-9bbc-c568a90a9fc3 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:35.964450 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057744ae-9823-44aa-8c85-381e20bc43d5 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:35.964732 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057744ae-9823-44aa-8c85-381e20bc43d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:35.965008 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057744ae-9823-44aa-8c85-381e20bc43d5 None admin] PATH_INFO: `/v3/domains` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:35.965446 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e752f22-7523-4789-9bbc-c568a90a9fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:35.965820 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057744ae-9823-44aa-8c85-381e20bc43d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:35.966139 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057744ae-9823-44aa-8c85-381e20bc43d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:35.966892 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e752f22-7523-4789-9bbc-c568a90a9fc3 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:35.967555 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057744ae-9823-44aa-8c85-381e20bc43d5 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:35.968761 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e752f22-7523-4789-9bbc-c568a90a9fc3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:35.971898 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e752f22-7523-4789-9bbc-c568a90a9fc3 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:35.985920 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 457/939] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 14 09:25:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:25:35.986883 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057744ae-9823-44aa-8c85-381e20bc43d5 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:35.988638 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-2e752f22-7523-4789-9bbc-c568a90a9fc3 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 14 09:25:35.988638 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:25:35.988638 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 09:25:35.988638 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 09:25:35.988638 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 09:25:35.988638 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 09:25:35.988638 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 09:25:35.988638 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 09:25:35.988638 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 14 09:25:35.988638 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Jul 14 09:25:35.988638 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 09:25:35.988638 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Jul 14 09:25:35.988638 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:25:35.988638 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:25:35.988638 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:25:35.988638 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:25:35.988638 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:25:35.989687 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:25:35.989687 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:25:35.989687 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:25:35.989687 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:25:35.989687 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:25:35.989687 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:25:35.989687 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 09:25:35.989687 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 09:25:35.989687 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 09:25:35.989687 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 09:25:35.989687 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:25:35.989687 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:25:35.989687 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:25:35.989687 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:25:35.989687 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:25:35.989687 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:25:35.990555 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:25:35.990555 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( Jul 14 09:25:35.990555 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:25:35.990555 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:25:35.990555 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:25:35.990555 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:25:35.990555 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:25:35.990555 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:25:35.990555 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:25:35.990555 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:25:35.990555 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 09:25:35.990555 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 09:25:35.990555 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 14 09:25:35.990555 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Jul 14 09:25:35.999236 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 483/940] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jul 14 09:25:35 2022] GET /identity/v3/services/compute => generated 88 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 09:25:36.001338 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e752f22-7523-4789-9bbc-c568a90a9fc3 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:36.111803 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:36.116306 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057744ae-9823-44aa-8c85-381e20bc43d5 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:36.125861 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e752f22-7523-4789-9bbc-c568a90a9fc3 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:36.150989 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:36.161417 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a99e59-4af0-4a76-8ed1-0ddcc0f1d119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:36.162762 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a99e59-4af0-4a76-8ed1-0ddcc0f1d119 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:36.163122 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a99e59-4af0-4a76-8ed1-0ddcc0f1d119 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:36.163477 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a99e59-4af0-4a76-8ed1-0ddcc0f1d119 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:36.172326 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a99e59-4af0-4a76-8ed1-0ddcc0f1d119 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:36.173793 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a99e59-4af0-4a76-8ed1-0ddcc0f1d119 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:36.178427 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9d5e06-fff5-407c-9aac-3d117332d58e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:36.179321 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9d5e06-fff5-407c-9aac-3d117332d58e None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:36.179769 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9d5e06-fff5-407c-9aac-3d117332d58e None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:36.180196 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9d5e06-fff5-407c-9aac-3d117332d58e None admin] PATH_INFO: `/v3/services` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:36.181133 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9d5e06-fff5-407c-9aac-3d117332d58e None admin] RBAC: Adding query filter params (name=compute) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:36.181593 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9d5e06-fff5-407c-9aac-3d117332d58e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:36.183197 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9d5e06-fff5-407c-9aac-3d117332d58e None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:36.189094 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 484/941] 10.222.0.40 () {56 vars in 1112 bytes} [Thu Jul 14 09:25:35 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:25:36.189983 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-b6a99e59-4af0-4a76-8ed1-0ddcc0f1d119 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 14 09:25:36.189983 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:25:36.189983 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:25:36.189983 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:25:36.189983 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:25:36.189983 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:25:36.189983 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:25:36.189983 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:25:36.189983 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:25:36.189983 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:25:36.189983 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:25:36.189983 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:25:36.189983 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 09:25:36.189983 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 09:25:36.189983 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 09:25:36.189983 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 09:25:36.190958 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:25:36.190958 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:25:36.190958 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 09:25:36.190958 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 09:25:36.190958 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 09:25:36.190958 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 09:25:36.190958 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:25:36.190958 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:25:36.190958 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:25:36.190958 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:25:36.190958 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:25:36.190958 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( Jul 14 09:25:36.190958 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:25:36.190958 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:25:36.190958 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:25:36.190958 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:25:36.190958 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:25:36.190958 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:25:36.191946 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:25:36.191946 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:25:36.191946 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 09:25:36.191946 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 09:25:36.191946 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 09:25:36.191946 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 09:25:36.191946 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 09:25:36.191946 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 09:25:36.191946 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 14 09:25:36.191946 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:25:36.191946 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 458/942] 10.222.0.40 () {56 vars in 1117 bytes} [Thu Jul 14 09:25:35 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:25:36.194150 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe526af-2f40-43a0-adfb-e6e03f86b2ac None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:36.194615 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe526af-2f40-43a0-adfb-e6e03f86b2ac None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:36.195030 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe526af-2f40-43a0-adfb-e6e03f86b2ac None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:36.196390 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a99e59-4af0-4a76-8ed1-0ddcc0f1d119 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:36.197281 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 485/943] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:25:36 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:25:36.198608 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe526af-2f40-43a0-adfb-e6e03f86b2ac None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:36.327907 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a99e59-4af0-4a76-8ed1-0ddcc0f1d119 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:36.341284 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe526af-2f40-43a0-adfb-e6e03f86b2ac None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:36.366942 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3dc9d0-6cc6-461b-b3b0-36098e97720c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:36.367529 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3dc9d0-6cc6-461b-b3b0-36098e97720c None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:36.367809 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3dc9d0-6cc6-461b-b3b0-36098e97720c None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:36.368084 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3dc9d0-6cc6-461b-b3b0-36098e97720c None admin] PATH_INFO: `/v3/services` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:36.368799 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3dc9d0-6cc6-461b-b3b0-36098e97720c None admin] RBAC: Adding query filter params (type=compute) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:36.369113 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3dc9d0-6cc6-461b-b3b0-36098e97720c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:36.370527 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3dc9d0-6cc6-461b-b3b0-36098e97720c None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:36.376357 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 459/944] 10.222.0.40 () {56 vars in 1112 bytes} [Thu Jul 14 09:25:36 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:25:36.377501 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b3ceec-73ab-4631-9d09-2f895034d101 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:36.377800 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b3ceec-73ab-4631-9d09-2f895034d101 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:36.378085 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b3ceec-73ab-4631-9d09-2f895034d101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:36.399955 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-55b3ceec-73ab-4631-9d09-2f895034d101 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:25:36.401336 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-55b3ceec-73ab-4631-9d09-2f895034d101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:36.420234 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01eb7a8-f227-4a27-96b8-e326d6abcade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:36.422247 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01eb7a8-f227-4a27-96b8-e326d6abcade None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:36.422855 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01eb7a8-f227-4a27-96b8-e326d6abcade None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:36.423339 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01eb7a8-f227-4a27-96b8-e326d6abcade None admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:36.424412 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01eb7a8-f227-4a27-96b8-e326d6abcade None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:36.424921 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01eb7a8-f227-4a27-96b8-e326d6abcade None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:36.427182 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01eb7a8-f227-4a27-96b8-e326d6abcade None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:36.453893 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 486/945] 10.222.0.40 () {56 vars in 1149 bytes} [Thu Jul 14 09:25:36 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:25:36.459357 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01eb7a8-f227-4a27-96b8-e326d6abcade None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:36.476874 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:36.480691 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:36.505502 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 460/946] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:25:36 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 09:25:36.530730 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b3ceec-73ab-4631-9d09-2f895034d101 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:36.600564 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01eb7a8-f227-4a27-96b8-e326d6abcade None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:36.647720 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91c4684-1ab7-484b-bf2b-79dd1d5057fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:36.648885 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91c4684-1ab7-484b-bf2b-79dd1d5057fd None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:36.649397 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91c4684-1ab7-484b-bf2b-79dd1d5057fd None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:36.650007 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91c4684-1ab7-484b-bf2b-79dd1d5057fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:36.662042 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91c4684-1ab7-484b-bf2b-79dd1d5057fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:36.664004 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91c4684-1ab7-484b-bf2b-79dd1d5057fd None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:36.668845 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b3ceec-73ab-4631-9d09-2f895034d101 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:36.684645 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-b91c4684-1ab7-484b-bf2b-79dd1d5057fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:25:36.684645 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:25:36.684645 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:25:36.684645 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:25:36.684645 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:25:36.684645 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:25:36.684645 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:25:36.684645 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:25:36.684645 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:25:36.684645 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:25:36.684645 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:25:36.684645 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:25:36.684645 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 09:25:36.684645 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 09:25:36.684645 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 09:25:36.685603 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 09:25:36.685603 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:25:36.685603 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:25:36.685603 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:25:36.685603 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:25:36.685603 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:25:36.685603 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:25:36.685603 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:25:36.685603 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( Jul 14 09:25:36.685603 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:25:36.685603 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:25:36.685603 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:25:36.685603 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:25:36.685603 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:25:36.685603 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:25:36.685603 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:25:36.685603 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:25:36.686927 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 09:25:36.686927 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 09:25:36.686927 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:25:36.686927 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Jul 14 09:25:36.689207 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 487/947] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 09:25:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 09:25:36.698227 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91c4684-1ab7-484b-bf2b-79dd1d5057fd None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:36.708032 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0f3398-3548-4851-a4d7-00b0d57b0d9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:36.708709 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0f3398-3548-4851-a4d7-00b0d57b0d9f None admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:36.708998 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0f3398-3548-4851-a4d7-00b0d57b0d9f None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:36.709835 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0f3398-3548-4851-a4d7-00b0d57b0d9f None admin] PATH_INFO: `/v3/projects` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:36.710630 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0f3398-3548-4851-a4d7-00b0d57b0d9f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:36.712508 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0f3398-3548-4851-a4d7-00b0d57b0d9f None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:36.714277 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: WARNING keystone.server.flask.common [None req-9c0f3398-3548-4851-a4d7-00b0d57b0d9f None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 14 09:25:36.743439 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.sql.core [None req-9c0f3398-3548-4851-a4d7-00b0d57b0d9f None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 14 09:25:36.743439 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 14 09:25:36.743439 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [parameters: {'id': '889ad5a79ff34345a97e9159a5a1aaf0', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 14 09:25:36.743439 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80197) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 14 09:25:36.760678 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-9c0f3398-3548-4851-a4d7-00b0d57b0d9f None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 889ad5a79ff34345a97e9159a5a1aaf0.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 889ad5a79ff34345a97e9159a5a1aaf0. Jul 14 09:25:36.760678 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:25:36.760678 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 14 09:25:36.760678 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 14 09:25:36.760678 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 14 09:25:36.760678 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 14 09:25:36.760678 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 14 09:25:36.760678 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application result = self._query(query) Jul 14 09:25:36.760678 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 14 09:25:36.760678 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application conn.query(q) Jul 14 09:25:36.760678 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 14 09:25:36.760678 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 14 09:25:36.760678 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 14 09:25:36.761636 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application result.read() Jul 14 09:25:36.761636 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 14 09:25:36.761636 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 14 09:25:36.761636 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 14 09:25:36.761636 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 14 09:25:36.761636 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 14 09:25:36.761636 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 14 09:25:36.761636 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 14 09:25:36.761636 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 14 09:25:36.761636 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 14 09:25:36.761636 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:25:36.761636 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 14 09:25:36.761636 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:25:36.761636 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:25:36.761636 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 14 09:25:36.761636 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 14 09:25:36.761636 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 14 09:25:36.761636 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 14 09:25:36.762636 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 14 09:25:36.762636 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application next(self.gen) Jul 14 09:25:36.762636 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 14 09:25:36.762636 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application yield resource Jul 14 09:25:36.762636 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 14 09:25:36.762636 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application next(self.gen) Jul 14 09:25:36.762636 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 14 09:25:36.762636 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application self.session.rollback() Jul 14 09:25:36.762636 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 14 09:25:36.762636 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application self.force_reraise() Jul 14 09:25:36.762636 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 14 09:25:36.762636 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise self.value Jul 14 09:25:36.762636 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 14 09:25:36.762636 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 14 09:25:36.762636 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 14 09:25:36.762636 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application session.commit() Jul 14 09:25:36.762636 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 14 09:25:36.763551 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 14 09:25:36.763551 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 14 09:25:36.763551 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application self._prepare_impl() Jul 14 09:25:36.763551 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 14 09:25:36.763551 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application self.session.flush() Jul 14 09:25:36.763551 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 14 09:25:36.763551 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application self._flush(objects) Jul 14 09:25:36.763551 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 14 09:25:36.763551 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 14 09:25:36.763551 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 14 09:25:36.763551 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application compat.raise_( Jul 14 09:25:36.763551 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 14 09:25:36.763551 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception Jul 14 09:25:36.763551 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 14 09:25:36.763551 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application flush_context.execute() Jul 14 09:25:36.763551 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 14 09:25:36.763551 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application rec.execute(self) Jul 14 09:25:36.764495 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 14 09:25:36.764495 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 14 09:25:36.764495 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 14 09:25:36.764495 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 14 09:25:36.764495 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 14 09:25:36.764495 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 14 09:25:36.764495 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 14 09:25:36.764495 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 14 09:25:36.764495 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 14 09:25:36.764495 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 14 09:25:36.764495 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 14 09:25:36.764495 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 14 09:25:36.764495 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 14 09:25:36.764495 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 14 09:25:36.764495 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 14 09:25:36.765278 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 14 09:25:36.765278 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 14 09:25:36.765278 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception Jul 14 09:25:36.765278 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 14 09:25:36.765278 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 14 09:25:36.765278 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 14 09:25:36.765278 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 14 09:25:36.765278 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 14 09:25:36.765278 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application result = self._query(query) Jul 14 09:25:36.765278 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 14 09:25:36.765278 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application conn.query(q) Jul 14 09:25:36.765278 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 14 09:25:36.765278 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 14 09:25:36.765278 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 14 09:25:36.765278 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application result.read() Jul 14 09:25:36.765278 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 14 09:25:36.765278 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 14 09:25:36.766141 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 14 09:25:36.766141 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 14 09:25:36.766141 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 14 09:25:36.766141 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 14 09:25:36.766141 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 14 09:25:36.766141 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 14 09:25:36.766141 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 14 09:25:36.766141 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 14 09:25:36.766141 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application [parameters: {'id': '889ad5a79ff34345a97e9159a5a1aaf0', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 14 09:25:36.766141 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 14 09:25:36.766141 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:25:36.766141 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 09:25:36.766141 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:25:36.766141 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:25:36.766141 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 14 09:25:36.771558 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 14 09:25:36.771558 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 14 09:25:36.771558 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 14 09:25:36.771558 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 14 09:25:36.771558 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:25:36.771558 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 09:25:36.771558 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:25:36.771558 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:25:36.771558 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:25:36.771558 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:25:36.771558 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:25:36.771558 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:25:36.771558 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:25:36.771558 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:25:36.771558 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:25:36.771558 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:25:36.771558 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:25:36.772434 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:25:36.772434 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 14 09:25:36.772434 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 14 09:25:36.772434 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:25:36.772434 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:25:36.772434 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 14 09:25:36.772434 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 14 09:25:36.772434 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 889ad5a79ff34345a97e9159a5a1aaf0. Jul 14 09:25:36.772434 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:25:36.772434 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 461/948] 10.222.0.40 () {60 vars in 1140 bytes} [Thu Jul 14 09:25:36 2022] POST /identity/v3/projects => generated 262 bytes in 232 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 14 09:25:36.774739 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0f3398-3548-4851-a4d7-00b0d57b0d9f None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:36.805969 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:36.825432 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:36.860206 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91c4684-1ab7-484b-bf2b-79dd1d5057fd None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:36.916055 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b7d635-1512-49b0-9ee3-3124feb385a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:36.917036 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b7d635-1512-49b0-9ee3-3124feb385a8 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:36.917481 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b7d635-1512-49b0-9ee3-3124feb385a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:36.917761 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b7d635-1512-49b0-9ee3-3124feb385a8 None admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:36.918641 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b7d635-1512-49b0-9ee3-3124feb385a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:36.918961 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b7d635-1512-49b0-9ee3-3124feb385a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:36.920377 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b7d635-1512-49b0-9ee3-3124feb385a8 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:36.937025 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0f3398-3548-4851-a4d7-00b0d57b0d9f None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:36.937573 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 488/949] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 14 09:25:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:25:36.943635 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b7d635-1512-49b0-9ee3-3124feb385a8 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:36.984568 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04ac70d-4221-4240-9b8e-354ab13aa1ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:36.985384 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04ac70d-4221-4240-9b8e-354ab13aa1ac None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:36.985671 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04ac70d-4221-4240-9b8e-354ab13aa1ac None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:36.985952 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04ac70d-4221-4240-9b8e-354ab13aa1ac None admin] PATH_INFO: `/v3/projects/service` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:36.995261 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04ac70d-4221-4240-9b8e-354ab13aa1ac None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:36.996939 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04ac70d-4221-4240-9b8e-354ab13aa1ac None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:37.016267 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-c04ac70d-4221-4240-9b8e-354ab13aa1ac None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 09:25:37.016267 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:25:37.016267 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:25:37.016267 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:25:37.016267 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:25:37.016267 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:25:37.016267 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:25:37.016267 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:25:37.016267 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:25:37.016267 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:25:37.016267 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:25:37.016267 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:25:37.016267 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 09:25:37.016267 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 09:25:37.016267 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 09:25:37.017635 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 09:25:37.017635 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:25:37.017635 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:25:37.017635 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:25:37.017635 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:25:37.017635 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:25:37.017635 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:25:37.017635 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:25:37.017635 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( Jul 14 09:25:37.017635 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:25:37.017635 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:25:37.017635 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:25:37.017635 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:25:37.017635 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:25:37.017635 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:25:37.017635 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:25:37.017635 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:25:37.018545 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 09:25:37.018545 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 09:25:37.018545 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 09:25:37.018545 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 09:25:37.018545 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 09:25:37.018545 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 09:25:37.018545 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 09:25:37.018545 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:25:37.022299 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 462/950] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jul 14 09:25:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 09:25:37.023797 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04ac70d-4221-4240-9b8e-354ab13aa1ac None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:37.105211 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b7d635-1512-49b0-9ee3-3124feb385a8 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:37.144031 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:37.154361 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04ac70d-4221-4240-9b8e-354ab13aa1ac None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:37.154617 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:37.185559 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a714e336-81ab-477a-922f-7510d99ade3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:37.186438 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a714e336-81ab-477a-922f-7510d99ade3e None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:37.186917 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a714e336-81ab-477a-922f-7510d99ade3e None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:37.187230 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a714e336-81ab-477a-922f-7510d99ade3e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:37.196178 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a714e336-81ab-477a-922f-7510d99ade3e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:37.198107 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a714e336-81ab-477a-922f-7510d99ade3e None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:37.217364 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-a714e336-81ab-477a-922f-7510d99ade3e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 09:25:37.217364 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:25:37.217364 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:25:37.217364 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:25:37.217364 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:25:37.217364 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:25:37.217364 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:25:37.217364 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:25:37.217364 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:25:37.217364 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:25:37.217364 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:25:37.217364 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:25:37.217364 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 09:25:37.217364 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 09:25:37.217364 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 09:25:37.218637 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 09:25:37.218637 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:25:37.218637 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:25:37.218637 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:25:37.218637 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:25:37.218637 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:25:37.218637 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:25:37.218637 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:25:37.218637 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( Jul 14 09:25:37.218637 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:25:37.218637 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:25:37.218637 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:25:37.218637 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:25:37.218637 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:25:37.218637 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:25:37.218637 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:25:37.218637 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:25:37.219531 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 09:25:37.219531 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 09:25:37.219531 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 09:25:37.219531 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 09:25:37.219531 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 09:25:37.219531 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 09:25:37.219531 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 09:25:37.219531 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Jul 14 09:25:37.219966 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d15b6b-84b2-4e50-aa26-2f800aaf4634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:37.219966 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d15b6b-84b2-4e50-aa26-2f800aaf4634 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:37.219966 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d15b6b-84b2-4e50-aa26-2f800aaf4634 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:37.219966 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d15b6b-84b2-4e50-aa26-2f800aaf4634 None admin] PATH_INFO: `/v3/projects` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:37.220362 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d15b6b-84b2-4e50-aa26-2f800aaf4634 None admin] RBAC: Adding query filter params (name=service) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:37.220362 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d15b6b-84b2-4e50-aa26-2f800aaf4634 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:37.221578 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d15b6b-84b2-4e50-aa26-2f800aaf4634 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:37.223938 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 489/951] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jul 14 09:25:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 09:25:37.225312 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a8ae48-8694-414f-9f87-6e6212d62752 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:37.226693 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a8ae48-8694-414f-9f87-6e6212d62752 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:37.226693 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a8ae48-8694-414f-9f87-6e6212d62752 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:37.230284 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 490/952] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:25:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:25:37.230284 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a8ae48-8694-414f-9f87-6e6212d62752 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:37.244408 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 463/953] 10.222.0.40 () {56 vars in 1112 bytes} [Thu Jul 14 09:25:37 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:25:37.245974 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecc4efa-0e00-46c5-8186-9490d5b24e76 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:37.246295 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecc4efa-0e00-46c5-8186-9490d5b24e76 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:37.246585 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecc4efa-0e00-46c5-8186-9490d5b24e76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:37.269653 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-4ecc4efa-0e00-46c5-8186-9490d5b24e76 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:25:37.271530 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-4ecc4efa-0e00-46c5-8186-9490d5b24e76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:37.358640 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 464/954] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:25:37 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 09:25:37.376643 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecc4efa-0e00-46c5-8186-9490d5b24e76 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:37.397442 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a8ae48-8694-414f-9f87-6e6212d62752 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:37.445995 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267d364f-a1ce-4786-b447-b49b402d7f28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:37.447050 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267d364f-a1ce-4786-b447-b49b402d7f28 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:37.447424 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267d364f-a1ce-4786-b447-b49b402d7f28 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:37.447800 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267d364f-a1ce-4786-b447-b49b402d7f28 None admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:37.448678 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267d364f-a1ce-4786-b447-b49b402d7f28 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:37.449049 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267d364f-a1ce-4786-b447-b49b402d7f28 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:37.450851 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267d364f-a1ce-4786-b447-b49b402d7f28 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:37.465141 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 491/955] 10.222.0.40 () {56 vars in 1148 bytes} [Thu Jul 14 09:25:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:25:37.474572 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267d364f-a1ce-4786-b447-b49b402d7f28 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:37.484673 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:37.501536 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecc4efa-0e00-46c5-8186-9490d5b24e76 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:37.553209 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:37.567768 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaa7772-0e8d-43e0-8c9b-11b84de47df3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:37.568630 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaa7772-0e8d-43e0-8c9b-11b84de47df3 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:37.568920 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaa7772-0e8d-43e0-8c9b-11b84de47df3 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:37.569209 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaa7772-0e8d-43e0-8c9b-11b84de47df3 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:37.569920 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaa7772-0e8d-43e0-8c9b-11b84de47df3 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:37.571442 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaa7772-0e8d-43e0-8c9b-11b84de47df3 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:37.584743 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-bcaa7772-0e8d-43e0-8c9b-11b84de47df3 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 09:25:37.584743 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:25:37.584743 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 09:25:37.584743 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 09:25:37.584743 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 09:25:37.584743 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 09:25:37.584743 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 09:25:37.584743 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 09:25:37.584743 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 09:25:37.584743 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:25:37.584743 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 09:25:37.584743 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:25:37.584743 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:25:37.584743 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:25:37.584743 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:25:37.584743 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:25:37.584743 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:25:37.586024 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:25:37.586024 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:25:37.586024 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:25:37.586024 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:25:37.586024 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:25:37.586024 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:25:37.586024 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 09:25:37.586024 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 09:25:37.586024 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 09:25:37.586024 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 09:25:37.586024 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:25:37.586024 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:25:37.586024 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:25:37.586024 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:25:37.586024 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:25:37.586024 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:25:37.587348 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:25:37.587348 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( Jul 14 09:25:37.587348 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:25:37.587348 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:25:37.587348 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:25:37.587348 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:25:37.587348 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:25:37.587348 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:25:37.587348 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:25:37.587348 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:25:37.587348 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 09:25:37.587348 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 09:25:37.587348 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 09:25:37.587348 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:25:37.587348 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 465/956] 10.222.0.40 () {56 vars in 1126 bytes} [Thu Jul 14 09:25:37 2022] GET /identity/v3/services/object-store => generated 93 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:25:37.591985 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaa7772-0e8d-43e0-8c9b-11b84de47df3 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:37.628922 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267d364f-a1ce-4786-b447-b49b402d7f28 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:37.675037 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc12e55-7300-4c27-a6f1-55e644f33c44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:37.676124 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc12e55-7300-4c27-a6f1-55e644f33c44 None admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:37.676541 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc12e55-7300-4c27-a6f1-55e644f33c44 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:37.677018 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc12e55-7300-4c27-a6f1-55e644f33c44 None admin] PATH_INFO: `/v3/projects/a478e76f04dd413f89ddfba7b0cdc9cc/users/6cf35868f9ff46e2835a6cc023641da6/roles/717b56da664944778c6bfc5e1c95909f` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:37.680243 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc12e55-7300-4c27-a6f1-55e644f33c44 None admin] RBAC: Authorizing `identity:create_grant(project_id=a478e76f04dd413f89ddfba7b0cdc9cc, user_id=6cf35868f9ff46e2835a6cc023641da6, role_id=717b56da664944778c6bfc5e1c95909f)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:37.681887 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc12e55-7300-4c27-a6f1-55e644f33c44 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:37.699800 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 492/957] 10.222.0.40 () {58 vars in 1439 bytes} [Thu Jul 14 09:25:37 2022] PUT /identity/v3/projects/a478e76f04dd413f89ddfba7b0cdc9cc/users/6cf35868f9ff46e2835a6cc023641da6/roles/717b56da664944778c6bfc5e1c95909f => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 09:25:37.722053 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaa7772-0e8d-43e0-8c9b-11b84de47df3 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:37.768143 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6864db1b-4f7f-421f-a79e-69a3c0e4f618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:37.768836 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6864db1b-4f7f-421f-a79e-69a3c0e4f618 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:37.769125 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6864db1b-4f7f-421f-a79e-69a3c0e4f618 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:37.769404 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6864db1b-4f7f-421f-a79e-69a3c0e4f618 None admin] PATH_INFO: `/v3/services` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:37.770716 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6864db1b-4f7f-421f-a79e-69a3c0e4f618 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:37.771031 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6864db1b-4f7f-421f-a79e-69a3c0e4f618 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:37.772584 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6864db1b-4f7f-421f-a79e-69a3c0e4f618 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:37.779040 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 466/958] 10.222.0.40 () {56 vars in 1122 bytes} [Thu Jul 14 09:25:37 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:25:37.785131 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc12e55-7300-4c27-a6f1-55e644f33c44 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:37.916460 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc12e55-7300-4c27-a6f1-55e644f33c44 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:37.924252 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:37.960299 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082575e8-d6d5-4fc0-985a-689ce412063e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:37.960881 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082575e8-d6d5-4fc0-985a-689ce412063e None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:37.961169 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082575e8-d6d5-4fc0-985a-689ce412063e None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:37.961446 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082575e8-d6d5-4fc0-985a-689ce412063e None admin] PATH_INFO: `/v3/services` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:37.962171 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082575e8-d6d5-4fc0-985a-689ce412063e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:37.962506 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082575e8-d6d5-4fc0-985a-689ce412063e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:37.963880 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082575e8-d6d5-4fc0-985a-689ce412063e None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:37.969779 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 493/959] 10.222.0.40 () {56 vars in 1122 bytes} [Thu Jul 14 09:25:37 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:25:37.976015 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6864db1b-4f7f-421f-a79e-69a3c0e4f618 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:37.997025 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:38.095013 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6864db1b-4f7f-421f-a79e-69a3c0e4f618 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:38.131425 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326ed0c4-3fb5-49cf-9127-1657eee3db04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:38.132113 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326ed0c4-3fb5-49cf-9127-1657eee3db04 None admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:38.132397 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326ed0c4-3fb5-49cf-9127-1657eee3db04 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:38.132678 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326ed0c4-3fb5-49cf-9127-1657eee3db04 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:38.133452 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326ed0c4-3fb5-49cf-9127-1657eee3db04 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:38.134939 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326ed0c4-3fb5-49cf-9127-1657eee3db04 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:38.157157 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 467/960] 10.222.0.40 () {60 vars in 1144 bytes} [Thu Jul 14 09:25:37 2022] POST /identity/v3/endpoints => generated 349 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:25:38.603963 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4459b0-31e1-45ec-b1a3-37514aebea5f None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:38.604682 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4459b0-31e1-45ec-b1a3-37514aebea5f None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:38.604682 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4459b0-31e1-45ec-b1a3-37514aebea5f None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:38.606729 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 494/961] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:25:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:25:38.612959 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dec4289-a9ae-482c-a716-2fed1163bba3 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:38.613390 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dec4289-a9ae-482c-a716-2fed1163bba3 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:38.614347 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dec4289-a9ae-482c-a716-2fed1163bba3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:38.632688 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-7dec4289-a9ae-482c-a716-2fed1163bba3 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:25:38.634034 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-7dec4289-a9ae-482c-a716-2fed1163bba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:38.701462 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:38.717161 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 468/962] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:25:38 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 09:25:38.741479 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4459b0-31e1-45ec-b1a3-37514aebea5f None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:38.852544 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4459b0-31e1-45ec-b1a3-37514aebea5f None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:38.888658 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae791e02-63cf-49fa-8b0f-cd108574ff1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:38.889331 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae791e02-63cf-49fa-8b0f-cd108574ff1e None admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:38.889621 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae791e02-63cf-49fa-8b0f-cd108574ff1e None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:38.889896 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae791e02-63cf-49fa-8b0f-cd108574ff1e None admin] PATH_INFO: `/v3/services` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:38.890659 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae791e02-63cf-49fa-8b0f-cd108574ff1e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:38.892024 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae791e02-63cf-49fa-8b0f-cd108574ff1e None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:38.910971 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 495/963] 10.222.0.40 () {60 vars in 1141 bytes} [Thu Jul 14 09:25:38 2022] POST /identity/v3/services => generated 242 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 09:25:39.670647 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83199595-bcfb-4d8d-b44b-c6cd9e524ac9 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:39.671168 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83199595-bcfb-4d8d-b44b-c6cd9e524ac9 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:39.671278 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83199595-bcfb-4d8d-b44b-c6cd9e524ac9 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:39.672903 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 469/964] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:25:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:25:39.678624 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e51b13f-ff80-41e9-9856-f26937843bb3 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:39.679473 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e51b13f-ff80-41e9-9856-f26937843bb3 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:39.679473 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e51b13f-ff80-41e9-9856-f26937843bb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:39.697247 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-9e51b13f-ff80-41e9-9856-f26937843bb3 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:25:39.698565 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-9e51b13f-ff80-41e9-9856-f26937843bb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:39.726502 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:39.780130 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 496/965] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:25:39 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 09:25:39.808446 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83199595-bcfb-4d8d-b44b-c6cd9e524ac9 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:39.922601 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83199595-bcfb-4d8d-b44b-c6cd9e524ac9 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:39.966743 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31458075-8bb4-44a2-8702-81ad918d4df5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:39.967437 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31458075-8bb4-44a2-8702-81ad918d4df5 None admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:39.967725 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31458075-8bb4-44a2-8702-81ad918d4df5 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:39.968009 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31458075-8bb4-44a2-8702-81ad918d4df5 None admin] PATH_INFO: `/v3/users` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:39.968737 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31458075-8bb4-44a2-8702-81ad918d4df5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:39.970218 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31458075-8bb4-44a2-8702-81ad918d4df5 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:39.990886 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.sql.core [None req-31458075-8bb4-44a2-8702-81ad918d4df5 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 14 09:25:39.990886 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 14 09:25:39.990886 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [parameters: {'user_id': '46fd9f84264541adb03d02a45d12fca8', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 14 09:25:39.990886 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80197) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 14 09:25:39.998861 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-31458075-8bb4-44a2-8702-81ad918d4df5 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 14 09:25:39.998861 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:25:39.998861 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 14 09:25:39.998861 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 14 09:25:39.998861 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 14 09:25:39.998861 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 14 09:25:39.998861 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 14 09:25:39.998861 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application result = self._query(query) Jul 14 09:25:39.998861 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 14 09:25:39.998861 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application conn.query(q) Jul 14 09:25:39.998861 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 14 09:25:39.998861 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 14 09:25:39.998861 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 14 09:25:39.998861 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application result.read() Jul 14 09:25:39.998861 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 14 09:25:40.001004 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 14 09:25:40.001004 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 14 09:25:40.001004 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 14 09:25:40.001004 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 14 09:25:40.001004 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 14 09:25:40.001004 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 14 09:25:40.001004 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 14 09:25:40.001004 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 14 09:25:40.001004 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:25:40.001004 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 14 09:25:40.001004 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:25:40.001004 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:25:40.001004 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 14 09:25:40.001004 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 14 09:25:40.001004 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 14 09:25:40.001004 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 14 09:25:40.001004 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 14 09:25:40.001004 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application next(self.gen) Jul 14 09:25:40.003347 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 14 09:25:40.003347 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application yield resource Jul 14 09:25:40.003347 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 14 09:25:40.003347 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application next(self.gen) Jul 14 09:25:40.003347 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 14 09:25:40.003347 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application self.session.rollback() Jul 14 09:25:40.003347 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 14 09:25:40.003347 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application self.force_reraise() Jul 14 09:25:40.003347 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 14 09:25:40.003347 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise self.value Jul 14 09:25:40.003347 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 14 09:25:40.003347 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 14 09:25:40.003347 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 14 09:25:40.003347 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application session.commit() Jul 14 09:25:40.003347 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 14 09:25:40.003347 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 14 09:25:40.003347 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 14 09:25:40.006008 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application self._prepare_impl() Jul 14 09:25:40.006008 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 14 09:25:40.006008 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application self.session.flush() Jul 14 09:25:40.006008 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 14 09:25:40.006008 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application self._flush(objects) Jul 14 09:25:40.006008 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 14 09:25:40.006008 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 14 09:25:40.006008 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 14 09:25:40.006008 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application compat.raise_( Jul 14 09:25:40.006008 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 14 09:25:40.006008 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception Jul 14 09:25:40.006008 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 14 09:25:40.006008 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application flush_context.execute() Jul 14 09:25:40.006008 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 14 09:25:40.006008 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application rec.execute(self) Jul 14 09:25:40.006008 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 14 09:25:40.006008 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 14 09:25:40.007626 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 14 09:25:40.007626 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 14 09:25:40.007626 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 14 09:25:40.007626 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 14 09:25:40.007626 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 14 09:25:40.007626 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 14 09:25:40.007626 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 14 09:25:40.007626 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 14 09:25:40.007626 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 14 09:25:40.007626 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 14 09:25:40.007626 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 14 09:25:40.007626 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 14 09:25:40.007626 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 14 09:25:40.007626 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 14 09:25:40.007626 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 14 09:25:40.007626 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception Jul 14 09:25:40.010442 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 14 09:25:40.010442 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 14 09:25:40.010442 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 14 09:25:40.010442 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 14 09:25:40.010442 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 14 09:25:40.010442 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application result = self._query(query) Jul 14 09:25:40.010442 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 14 09:25:40.010442 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application conn.query(q) Jul 14 09:25:40.010442 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 14 09:25:40.010442 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 14 09:25:40.010442 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 14 09:25:40.010442 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application result.read() Jul 14 09:25:40.010442 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 14 09:25:40.010442 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 14 09:25:40.010442 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 14 09:25:40.010442 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 14 09:25:40.011306 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 14 09:25:40.011306 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 14 09:25:40.011306 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 14 09:25:40.011306 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 14 09:25:40.011306 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 14 09:25:40.011306 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 14 09:25:40.011306 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application [parameters: {'user_id': '46fd9f84264541adb03d02a45d12fca8', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 14 09:25:40.011306 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 14 09:25:40.011306 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:25:40.011306 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 09:25:40.011306 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:25:40.011306 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:25:40.011306 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:25:40.011306 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:25:40.011306 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:25:40.012111 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:25:40.012111 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:25:40.012111 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:25:40.012111 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:25:40.012111 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:25:40.012111 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:25:40.012111 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:25:40.012111 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 14 09:25:40.012111 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 14 09:25:40.012111 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:25:40.012111 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:25:40.012111 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 09:25:40.012111 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 09:25:40.012111 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 09:25:40.012111 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 09:25:40.012111 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 14 09:25:40.012111 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 14 09:25:40.013004 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 14 09:25:40.013004 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 14 09:25:40.013004 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 14 09:25:40.013004 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 14 09:25:40.013004 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 14 09:25:40.013004 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:25:40.013004 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 470/966] 10.222.0.40 () {60 vars in 1131 bytes} [Thu Jul 14 09:25:39 2022] POST /identity/v3/users => generated 160 bytes in 193 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:25:40.013396 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e51b13f-ff80-41e9-9856-f26937843bb3 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:40.120945 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e51b13f-ff80-41e9-9856-f26937843bb3 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:40.128218 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952a55fc-d064-43bf-84c1-fd0424dd3a4c None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:40.128510 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952a55fc-d064-43bf-84c1-fd0424dd3a4c None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:40.128777 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952a55fc-d064-43bf-84c1-fd0424dd3a4c None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:40.133978 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 471/967] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:25:40 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:25:40.141712 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2a7e0b-8771-4e71-a5bc-ee1614e240c2 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:40.141997 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2a7e0b-8771-4e71-a5bc-ee1614e240c2 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:40.142319 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2a7e0b-8771-4e71-a5bc-ee1614e240c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:40.157038 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd58717-b960-48b5-9eea-077858fb4dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:40.157846 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd58717-b960-48b5-9eea-077858fb4dd9 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:40.158131 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd58717-b960-48b5-9eea-077858fb4dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:40.158435 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd58717-b960-48b5-9eea-077858fb4dd9 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:40.167206 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd58717-b960-48b5-9eea-077858fb4dd9 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:40.168471 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-dd2a7e0b-8771-4e71-a5bc-ee1614e240c2 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:25:40.168712 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd58717-b960-48b5-9eea-077858fb4dd9 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:40.170843 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-dd2a7e0b-8771-4e71-a5bc-ee1614e240c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:40.185231 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-0cd58717-b960-48b5-9eea-077858fb4dd9 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 14 09:25:40.185231 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:25:40.185231 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:25:40.185231 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:25:40.185231 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:25:40.185231 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:25:40.185231 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:25:40.185231 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:25:40.185231 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:25:40.185231 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:25:40.185231 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:25:40.185231 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:25:40.185231 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 09:25:40.185231 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 09:25:40.185231 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 09:25:40.185231 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 09:25:40.186360 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:25:40.186360 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:25:40.186360 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 09:25:40.186360 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 09:25:40.186360 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 09:25:40.186360 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 09:25:40.186360 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:25:40.186360 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:25:40.186360 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:25:40.186360 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:25:40.186360 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:25:40.186360 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( Jul 14 09:25:40.186360 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:25:40.186360 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:25:40.186360 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:25:40.186360 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:25:40.186360 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:25:40.186360 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:25:40.187295 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:25:40.187295 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:25:40.187295 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 09:25:40.187295 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 09:25:40.187295 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 09:25:40.187295 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 09:25:40.187295 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 09:25:40.187295 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 09:25:40.187295 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 14 09:25:40.187295 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Jul 14 09:25:40.187295 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 497/968] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 14 09:25:40 2022] GET /identity/v3/users/cinder => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:25:40.193937 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd58717-b960-48b5-9eea-077858fb4dd9 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:40.213957 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:40.240063 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:40.266510 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 472/969] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:25:40 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 09:25:40.294290 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2a7e0b-8771-4e71-a5bc-ee1614e240c2 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:40.335765 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd58717-b960-48b5-9eea-077858fb4dd9 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:40.381303 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e92b7f-01c7-40e4-b323-feeceb2fd62f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:40.382527 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e92b7f-01c7-40e4-b323-feeceb2fd62f None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:40.383396 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e92b7f-01c7-40e4-b323-feeceb2fd62f None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:40.384190 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e92b7f-01c7-40e4-b323-feeceb2fd62f None admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:40.385408 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e92b7f-01c7-40e4-b323-feeceb2fd62f None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:40.386233 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e92b7f-01c7-40e4-b323-feeceb2fd62f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:40.387703 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e92b7f-01c7-40e4-b323-feeceb2fd62f None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:40.404740 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2a7e0b-8771-4e71-a5bc-ee1614e240c2 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:40.438050 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 498/970] 10.222.0.40 () {56 vars in 1101 bytes} [Thu Jul 14 09:25:40 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:25:40.438050 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6f129e-0e37-4c57-9c0d-99927012d983 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:40.438050 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6f129e-0e37-4c57-9c0d-99927012d983 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:40.438050 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6f129e-0e37-4c57-9c0d-99927012d983 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:40.438050 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 499/971] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:25:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:25:40.449515 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9e683a-9720-430c-add3-a510804c0ab9 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:40.449935 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9e683a-9720-430c-add3-a510804c0ab9 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:40.450426 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9e683a-9720-430c-add3-a510804c0ab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:40.456595 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c115f107-a60c-4f3d-b996-da35ee7d4e74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:40.457491 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c115f107-a60c-4f3d-b996-da35ee7d4e74 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:40.457785 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c115f107-a60c-4f3d-b996-da35ee7d4e74 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:40.458065 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c115f107-a60c-4f3d-b996-da35ee7d4e74 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:40.470642 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c115f107-a60c-4f3d-b996-da35ee7d4e74 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:25:40.477549 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-0f9e683a-9720-430c-add3-a510804c0ab9 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:25:40.478839 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-0f9e683a-9720-430c-add3-a510804c0ab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:40.479754 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-c115f107-a60c-4f3d-b996-da35ee7d4e74 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 14 09:25:40.479754 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:25:40.479754 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:25:40.479754 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:25:40.479754 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:25:40.479754 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:25:40.479754 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:25:40.479754 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:25:40.479754 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:25:40.479754 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:25:40.479754 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:25:40.479754 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:25:40.479754 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:25:40.479754 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:25:40.479754 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:25:40.479754 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:25:40.480923 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:25:40.480923 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:25:40.480923 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:25:40.480923 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:25:40.480923 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:25:40.480923 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:25:40.480923 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:25:40.480923 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:25:40.480923 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:25:40.480923 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:25:40.480923 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:25:40.480923 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( Jul 14 09:25:40.480923 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:25:40.480923 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:25:40.480923 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:25:40.480923 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:25:40.482295 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:25:40.482295 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:25:40.482295 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:25:40.482295 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:25:40.482295 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:25:40.482295 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:25:40.482295 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:25:40.482295 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:25:40.482295 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:25:40.482295 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:25:40.482295 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 14 09:25:40.482295 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:25:40.482295 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 473/972] 10.222.0.40 () {56 vars in 1120 bytes} [Thu Jul 14 09:25:40 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:25:40.491143 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c115f107-a60c-4f3d-b996-da35ee7d4e74 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:40.577452 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:40.599051 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 500/973] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:25:40 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 09:25:40.619997 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9e683a-9720-430c-add3-a510804c0ab9 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:40.622715 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:40.649823 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c115f107-a60c-4f3d-b996-da35ee7d4e74 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:40.700496 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c325a3-9317-474a-91c2-9ea741b9897a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:40.701691 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c325a3-9317-474a-91c2-9ea741b9897a None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:40.702262 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c325a3-9317-474a-91c2-9ea741b9897a None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:40.702670 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c325a3-9317-474a-91c2-9ea741b9897a None admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:40.703980 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c325a3-9317-474a-91c2-9ea741b9897a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:40.704497 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c325a3-9317-474a-91c2-9ea741b9897a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:40.707775 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c325a3-9317-474a-91c2-9ea741b9897a None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:40.726554 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 474/974] 10.222.0.40 () {56 vars in 1115 bytes} [Thu Jul 14 09:25:40 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:25:40.731866 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c325a3-9317-474a-91c2-9ea741b9897a None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:40.763838 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9e683a-9720-430c-add3-a510804c0ab9 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:40.808961 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4d181f-430a-4cbc-94f9-b08a5d29ead9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:40.809781 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4d181f-430a-4cbc-94f9-b08a5d29ead9 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:40.810069 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4d181f-430a-4cbc-94f9-b08a5d29ead9 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:40.810381 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4d181f-430a-4cbc-94f9-b08a5d29ead9 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:40.811047 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4d181f-430a-4cbc-94f9-b08a5d29ead9 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:40.812429 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4d181f-430a-4cbc-94f9-b08a5d29ead9 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:40.829964 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-dc4d181f-430a-4cbc-94f9-b08a5d29ead9 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 09:25:40.829964 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:25:40.829964 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 09:25:40.829964 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 09:25:40.829964 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 09:25:40.829964 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 09:25:40.829964 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 09:25:40.829964 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 09:25:40.829964 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 09:25:40.829964 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Jul 14 09:25:40.829964 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 09:25:40.829964 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Jul 14 09:25:40.829964 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:25:40.829964 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:25:40.829964 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:25:40.829964 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:25:40.829964 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:25:40.831084 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:25:40.831084 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:25:40.831084 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:25:40.831084 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:25:40.831084 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:25:40.831084 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:25:40.831084 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 09:25:40.831084 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 09:25:40.831084 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 09:25:40.831084 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 09:25:40.831084 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:25:40.831084 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:25:40.831084 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:25:40.831084 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:25:40.831084 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:25:40.831084 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:25:40.832179 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:25:40.832179 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( Jul 14 09:25:40.832179 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:25:40.832179 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:25:40.832179 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:25:40.832179 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:25:40.832179 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:25:40.832179 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:25:40.832179 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:25:40.832179 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:25:40.832179 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 09:25:40.832179 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 09:25:40.832179 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 09:25:40.832179 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Jul 14 09:25:40.832179 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 501/975] 10.222.0.40 () {56 vars in 1126 bytes} [Thu Jul 14 09:25:40 2022] GET /identity/v3/services/object-store => generated 93 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 09:25:40.837800 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4d181f-430a-4cbc-94f9-b08a5d29ead9 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:40.860902 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c325a3-9317-474a-91c2-9ea741b9897a None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:40.874405 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:40.916379 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d151cc5-e6d2-4f1d-95af-2ea2041e8571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:40.917237 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d151cc5-e6d2-4f1d-95af-2ea2041e8571 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:40.917523 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d151cc5-e6d2-4f1d-95af-2ea2041e8571 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:40.917802 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d151cc5-e6d2-4f1d-95af-2ea2041e8571 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:40.924553 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:40.930732 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d151cc5-e6d2-4f1d-95af-2ea2041e8571 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:40.932229 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d151cc5-e6d2-4f1d-95af-2ea2041e8571 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:40.952458 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-5d151cc5-e6d2-4f1d-95af-2ea2041e8571 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:25:40.952458 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:25:40.952458 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:25:40.952458 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:25:40.952458 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:25:40.952458 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:25:40.952458 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:25:40.952458 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:25:40.952458 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:25:40.952458 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:25:40.952458 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:25:40.952458 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:25:40.952458 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 09:25:40.952458 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 09:25:40.952458 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 09:25:40.953429 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 09:25:40.953429 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:25:40.953429 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:25:40.953429 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:25:40.953429 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:25:40.953429 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:25:40.953429 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:25:40.953429 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:25:40.953429 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( Jul 14 09:25:40.953429 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:25:40.953429 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:25:40.953429 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:25:40.953429 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:25:40.953429 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:25:40.953429 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:25:40.953429 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:25:40.953429 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:25:40.954454 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 09:25:40.954454 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 09:25:40.954454 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:25:40.954454 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:25:40.954454 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 475/976] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 09:25:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 09:25:40.959949 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d151cc5-e6d2-4f1d-95af-2ea2041e8571 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:40.971395 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4d181f-430a-4cbc-94f9-b08a5d29ead9 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:41.013013 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0b0c5c-2e83-4bd2-ba61-c98b3f799bd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:41.014054 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0b0c5c-2e83-4bd2-ba61-c98b3f799bd2 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:41.014367 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0b0c5c-2e83-4bd2-ba61-c98b3f799bd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:41.014644 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0b0c5c-2e83-4bd2-ba61-c98b3f799bd2 None admin] PATH_INFO: `/v3/services` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:41.015374 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0b0c5c-2e83-4bd2-ba61-c98b3f799bd2 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:41.015673 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0b0c5c-2e83-4bd2-ba61-c98b3f799bd2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:41.017070 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0b0c5c-2e83-4bd2-ba61-c98b3f799bd2 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:41.028135 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 502/977] 10.222.0.40 () {56 vars in 1122 bytes} [Thu Jul 14 09:25:40 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:25:41.029291 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0b0c5c-2e83-4bd2-ba61-c98b3f799bd2 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:41.087231 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d151cc5-e6d2-4f1d-95af-2ea2041e8571 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:41.128991 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371da12d-7fde-431b-8ad9-5d9d7d4568da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:41.130700 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371da12d-7fde-431b-8ad9-5d9d7d4568da None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:41.130993 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371da12d-7fde-431b-8ad9-5d9d7d4568da None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:41.131281 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371da12d-7fde-431b-8ad9-5d9d7d4568da None admin] PATH_INFO: `/v3/domains` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:41.132027 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371da12d-7fde-431b-8ad9-5d9d7d4568da None admin] RBAC: Adding query filter params (name=Default) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:41.132343 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371da12d-7fde-431b-8ad9-5d9d7d4568da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:41.133745 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371da12d-7fde-431b-8ad9-5d9d7d4568da None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:41.140253 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0b0c5c-2e83-4bd2-ba61-c98b3f799bd2 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:41.147110 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 476/978] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 14 09:25:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:25:41.148274 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac42b79-cf73-45ee-b424-77558d814f54 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:41.148567 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac42b79-cf73-45ee-b424-77558d814f54 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:41.148844 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac42b79-cf73-45ee-b424-77558d814f54 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:41.150096 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 477/979] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:25:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:25:41.152259 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac42b79-cf73-45ee-b424-77558d814f54 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:41.181558 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:41.184105 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:41.190898 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddff928-2308-4d42-ad68-7a6b72d97568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:41.192105 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddff928-2308-4d42-ad68-7a6b72d97568 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:41.192488 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddff928-2308-4d42-ad68-7a6b72d97568 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:41.192973 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddff928-2308-4d42-ad68-7a6b72d97568 None admin] PATH_INFO: `/v3/services` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:41.194330 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddff928-2308-4d42-ad68-7a6b72d97568 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:41.194837 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddff928-2308-4d42-ad68-7a6b72d97568 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:41.196656 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddff928-2308-4d42-ad68-7a6b72d97568 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:41.203077 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 503/980] 10.222.0.40 () {56 vars in 1122 bytes} [Thu Jul 14 09:25:41 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:25:41.204397 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64348372-265c-4efc-98be-0baa49ab7d59 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:41.204686 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64348372-265c-4efc-98be-0baa49ab7d59 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:41.204970 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64348372-265c-4efc-98be-0baa49ab7d59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:41.229580 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-64348372-265c-4efc-98be-0baa49ab7d59 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:25:41.231292 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-64348372-265c-4efc-98be-0baa49ab7d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:41.272493 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac42b79-cf73-45ee-b424-77558d814f54 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:41.303568 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 504/981] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:25:41 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 09:25:41.304420 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64348372-265c-4efc-98be-0baa49ab7d59 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:41.311440 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe168c3-572c-4978-ba1c-9ecf42714564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:41.312287 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe168c3-572c-4978-ba1c-9ecf42714564 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:41.312994 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe168c3-572c-4978-ba1c-9ecf42714564 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:41.313275 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe168c3-572c-4978-ba1c-9ecf42714564 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:41.323240 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe168c3-572c-4978-ba1c-9ecf42714564 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:41.324701 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe168c3-572c-4978-ba1c-9ecf42714564 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:41.341202 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-2fe168c3-572c-4978-ba1c-9ecf42714564 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 14 09:25:41.341202 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:25:41.341202 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:25:41.341202 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:25:41.341202 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:25:41.341202 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:25:41.341202 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:25:41.341202 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:25:41.341202 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:25:41.341202 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:25:41.341202 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:25:41.341202 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:25:41.341202 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 09:25:41.341202 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 09:25:41.341202 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 09:25:41.341202 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 09:25:41.342281 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:25:41.342281 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:25:41.342281 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 09:25:41.342281 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 09:25:41.342281 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 09:25:41.342281 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 09:25:41.342281 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:25:41.342281 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:25:41.342281 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:25:41.342281 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:25:41.342281 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:25:41.342281 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( Jul 14 09:25:41.342281 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:25:41.342281 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:25:41.342281 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:25:41.342281 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:25:41.342281 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:25:41.342281 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:25:41.343389 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:25:41.343389 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:25:41.343389 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 09:25:41.343389 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 09:25:41.343389 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 09:25:41.343389 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 09:25:41.343389 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 09:25:41.343389 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 09:25:41.343389 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 14 09:25:41.343389 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:25:41.343389 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 478/982] 10.222.0.40 () {56 vars in 1117 bytes} [Thu Jul 14 09:25:41 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 09:25:41.344224 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe168c3-572c-4978-ba1c-9ecf42714564 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:41.433570 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64348372-265c-4efc-98be-0baa49ab7d59 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:41.443818 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:41.469240 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:41.473216 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe168c3-572c-4978-ba1c-9ecf42714564 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:41.480992 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa03f460-52f2-4be2-a8e4-77d17705283a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:41.481661 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa03f460-52f2-4be2-a8e4-77d17705283a None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:41.481944 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa03f460-52f2-4be2-a8e4-77d17705283a None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:41.482254 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa03f460-52f2-4be2-a8e4-77d17705283a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:41.483066 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa03f460-52f2-4be2-a8e4-77d17705283a None admin] RBAC: Adding query filter params (interface=admin, service_id=b422ae8997e24e089abbd6022a979430, region_id=RegionOne) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:41.483387 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa03f460-52f2-4be2-a8e4-77d17705283a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:41.484851 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa03f460-52f2-4be2-a8e4-77d17705283a None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:41.490693 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 505/983] 10.222.0.40 () {56 vars in 1249 bytes} [Thu Jul 14 09:25:41 2022] GET /identity/v3/endpoints?service_id=b422ae8997e24e089abbd6022a979430&interface=admin®ion_id=RegionOne => generated 193 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:25:41.493460 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa03f460-52f2-4be2-a8e4-77d17705283a None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:41.512048 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0604dfdb-0bc2-476d-aef4-636877494e27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:41.512857 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0604dfdb-0bc2-476d-aef4-636877494e27 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:41.513137 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0604dfdb-0bc2-476d-aef4-636877494e27 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:41.513412 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0604dfdb-0bc2-476d-aef4-636877494e27 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:41.514074 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0604dfdb-0bc2-476d-aef4-636877494e27 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:41.515480 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0604dfdb-0bc2-476d-aef4-636877494e27 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:41.527517 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-0604dfdb-0bc2-476d-aef4-636877494e27 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 14 09:25:41.527517 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:25:41.527517 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 09:25:41.527517 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 09:25:41.527517 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 09:25:41.527517 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 09:25:41.527517 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 09:25:41.527517 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 09:25:41.527517 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 14 09:25:41.527517 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:25:41.527517 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 09:25:41.527517 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:25:41.527517 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:25:41.527517 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:25:41.527517 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:25:41.527517 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:25:41.527517 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:25:41.529435 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:25:41.529435 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:25:41.529435 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:25:41.529435 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:25:41.529435 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:25:41.529435 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:25:41.529435 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 09:25:41.529435 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 09:25:41.529435 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 09:25:41.529435 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 09:25:41.529435 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:25:41.529435 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:25:41.529435 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:25:41.529435 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:25:41.529435 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:25:41.529435 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:25:41.531234 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:25:41.531234 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( Jul 14 09:25:41.531234 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:25:41.531234 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:25:41.531234 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:25:41.531234 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:25:41.531234 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:25:41.531234 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:25:41.531234 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:25:41.531234 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:25:41.531234 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 09:25:41.531234 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 09:25:41.531234 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 14 09:25:41.531234 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:25:41.533786 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 479/984] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jul 14 09:25:41 2022] GET /identity/v3/services/compute => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:25:41.534786 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0604dfdb-0bc2-476d-aef4-636877494e27 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:41.616958 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa03f460-52f2-4be2-a8e4-77d17705283a None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:41.648205 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0604dfdb-0bc2-476d-aef4-636877494e27 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:41.651952 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98daa3d9-09d2-4136-a9b7-184f5e53a936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:41.652634 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98daa3d9-09d2-4136-a9b7-184f5e53a936 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:41.652917 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98daa3d9-09d2-4136-a9b7-184f5e53a936 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:41.653197 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98daa3d9-09d2-4136-a9b7-184f5e53a936 None admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:41.654041 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98daa3d9-09d2-4136-a9b7-184f5e53a936 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:41.654387 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98daa3d9-09d2-4136-a9b7-184f5e53a936 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:41.655823 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98daa3d9-09d2-4136-a9b7-184f5e53a936 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:41.679261 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 506/985] 10.222.0.40 () {56 vars in 1149 bytes} [Thu Jul 14 09:25:41 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:25:41.680031 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98daa3d9-09d2-4136-a9b7-184f5e53a936 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:41.683867 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176fdf8d-5aa0-433e-a73c-bc3cd4168ad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:41.684602 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176fdf8d-5aa0-433e-a73c-bc3cd4168ad0 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:41.684987 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176fdf8d-5aa0-433e-a73c-bc3cd4168ad0 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:41.685384 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176fdf8d-5aa0-433e-a73c-bc3cd4168ad0 None admin] PATH_INFO: `/v3/services` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:41.686217 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176fdf8d-5aa0-433e-a73c-bc3cd4168ad0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:41.687596 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176fdf8d-5aa0-433e-a73c-bc3cd4168ad0 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:41.694126 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 480/986] 10.222.0.40 () {56 vars in 1087 bytes} [Thu Jul 14 09:25:41 2022] GET /identity/v3/services => generated 1727 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:25:41.694946 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176fdf8d-5aa0-433e-a73c-bc3cd4168ad0 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:41.710145 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:41.739890 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:41.808675 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98daa3d9-09d2-4136-a9b7-184f5e53a936 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:41.841747 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176fdf8d-5aa0-433e-a73c-bc3cd4168ad0 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:41.860799 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39917d59-bd3f-498e-b285-d5d92d88ca55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:41.861489 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39917d59-bd3f-498e-b285-d5d92d88ca55 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:41.861784 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39917d59-bd3f-498e-b285-d5d92d88ca55 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:41.862064 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39917d59-bd3f-498e-b285-d5d92d88ca55 None admin] PATH_INFO: `/v3/services` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:41.862828 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39917d59-bd3f-498e-b285-d5d92d88ca55 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:41.863147 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39917d59-bd3f-498e-b285-d5d92d88ca55 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:41.865118 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39917d59-bd3f-498e-b285-d5d92d88ca55 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:41.873532 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 507/987] 10.222.0.40 () {56 vars in 1112 bytes} [Thu Jul 14 09:25:41 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:25:41.878486 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39917d59-bd3f-498e-b285-d5d92d88ca55 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:41.887626 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b09527-4f87-4a16-a766-98e1f9889c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:41.888307 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b09527-4f87-4a16-a766-98e1f9889c8b None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:41.888599 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b09527-4f87-4a16-a766-98e1f9889c8b None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:41.888881 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b09527-4f87-4a16-a766-98e1f9889c8b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:41.970498 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b09527-4f87-4a16-a766-98e1f9889c8b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:41.972044 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b09527-4f87-4a16-a766-98e1f9889c8b None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:41.985050 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:41.997988 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39917d59-bd3f-498e-b285-d5d92d88ca55 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:42.015672 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:42.047808 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f59034-2a0d-45a2-8af4-21b37e667720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:42.048500 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f59034-2a0d-45a2-8af4-21b37e667720 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:42.048795 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f59034-2a0d-45a2-8af4-21b37e667720 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:42.049067 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f59034-2a0d-45a2-8af4-21b37e667720 None admin] PATH_INFO: `/v3/services` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:42.049876 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f59034-2a0d-45a2-8af4-21b37e667720 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:42.050109 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f59034-2a0d-45a2-8af4-21b37e667720 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:42.051560 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f59034-2a0d-45a2-8af4-21b37e667720 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:42.057077 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 508/988] 10.222.0.40 () {56 vars in 1112 bytes} [Thu Jul 14 09:25:41 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:25:42.062832 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f59034-2a0d-45a2-8af4-21b37e667720 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:42.103268 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 481/989] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 14 09:25:41 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 09:25:42.111549 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b09527-4f87-4a16-a766-98e1f9889c8b None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:42.190903 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f59034-2a0d-45a2-8af4-21b37e667720 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:42.236367 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92352dc9-53b6-49e3-9dc1-5bbafa204dab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:42.236954 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92352dc9-53b6-49e3-9dc1-5bbafa204dab None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:42.237245 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92352dc9-53b6-49e3-9dc1-5bbafa204dab None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:42.237528 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92352dc9-53b6-49e3-9dc1-5bbafa204dab None admin] PATH_INFO: `/v3/endpoints` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:42.238329 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b09527-4f87-4a16-a766-98e1f9889c8b None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:42.238745 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92352dc9-53b6-49e3-9dc1-5bbafa204dab None admin] RBAC: Adding query filter params (interface=public, service_id=8e7bef561d124000a9a7bd122aa48674, region_id=RegionOne) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:42.239065 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92352dc9-53b6-49e3-9dc1-5bbafa204dab None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:42.240621 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92352dc9-53b6-49e3-9dc1-5bbafa204dab None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:42.251166 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 509/990] 10.222.0.40 () {56 vars in 1251 bytes} [Thu Jul 14 09:25:42 2022] GET /identity/v3/endpoints?service_id=8e7bef561d124000a9a7bd122aa48674&interface=public®ion_id=RegionOne => generated 194 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:25:42.252992 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92352dc9-53b6-49e3-9dc1-5bbafa204dab None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:42.258142 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:42.290178 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c0dfb2-6695-48f0-81f3-8f0121b8afd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:42.291342 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c0dfb2-6695-48f0-81f3-8f0121b8afd9 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:42.292326 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c0dfb2-6695-48f0-81f3-8f0121b8afd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:42.293070 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c0dfb2-6695-48f0-81f3-8f0121b8afd9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:42.305634 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:42.308413 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c0dfb2-6695-48f0-81f3-8f0121b8afd9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:42.310073 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c0dfb2-6695-48f0-81f3-8f0121b8afd9 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:42.329043 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-84c0dfb2-6695-48f0-81f3-8f0121b8afd9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:25:42.329043 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:25:42.329043 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:25:42.329043 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:25:42.329043 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:25:42.329043 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:25:42.329043 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:25:42.329043 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:25:42.329043 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:25:42.329043 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:25:42.329043 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:25:42.329043 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:25:42.329043 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 09:25:42.329043 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 09:25:42.329043 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 09:25:42.330104 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 09:25:42.330104 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:25:42.330104 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:25:42.330104 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:25:42.330104 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:25:42.330104 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:25:42.330104 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:25:42.330104 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:25:42.330104 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( Jul 14 09:25:42.330104 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:25:42.330104 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:25:42.330104 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:25:42.330104 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:25:42.330104 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:25:42.330104 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:25:42.330104 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:25:42.330104 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:25:42.331110 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 09:25:42.331110 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 09:25:42.331110 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:25:42.331110 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:25:42.331110 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 482/991] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 09:25:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 09:25:42.336761 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c0dfb2-6695-48f0-81f3-8f0121b8afd9 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:42.386214 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92352dc9-53b6-49e3-9dc1-5bbafa204dab None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:42.425144 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9547fc-3ce3-4781-8fd2-8ba9b57fb866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:42.425833 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9547fc-3ce3-4781-8fd2-8ba9b57fb866 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:42.426166 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9547fc-3ce3-4781-8fd2-8ba9b57fb866 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:42.426465 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9547fc-3ce3-4781-8fd2-8ba9b57fb866 None admin] PATH_INFO: `/v3/services` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:42.427164 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9547fc-3ce3-4781-8fd2-8ba9b57fb866 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:42.428537 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9547fc-3ce3-4781-8fd2-8ba9b57fb866 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:42.446216 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 510/992] 10.222.0.40 () {56 vars in 1087 bytes} [Thu Jul 14 09:25:42 2022] GET /identity/v3/services => generated 1727 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:25:42.479774 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c0dfb2-6695-48f0-81f3-8f0121b8afd9 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:42.521947 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9f009d-6422-4289-b952-702fd9c1d586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:42.522649 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9f009d-6422-4289-b952-702fd9c1d586 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:42.522940 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9f009d-6422-4289-b952-702fd9c1d586 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:42.523215 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9f009d-6422-4289-b952-702fd9c1d586 None admin] PATH_INFO: `/v3/domains` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:42.523980 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9f009d-6422-4289-b952-702fd9c1d586 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:42.524290 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9f009d-6422-4289-b952-702fd9c1d586 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:42.525726 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9f009d-6422-4289-b952-702fd9c1d586 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:42.544754 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 483/993] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 14 09:25:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:25:42.555873 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9547fc-3ce3-4781-8fd2-8ba9b57fb866 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:42.677163 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9547fc-3ce3-4781-8fd2-8ba9b57fb866 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:42.678746 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:42.717827 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3e5c99-daf5-4ee8-aa79-7d0fecd3e996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:42.718670 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3e5c99-daf5-4ee8-aa79-7d0fecd3e996 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:42.718956 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3e5c99-daf5-4ee8-aa79-7d0fecd3e996 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:42.719233 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3e5c99-daf5-4ee8-aa79-7d0fecd3e996 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:42.726653 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3e5c99-daf5-4ee8-aa79-7d0fecd3e996 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:42.728125 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3e5c99-daf5-4ee8-aa79-7d0fecd3e996 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:42.743186 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-fd3e5c99-daf5-4ee8-aa79-7d0fecd3e996 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 09:25:42.743186 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:25:42.743186 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:25:42.743186 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:25:42.743186 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:25:42.743186 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:25:42.743186 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:25:42.743186 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:25:42.743186 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:25:42.743186 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:25:42.743186 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:25:42.743186 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:25:42.743186 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 09:25:42.743186 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 09:25:42.743186 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 09:25:42.744791 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 09:25:42.744791 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:25:42.744791 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:25:42.744791 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:25:42.744791 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:25:42.744791 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:25:42.744791 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:25:42.744791 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:25:42.744791 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( Jul 14 09:25:42.744791 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:25:42.744791 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:25:42.744791 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:25:42.744791 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:25:42.744791 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:25:42.744791 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:25:42.744791 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:25:42.744791 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:25:42.746496 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 09:25:42.746496 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 09:25:42.746496 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 09:25:42.746496 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 09:25:42.746496 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 09:25:42.746496 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 09:25:42.746496 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 09:25:42.746496 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Jul 14 09:25:42.748037 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 511/994] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jul 14 09:25:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:25:42.750856 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9f009d-6422-4289-b952-702fd9c1d586 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:42.782846 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:42.882342 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9f009d-6422-4289-b952-702fd9c1d586 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:42.924479 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1d492a-acb7-4c6a-b883-0176b42ed4bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:42.925148 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1d492a-acb7-4c6a-b883-0176b42ed4bf None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:42.927582 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1d492a-acb7-4c6a-b883-0176b42ed4bf None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:42.927582 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1d492a-acb7-4c6a-b883-0176b42ed4bf None admin] PATH_INFO: `/v3/projects` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:42.927582 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1d492a-acb7-4c6a-b883-0176b42ed4bf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:42.927582 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1d492a-acb7-4c6a-b883-0176b42ed4bf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:42.928776 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1d492a-acb7-4c6a-b883-0176b42ed4bf None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:42.950247 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 484/995] 10.222.0.40 () {56 vars in 1148 bytes} [Thu Jul 14 09:25:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:25:42.953642 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3e5c99-daf5-4ee8-aa79-7d0fecd3e996 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:43.066456 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3e5c99-daf5-4ee8-aa79-7d0fecd3e996 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:43.103932 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26730c78-de92-4214-ad31-20fce5c5e317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:43.104601 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26730c78-de92-4214-ad31-20fce5c5e317 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:43.104910 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26730c78-de92-4214-ad31-20fce5c5e317 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:43.105162 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26730c78-de92-4214-ad31-20fce5c5e317 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:43.106209 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26730c78-de92-4214-ad31-20fce5c5e317 None admin] RBAC: Adding query filter params (role.id=717b56da664944778c6bfc5e1c95909f, scope.project.id=a478e76f04dd413f89ddfba7b0cdc9cc, user.id=6cf35868f9ff46e2835a6cc023641da6) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:43.106454 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26730c78-de92-4214-ad31-20fce5c5e317 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:43.107860 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26730c78-de92-4214-ad31-20fce5c5e317 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:43.122287 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 512/996] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jul 14 09:25:42 2022] GET /identity/v3/role_assignments?user.id=6cf35868f9ff46e2835a6cc023641da6&scope.project.id=a478e76f04dd413f89ddfba7b0cdc9cc&role.id=717b56da664944778c6bfc5e1c95909f => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:25:43.791690 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74e7af0-9889-472e-a425-f27a6885e721 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:43.792218 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74e7af0-9889-472e-a425-f27a6885e721 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:43.792218 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74e7af0-9889-472e-a425-f27a6885e721 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:43.793754 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 485/997] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:25:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:25:43.799448 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff220380-3d2e-4eb4-886a-3745d420d18e None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:43.799745 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff220380-3d2e-4eb4-886a-3745d420d18e None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:43.800025 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff220380-3d2e-4eb4-886a-3745d420d18e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:43.818461 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-ff220380-3d2e-4eb4-886a-3745d420d18e None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:25:43.819694 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-ff220380-3d2e-4eb4-886a-3745d420d18e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:43.847365 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:43.915059 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 513/998] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:25:43 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 09:25:43.937971 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74e7af0-9889-472e-a425-f27a6885e721 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:44.035178 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:44.060518 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74e7af0-9889-472e-a425-f27a6885e721 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:44.108784 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc46242-98b1-491e-80e3-39ee883ffb9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:44.109932 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc46242-98b1-491e-80e3-39ee883ffb9f None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:44.110404 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc46242-98b1-491e-80e3-39ee883ffb9f None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:44.110839 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc46242-98b1-491e-80e3-39ee883ffb9f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:44.111894 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc46242-98b1-491e-80e3-39ee883ffb9f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:44.114132 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc46242-98b1-491e-80e3-39ee883ffb9f None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:44.135611 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-6fc46242-98b1-491e-80e3-39ee883ffb9f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 09:25:44.135611 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:25:44.135611 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 09:25:44.135611 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 09:25:44.135611 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 09:25:44.135611 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 09:25:44.135611 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 09:25:44.135611 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 09:25:44.135611 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 09:25:44.135611 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:25:44.135611 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 09:25:44.135611 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:25:44.135611 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:25:44.135611 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:25:44.135611 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:25:44.135611 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:25:44.135611 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:25:44.136677 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:25:44.136677 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:25:44.136677 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:25:44.136677 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:25:44.136677 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:25:44.136677 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:25:44.136677 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 09:25:44.136677 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 09:25:44.136677 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 09:25:44.136677 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 09:25:44.136677 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:25:44.136677 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:25:44.136677 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:25:44.136677 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:25:44.136677 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:25:44.136677 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:25:44.143455 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:25:44.143455 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( Jul 14 09:25:44.143455 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:25:44.143455 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:25:44.143455 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:25:44.143455 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:25:44.143455 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:25:44.143455 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:25:44.143455 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:25:44.143455 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:25:44.143455 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 09:25:44.143455 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 09:25:44.143455 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 09:25:44.143455 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:25:44.143455 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 486/999] 10.222.0.40 () {56 vars in 1126 bytes} [Thu Jul 14 09:25:43 2022] GET /identity/v3/services/object-store => generated 93 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:25:44.146955 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff220380-3d2e-4eb4-886a-3745d420d18e None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:44.261152 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff220380-3d2e-4eb4-886a-3745d420d18e None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:44.298900 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3111ca72-cd06-43be-a869-f4e74b7a8767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:44.299595 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3111ca72-cd06-43be-a869-f4e74b7a8767 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:44.299895 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3111ca72-cd06-43be-a869-f4e74b7a8767 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:44.300150 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3111ca72-cd06-43be-a869-f4e74b7a8767 None admin] PATH_INFO: `/v3/services` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:44.301432 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3111ca72-cd06-43be-a869-f4e74b7a8767 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:44.301743 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3111ca72-cd06-43be-a869-f4e74b7a8767 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:44.303210 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3111ca72-cd06-43be-a869-f4e74b7a8767 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:44.314041 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 514/1000] 10.222.0.40 () {56 vars in 1122 bytes} [Thu Jul 14 09:25:44 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:25:44.315967 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc46242-98b1-491e-80e3-39ee883ffb9f None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:44.445862 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc46242-98b1-491e-80e3-39ee883ffb9f None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:44.481911 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ffd8b6-bbd4-4952-932b-b9be2b36bd7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:44.482674 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ffd8b6-bbd4-4952-932b-b9be2b36bd7f None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:44.483029 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ffd8b6-bbd4-4952-932b-b9be2b36bd7f None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:44.483265 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ffd8b6-bbd4-4952-932b-b9be2b36bd7f None admin] PATH_INFO: `/v3/services` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:44.483890 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ffd8b6-bbd4-4952-932b-b9be2b36bd7f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:44.484203 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ffd8b6-bbd4-4952-932b-b9be2b36bd7f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:44.485580 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ffd8b6-bbd4-4952-932b-b9be2b36bd7f None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:44.491850 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 487/1001] 10.222.0.40 () {56 vars in 1122 bytes} [Thu Jul 14 09:25:44 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:25:44.497563 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3111ca72-cd06-43be-a869-f4e74b7a8767 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:44.521398 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:44.572553 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b481071c-2d76-4211-82f0-7518bade4051 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:44.572858 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b481071c-2d76-4211-82f0-7518bade4051 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:44.573137 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b481071c-2d76-4211-82f0-7518bade4051 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:44.574621 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 488/1002] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:25:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:25:44.582912 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4d1d10-b677-49ef-9a59-e4b6afdfe51a None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:44.583231 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4d1d10-b677-49ef-9a59-e4b6afdfe51a None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:44.583486 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4d1d10-b677-49ef-9a59-e4b6afdfe51a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:44.600486 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-be4d1d10-b677-49ef-9a59-e4b6afdfe51a None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:25:44.601697 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-be4d1d10-b677-49ef-9a59-e4b6afdfe51a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:44.604817 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:44.639929 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3111ca72-cd06-43be-a869-f4e74b7a8767 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:44.684776 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 489/1003] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:25:44 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 09:25:44.690628 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d603e72-44b9-47da-8324-a59a6d5386c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:44.691312 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d603e72-44b9-47da-8324-a59a6d5386c3 None admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:44.691638 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d603e72-44b9-47da-8324-a59a6d5386c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:44.691926 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d603e72-44b9-47da-8324-a59a6d5386c3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:44.692695 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d603e72-44b9-47da-8324-a59a6d5386c3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:44.694232 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d603e72-44b9-47da-8324-a59a6d5386c3 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:44.709481 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4d1d10-b677-49ef-9a59-e4b6afdfe51a None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:44.716071 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 515/1004] 10.222.0.40 () {60 vars in 1144 bytes} [Thu Jul 14 09:25:44 2022] POST /identity/v3/endpoints => generated 325 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:25:44.848642 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4d1d10-b677-49ef-9a59-e4b6afdfe51a None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:44.899283 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d827963-cc39-473e-b537-d6c76adedfcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:44.900127 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d827963-cc39-473e-b537-d6c76adedfcb None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:44.900381 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d827963-cc39-473e-b537-d6c76adedfcb None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:44.900660 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d827963-cc39-473e-b537-d6c76adedfcb None admin] PATH_INFO: `/v3/services/compute` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:44.901327 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d827963-cc39-473e-b537-d6c76adedfcb None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:44.902758 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d827963-cc39-473e-b537-d6c76adedfcb None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:44.905783 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:44.917409 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-8d827963-cc39-473e-b537-d6c76adedfcb None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 14 09:25:44.917409 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:25:44.917409 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 09:25:44.917409 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 09:25:44.917409 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 09:25:44.917409 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 09:25:44.917409 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 09:25:44.917409 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 09:25:44.917409 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 14 09:25:44.917409 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:25:44.917409 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 09:25:44.917409 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:25:44.917409 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:25:44.917409 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:25:44.917409 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:25:44.917409 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:25:44.917409 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:25:44.919138 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:25:44.919138 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:25:44.919138 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:25:44.919138 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:25:44.919138 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:25:44.919138 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:25:44.919138 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 09:25:44.919138 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 09:25:44.919138 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 09:25:44.919138 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 09:25:44.919138 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:25:44.919138 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:25:44.919138 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:25:44.919138 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:25:44.919138 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:25:44.919138 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:25:44.920097 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:25:44.920097 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( Jul 14 09:25:44.920097 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:25:44.920097 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:25:44.920097 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:25:44.920097 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:25:44.920097 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:25:44.920097 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:25:44.920097 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:25:44.920097 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:25:44.920097 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 09:25:44.920097 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 09:25:44.920097 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 14 09:25:44.920097 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:25:44.925537 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 490/1005] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jul 14 09:25:44 2022] GET /identity/v3/services/compute => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 09:25:44.938009 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d603e72-44b9-47da-8324-a59a6d5386c3 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:45.037711 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:45.060791 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d603e72-44b9-47da-8324-a59a6d5386c3 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:45.097461 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd39bef-b920-4dde-a47a-99efa36cda7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:45.098829 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd39bef-b920-4dde-a47a-99efa36cda7b None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:45.099177 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd39bef-b920-4dde-a47a-99efa36cda7b None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:45.099363 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd39bef-b920-4dde-a47a-99efa36cda7b None admin] PATH_INFO: `/v3/services` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:45.100063 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd39bef-b920-4dde-a47a-99efa36cda7b None admin] RBAC: Adding query filter params (name=compute) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:45.100369 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd39bef-b920-4dde-a47a-99efa36cda7b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:45.101745 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd39bef-b920-4dde-a47a-99efa36cda7b None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:45.107759 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 516/1006] 10.222.0.40 () {56 vars in 1112 bytes} [Thu Jul 14 09:25:44 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:25:45.113420 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d827963-cc39-473e-b537-d6c76adedfcb None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:45.225496 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d827963-cc39-473e-b537-d6c76adedfcb None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:45.253883 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6432aed-e5f4-483e-9746-433473c1ca7a None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:45.254434 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6432aed-e5f4-483e-9746-433473c1ca7a None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:45.254547 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6432aed-e5f4-483e-9746-433473c1ca7a None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:45.256121 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 517/1007] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:25:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:25:45.261354 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaabd15-5ba0-46b8-a728-eaf40dd9d7df None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:45.261640 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaabd15-5ba0-46b8-a728-eaf40dd9d7df None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:45.261919 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaabd15-5ba0-46b8-a728-eaf40dd9d7df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:45.266588 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becaf02e-4543-4505-b71e-12aaa048ba29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:45.267264 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becaf02e-4543-4505-b71e-12aaa048ba29 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:45.267548 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becaf02e-4543-4505-b71e-12aaa048ba29 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:45.267823 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becaf02e-4543-4505-b71e-12aaa048ba29 None admin] PATH_INFO: `/v3/services` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:45.268550 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becaf02e-4543-4505-b71e-12aaa048ba29 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:45.268857 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becaf02e-4543-4505-b71e-12aaa048ba29 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:45.270803 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becaf02e-4543-4505-b71e-12aaa048ba29 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:45.276680 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 491/1008] 10.222.0.40 () {56 vars in 1112 bytes} [Thu Jul 14 09:25:45 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:25:45.282457 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becaf02e-4543-4505-b71e-12aaa048ba29 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:45.282587 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-aeaabd15-5ba0-46b8-a728-eaf40dd9d7df None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:25:45.283838 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-aeaabd15-5ba0-46b8-a728-eaf40dd9d7df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:45.361603 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 518/1009] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:25:45 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 09:25:45.378672 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:45.384583 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaabd15-5ba0-46b8-a728-eaf40dd9d7df None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:45.438258 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becaf02e-4543-4505-b71e-12aaa048ba29 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:45.489446 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:45.497412 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fa951f-50a5-478e-a061-636d95b2d97d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:45.498092 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fa951f-50a5-478e-a061-636d95b2d97d None admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:45.498546 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fa951f-50a5-478e-a061-636d95b2d97d None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:45.498800 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fa951f-50a5-478e-a061-636d95b2d97d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:45.499634 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fa951f-50a5-478e-a061-636d95b2d97d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:45.501142 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fa951f-50a5-478e-a061-636d95b2d97d None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:45.522221 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaabd15-5ba0-46b8-a728-eaf40dd9d7df None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:45.527877 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 492/1010] 10.222.0.40 () {60 vars in 1144 bytes} [Thu Jul 14 09:25:45 2022] POST /identity/v3/endpoints => generated 334 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:25:45.594218 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf6225f-bd55-4fc0-87a5-416a0101b159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:45.595070 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf6225f-bd55-4fc0-87a5-416a0101b159 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:45.595360 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf6225f-bd55-4fc0-87a5-416a0101b159 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:45.595639 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf6225f-bd55-4fc0-87a5-416a0101b159 None admin] PATH_INFO: `/v3/services/image` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:45.596320 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf6225f-bd55-4fc0-87a5-416a0101b159 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:45.597855 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf6225f-bd55-4fc0-87a5-416a0101b159 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:45.611327 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-1bf6225f-bd55-4fc0-87a5-416a0101b159 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 14 09:25:45.611327 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:25:45.611327 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 09:25:45.611327 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 09:25:45.611327 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 09:25:45.611327 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 09:25:45.611327 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 09:25:45.611327 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 09:25:45.611327 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 14 09:25:45.611327 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Jul 14 09:25:45.611327 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 09:25:45.611327 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Jul 14 09:25:45.611327 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:25:45.611327 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:25:45.611327 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:25:45.611327 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:25:45.611327 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:25:45.612526 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:25:45.612526 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:25:45.612526 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:25:45.612526 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:25:45.612526 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:25:45.612526 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:25:45.612526 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 09:25:45.612526 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 09:25:45.612526 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 09:25:45.612526 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 09:25:45.612526 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:25:45.612526 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:25:45.612526 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:25:45.612526 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:25:45.612526 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:25:45.612526 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:25:45.618908 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:25:45.618908 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( Jul 14 09:25:45.618908 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:25:45.618908 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:25:45.618908 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:25:45.618908 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:25:45.618908 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:25:45.618908 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:25:45.618908 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:25:45.618908 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:25:45.618908 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 09:25:45.618908 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 09:25:45.618908 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 14 09:25:45.618908 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Jul 14 09:25:45.618908 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 519/1011] 10.222.0.40 () {56 vars in 1105 bytes} [Thu Jul 14 09:25:45 2022] GET /identity/v3/services/image => generated 86 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 09:25:45.619695 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fa951f-50a5-478e-a061-636d95b2d97d None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:45.744126 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fa951f-50a5-478e-a061-636d95b2d97d None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:45.767147 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:45.787600 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52857b37-9cb8-4555-bace-1f2cd4b1be30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:45.788366 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52857b37-9cb8-4555-bace-1f2cd4b1be30 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:45.788652 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52857b37-9cb8-4555-bace-1f2cd4b1be30 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:45.789030 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52857b37-9cb8-4555-bace-1f2cd4b1be30 None admin] PATH_INFO: `/v3/services` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:45.789863 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52857b37-9cb8-4555-bace-1f2cd4b1be30 None admin] RBAC: Adding query filter params (name=image) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:45.790253 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52857b37-9cb8-4555-bace-1f2cd4b1be30 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:45.791930 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52857b37-9cb8-4555-bace-1f2cd4b1be30 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:45.798402 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 493/1012] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 09:25:45 2022] GET /identity/v3/services?name=image => generated 122 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:25:45.804783 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf6225f-bd55-4fc0-87a5-416a0101b159 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:45.957484 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf6225f-bd55-4fc0-87a5-416a0101b159 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:45.996816 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019b7142-c821-4551-929f-ae955df496f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:45.997485 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019b7142-c821-4551-929f-ae955df496f1 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:45.997805 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019b7142-c821-4551-929f-ae955df496f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:45.998148 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019b7142-c821-4551-929f-ae955df496f1 None admin] PATH_INFO: `/v3/services` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:45.998994 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019b7142-c821-4551-929f-ae955df496f1 None admin] RBAC: Adding query filter params (type=image) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:45.999397 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019b7142-c821-4551-929f-ae955df496f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:46.006040 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019b7142-c821-4551-929f-ae955df496f1 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:46.008112 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:46.022224 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 520/1013] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 09:25:45 2022] GET /identity/v3/services?type=image => generated 122 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:25:46.852227 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678f6fe1-a7e9-4575-b816-6e641e43efe6 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:46.853023 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678f6fe1-a7e9-4575-b816-6e641e43efe6 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:46.853023 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678f6fe1-a7e9-4575-b816-6e641e43efe6 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:46.858242 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 494/1014] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:25:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:25:46.862565 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c94c8b-464e-42fd-aa62-d713e154ebe6 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:46.863158 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c94c8b-464e-42fd-aa62-d713e154ebe6 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:46.863523 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c94c8b-464e-42fd-aa62-d713e154ebe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:46.892518 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-72c94c8b-464e-42fd-aa62-d713e154ebe6 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:25:46.895102 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-72c94c8b-464e-42fd-aa62-d713e154ebe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:46.978232 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 521/1015] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:25:46 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 09:25:47.001250 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678f6fe1-a7e9-4575-b816-6e641e43efe6 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:47.126618 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678f6fe1-a7e9-4575-b816-6e641e43efe6 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:47.165941 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae5cb6f-f572-4780-98f4-9bae39d6bc1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:47.166850 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae5cb6f-f572-4780-98f4-9bae39d6bc1c None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:47.167225 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae5cb6f-f572-4780-98f4-9bae39d6bc1c None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:47.167603 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae5cb6f-f572-4780-98f4-9bae39d6bc1c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:47.168828 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae5cb6f-f572-4780-98f4-9bae39d6bc1c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:47.170291 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae5cb6f-f572-4780-98f4-9bae39d6bc1c None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:47.177843 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 495/1016] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 09:25:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:25:47.179439 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c94c8b-464e-42fd-aa62-d713e154ebe6 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:47.306296 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c94c8b-464e-42fd-aa62-d713e154ebe6 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:47.337824 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:47.348543 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf037f6-35a6-4564-beff-1534182bc581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:47.349263 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf037f6-35a6-4564-beff-1534182bc581 None admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:47.349555 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf037f6-35a6-4564-beff-1534182bc581 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:47.349896 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf037f6-35a6-4564-beff-1534182bc581 None admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:47.350721 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf037f6-35a6-4564-beff-1534182bc581 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:47.352271 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf037f6-35a6-4564-beff-1534182bc581 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:47.386318 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 522/1017] 10.222.0.40 () {60 vars in 1141 bytes} [Thu Jul 14 09:25:47 2022] POST /identity/v3/projects => generated 311 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 09:25:47.808938 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ec9985-6210-43f2-b28f-8533ce84305f None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:47.809345 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ec9985-6210-43f2-b28f-8533ce84305f None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:47.809567 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ec9985-6210-43f2-b28f-8533ce84305f None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:47.811246 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 496/1018] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:25:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:25:47.816633 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10a9a28-50fc-4c14-b66b-68c016c9c034 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:47.816926 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10a9a28-50fc-4c14-b66b-68c016c9c034 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:47.817212 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10a9a28-50fc-4c14-b66b-68c016c9c034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:47.835512 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-f10a9a28-50fc-4c14-b66b-68c016c9c034 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:25:47.836724 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-f10a9a28-50fc-4c14-b66b-68c016c9c034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:47.913518 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 523/1019] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:25:47 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 09:25:47.937097 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ec9985-6210-43f2-b28f-8533ce84305f None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:48.003027 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:48.069200 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ec9985-6210-43f2-b28f-8533ce84305f None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:48.126131 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd657f9-c910-4030-bd13-5a181153b3af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:48.127316 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd657f9-c910-4030-bd13-5a181153b3af None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:48.127811 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd657f9-c910-4030-bd13-5a181153b3af None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:48.128262 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd657f9-c910-4030-bd13-5a181153b3af None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:48.143494 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd657f9-c910-4030-bd13-5a181153b3af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:25:48.153688 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-2bd657f9-c910-4030-bd13-5a181153b3af None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 14 09:25:48.153688 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:25:48.153688 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:25:48.153688 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:25:48.153688 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:25:48.153688 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:25:48.153688 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:25:48.153688 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:25:48.153688 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:25:48.153688 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:25:48.153688 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:25:48.153688 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:25:48.153688 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:25:48.153688 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:25:48.153688 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:25:48.153688 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:25:48.155887 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:25:48.155887 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:25:48.155887 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:25:48.155887 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:25:48.155887 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:25:48.155887 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:25:48.155887 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:25:48.155887 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:25:48.155887 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:25:48.155887 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:25:48.155887 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:25:48.155887 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( Jul 14 09:25:48.155887 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:25:48.155887 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:25:48.155887 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:25:48.155887 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:25:48.156822 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:25:48.156822 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:25:48.156822 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:25:48.156822 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:25:48.156822 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:25:48.156822 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:25:48.156822 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:25:48.156822 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:25:48.156822 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:25:48.156822 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:25:48.156822 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 14 09:25:48.156822 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:25:48.159063 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 497/1020] 10.222.0.40 () {56 vars in 1120 bytes} [Thu Jul 14 09:25:47 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:25:48.162129 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10a9a28-50fc-4c14-b66b-68c016c9c034 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:48.212709 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b65462-7778-4e6a-8691-6fde5ce98614 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:48.213376 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b65462-7778-4e6a-8691-6fde5ce98614 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:48.213851 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b65462-7778-4e6a-8691-6fde5ce98614 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:48.215732 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 498/1021] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:25:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:25:48.222229 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf00c35-3509-456b-ab3b-287c484f7106 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:48.223076 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf00c35-3509-456b-ab3b-287c484f7106 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:48.223795 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf00c35-3509-456b-ab3b-287c484f7106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:48.247387 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-edf00c35-3509-456b-ab3b-287c484f7106 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:25:48.248932 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-edf00c35-3509-456b-ab3b-287c484f7106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:48.285199 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10a9a28-50fc-4c14-b66b-68c016c9c034 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:48.297313 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:48.327169 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b07b23-3dd8-443e-b567-e95ee2776da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:48.327884 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b07b23-3dd8-443e-b567-e95ee2776da2 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:48.328238 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b07b23-3dd8-443e-b567-e95ee2776da2 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:48.328622 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b07b23-3dd8-443e-b567-e95ee2776da2 None admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:48.329401 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b07b23-3dd8-443e-b567-e95ee2776da2 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:48.329755 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b07b23-3dd8-443e-b567-e95ee2776da2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:48.331153 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b07b23-3dd8-443e-b567-e95ee2776da2 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:48.332825 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 499/1022] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:25:48 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 09:25:48.346044 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 524/1023] 10.222.0.40 () {56 vars in 1115 bytes} [Thu Jul 14 09:25:48 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:25:48.347700 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf00c35-3509-456b-ab3b-287c484f7106 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:48.357859 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b07b23-3dd8-443e-b567-e95ee2776da2 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:48.399993 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:48.478465 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b07b23-3dd8-443e-b567-e95ee2776da2 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:48.487576 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf00c35-3509-456b-ab3b-287c484f7106 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:48.515896 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31a0adc-a125-4a71-bca9-611fd4ad6f69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:48.516575 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31a0adc-a125-4a71-bca9-611fd4ad6f69 None admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:48.516880 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31a0adc-a125-4a71-bca9-611fd4ad6f69 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:48.517134 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31a0adc-a125-4a71-bca9-611fd4ad6f69 None admin] PATH_INFO: `/v3/services` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:48.517865 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31a0adc-a125-4a71-bca9-611fd4ad6f69 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:48.519286 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31a0adc-a125-4a71-bca9-611fd4ad6f69 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:48.548441 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9d501d-6b42-4b9c-ba2f-426e5b1c0407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:48.549372 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9d501d-6b42-4b9c-ba2f-426e5b1c0407 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:48.549664 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9d501d-6b42-4b9c-ba2f-426e5b1c0407 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:48.549945 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9d501d-6b42-4b9c-ba2f-426e5b1c0407 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:48.550693 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 525/1024] 10.222.0.40 () {60 vars in 1141 bytes} [Thu Jul 14 09:25:48 2022] POST /identity/v3/services => generated 242 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 09:25:48.569106 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9d501d-6b42-4b9c-ba2f-426e5b1c0407 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:48.570783 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9d501d-6b42-4b9c-ba2f-426e5b1c0407 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:48.590733 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-4d9d501d-6b42-4b9c-ba2f-426e5b1c0407 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:25:48.590733 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:25:48.590733 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:25:48.590733 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:25:48.590733 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:25:48.590733 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:25:48.590733 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:25:48.590733 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:25:48.590733 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:25:48.590733 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:25:48.590733 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:25:48.590733 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:25:48.590733 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 09:25:48.590733 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 09:25:48.590733 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 09:25:48.598959 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 09:25:48.598959 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:25:48.598959 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:25:48.598959 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:25:48.598959 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:25:48.598959 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:25:48.598959 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:25:48.598959 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:25:48.598959 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( Jul 14 09:25:48.598959 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:25:48.598959 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:25:48.598959 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:25:48.598959 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:25:48.598959 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:25:48.598959 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:25:48.598959 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:25:48.598959 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:25:48.600514 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 09:25:48.600514 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 09:25:48.600514 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:25:48.600514 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:25:48.600514 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 500/1025] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 09:25:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:25:48.604129 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31a0adc-a125-4a71-bca9-611fd4ad6f69 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:48.647853 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:48.742075 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31a0adc-a125-4a71-bca9-611fd4ad6f69 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:48.779859 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc82fbd-8e17-4963-94b1-f72311ba8e49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:48.780542 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc82fbd-8e17-4963-94b1-f72311ba8e49 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:48.780828 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc82fbd-8e17-4963-94b1-f72311ba8e49 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:48.781107 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc82fbd-8e17-4963-94b1-f72311ba8e49 None admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:48.781842 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc82fbd-8e17-4963-94b1-f72311ba8e49 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:48.782153 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc82fbd-8e17-4963-94b1-f72311ba8e49 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:48.783568 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc82fbd-8e17-4963-94b1-f72311ba8e49 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:48.801501 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 526/1026] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 14 09:25:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:25:48.802814 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9d501d-6b42-4b9c-ba2f-426e5b1c0407 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:48.904596 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:48.917296 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9d501d-6b42-4b9c-ba2f-426e5b1c0407 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:48.953081 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384d9ad6-fec0-495a-a207-746d45c943d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:48.953961 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384d9ad6-fec0-495a-a207-746d45c943d3 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:48.954350 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384d9ad6-fec0-495a-a207-746d45c943d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:48.954484 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384d9ad6-fec0-495a-a207-746d45c943d3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:48.962940 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384d9ad6-fec0-495a-a207-746d45c943d3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:48.964392 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384d9ad6-fec0-495a-a207-746d45c943d3 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:48.983301 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-384d9ad6-fec0-495a-a207-746d45c943d3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 14 09:25:48.983301 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:25:48.983301 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:25:48.983301 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:25:48.983301 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:25:48.983301 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:25:48.983301 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:25:48.983301 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:25:48.983301 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:25:48.983301 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:25:48.983301 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:25:48.983301 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:25:48.983301 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 09:25:48.983301 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 09:25:48.983301 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 09:25:48.983301 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 09:25:48.984341 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:25:48.984341 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:25:48.984341 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 09:25:48.984341 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 09:25:48.984341 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 09:25:48.984341 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 09:25:48.984341 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:25:48.984341 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:25:48.984341 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:25:48.984341 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:25:48.984341 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:25:48.984341 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( Jul 14 09:25:48.984341 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:25:48.984341 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:25:48.984341 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:25:48.984341 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:25:48.984341 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:25:48.984341 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:25:48.985290 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:25:48.985290 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:25:48.985290 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 09:25:48.985290 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 09:25:48.985290 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 09:25:48.985290 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 09:25:48.985290 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 09:25:48.985290 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 09:25:48.985290 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 14 09:25:48.985290 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:25:48.985290 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 501/1027] 10.222.0.40 () {56 vars in 1093 bytes} [Thu Jul 14 09:25:48 2022] GET /identity/v3/users/nova => generated 82 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:25:48.991974 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc82fbd-8e17-4963-94b1-f72311ba8e49 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:49.103534 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:49.120428 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc82fbd-8e17-4963-94b1-f72311ba8e49 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:49.166980 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaedac4-0e41-4238-8906-c4651960bfc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:49.167582 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaedac4-0e41-4238-8906-c4651960bfc8 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:49.167863 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaedac4-0e41-4238-8906-c4651960bfc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:49.168136 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaedac4-0e41-4238-8906-c4651960bfc8 None admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:49.168989 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaedac4-0e41-4238-8906-c4651960bfc8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:49.169297 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaedac4-0e41-4238-8906-c4651960bfc8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:49.170876 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaedac4-0e41-4238-8906-c4651960bfc8 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:49.190382 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 527/1028] 10.222.0.40 () {56 vars in 1133 bytes} [Thu Jul 14 09:25:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:25:49.196373 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384d9ad6-fec0-495a-a207-746d45c943d3 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:49.316933 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384d9ad6-fec0-495a-a207-746d45c943d3 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:49.353082 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c234f068-f17d-44f9-8487-1442700a554f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:49.353744 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c234f068-f17d-44f9-8487-1442700a554f None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:49.354027 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c234f068-f17d-44f9-8487-1442700a554f None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:49.354336 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c234f068-f17d-44f9-8487-1442700a554f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:49.374766 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:49.445566 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c234f068-f17d-44f9-8487-1442700a554f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:49.448041 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c234f068-f17d-44f9-8487-1442700a554f None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:49.572295 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 502/1029] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 14 09:25:49 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 09:25:49.578620 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaedac4-0e41-4238-8906-c4651960bfc8 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:49.588607 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e892f6-7386-4e1c-b013-b0943947d2f0 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:49.588892 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e892f6-7386-4e1c-b013-b0943947d2f0 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:49.589179 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e892f6-7386-4e1c-b013-b0943947d2f0 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:49.590874 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 503/1030] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:25:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 09:25:49.596423 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7861daf5-b5b7-4cd5-9ec4-4d2defb0a55f None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:49.596792 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7861daf5-b5b7-4cd5-9ec4-4d2defb0a55f None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:49.596959 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7861daf5-b5b7-4cd5-9ec4-4d2defb0a55f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:49.621918 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-7861daf5-b5b7-4cd5-9ec4-4d2defb0a55f None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:25:49.623198 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-7861daf5-b5b7-4cd5-9ec4-4d2defb0a55f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:49.680504 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:49.704627 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 504/1031] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:25:49 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 09:25:49.709471 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaedac4-0e41-4238-8906-c4651960bfc8 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:49.729250 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7861daf5-b5b7-4cd5-9ec4-4d2defb0a55f None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:49.772485 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3f71af-3e63-443d-b2f8-b797eb465f42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:49.773559 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3f71af-3e63-443d-b2f8-b797eb465f42 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:49.774011 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3f71af-3e63-443d-b2f8-b797eb465f42 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:49.774494 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3f71af-3e63-443d-b2f8-b797eb465f42 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:49.791101 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3f71af-3e63-443d-b2f8-b797eb465f42 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:49.793626 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3f71af-3e63-443d-b2f8-b797eb465f42 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:49.824286 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-4a3f71af-3e63-443d-b2f8-b797eb465f42 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:25:49.824286 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:25:49.824286 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:25:49.824286 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:25:49.824286 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:25:49.824286 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:25:49.824286 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:25:49.824286 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:25:49.824286 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:25:49.824286 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:25:49.824286 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:25:49.824286 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:25:49.824286 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 09:25:49.824286 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 09:25:49.824286 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 09:25:49.825444 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 09:25:49.825444 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:25:49.825444 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:25:49.825444 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:25:49.825444 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:25:49.825444 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:25:49.825444 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:25:49.825444 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:25:49.825444 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( Jul 14 09:25:49.825444 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:25:49.825444 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:25:49.825444 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:25:49.825444 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:25:49.825444 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:25:49.825444 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:25:49.825444 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:25:49.825444 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:25:49.831256 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 09:25:49.831256 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 09:25:49.831256 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:25:49.831256 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Jul 14 09:25:49.831256 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 528/1032] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 09:25:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 09:25:49.832221 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3f71af-3e63-443d-b2f8-b797eb465f42 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:49.835879 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:49.902509 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7861daf5-b5b7-4cd5-9ec4-4d2defb0a55f None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:49.943401 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb487f04-16a8-45be-84ae-408c055e5e00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:49.944200 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb487f04-16a8-45be-84ae-408c055e5e00 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:49.944483 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb487f04-16a8-45be-84ae-408c055e5e00 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:49.944765 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb487f04-16a8-45be-84ae-408c055e5e00 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:49.945944 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb487f04-16a8-45be-84ae-408c055e5e00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:49.947426 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb487f04-16a8-45be-84ae-408c055e5e00 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:49.949214 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 505/1033] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 09:25:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:25:49.954700 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb487f04-16a8-45be-84ae-408c055e5e00 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:49.981496 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3f71af-3e63-443d-b2f8-b797eb465f42 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:50.013685 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:50.026593 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae462813-7c01-428b-9524-9800f7a84c6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:50.027287 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae462813-7c01-428b-9524-9800f7a84c6d None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:50.027552 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae462813-7c01-428b-9524-9800f7a84c6d None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:50.027850 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae462813-7c01-428b-9524-9800f7a84c6d None admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:50.028564 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae462813-7c01-428b-9524-9800f7a84c6d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:50.028876 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae462813-7c01-428b-9524-9800f7a84c6d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:50.030265 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae462813-7c01-428b-9524-9800f7a84c6d None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:50.043212 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 529/1034] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 14 09:25:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:25:50.048623 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae462813-7c01-428b-9524-9800f7a84c6d None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:50.079752 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb487f04-16a8-45be-84ae-408c055e5e00 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:50.121364 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:50.124882 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0572088-1bed-44ac-8475-6c830864c230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:50.125570 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0572088-1bed-44ac-8475-6c830864c230 None admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:50.125859 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0572088-1bed-44ac-8475-6c830864c230 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:50.126141 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0572088-1bed-44ac-8475-6c830864c230 None admin] PATH_INFO: `/v3/users` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:50.126893 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0572088-1bed-44ac-8475-6c830864c230 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:50.128333 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0572088-1bed-44ac-8475-6c830864c230 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:50.158627 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 506/1035] 10.222.0.40 () {60 vars in 1132 bytes} [Thu Jul 14 09:25:49 2022] POST /identity/v3/users => generated 285 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 09:25:50.168571 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae462813-7c01-428b-9524-9800f7a84c6d None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:50.229831 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6561654-74fc-4e4c-ae50-a6f98e1324cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:50.230612 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6561654-74fc-4e4c-ae50-a6f98e1324cf None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:50.230893 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6561654-74fc-4e4c-ae50-a6f98e1324cf None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:50.231167 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6561654-74fc-4e4c-ae50-a6f98e1324cf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:50.240018 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6561654-74fc-4e4c-ae50-a6f98e1324cf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:50.241800 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6561654-74fc-4e4c-ae50-a6f98e1324cf None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:50.257179 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-a6561654-74fc-4e4c-ae50-a6f98e1324cf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 09:25:50.257179 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:25:50.257179 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:25:50.257179 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:25:50.257179 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:25:50.257179 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:25:50.257179 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:25:50.257179 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:25:50.257179 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:25:50.257179 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:25:50.257179 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:25:50.257179 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:25:50.257179 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 09:25:50.257179 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 09:25:50.257179 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 09:25:50.258164 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 09:25:50.258164 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:25:50.258164 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:25:50.258164 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:25:50.258164 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:25:50.258164 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:25:50.258164 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:25:50.258164 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:25:50.258164 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( Jul 14 09:25:50.258164 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:25:50.258164 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:25:50.258164 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:25:50.258164 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:25:50.258164 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:25:50.258164 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:25:50.258164 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:25:50.258164 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:25:50.259173 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 09:25:50.259173 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 09:25:50.259173 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 09:25:50.259173 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 09:25:50.259173 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 09:25:50.259173 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 09:25:50.259173 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 09:25:50.259173 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Jul 14 09:25:50.259173 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 530/1036] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jul 14 09:25:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:25:50.267576 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0572088-1bed-44ac-8475-6c830864c230 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:50.397242 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0572088-1bed-44ac-8475-6c830864c230 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:50.402169 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:50.442471 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb57342-c3d3-4d80-9fd2-50201c4ea348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:50.443149 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb57342-c3d3-4d80-9fd2-50201c4ea348 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:50.443435 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb57342-c3d3-4d80-9fd2-50201c4ea348 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:50.443714 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb57342-c3d3-4d80-9fd2-50201c4ea348 None admin] PATH_INFO: `/v3/projects` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:50.444516 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb57342-c3d3-4d80-9fd2-50201c4ea348 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:50.444830 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb57342-c3d3-4d80-9fd2-50201c4ea348 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:50.446305 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb57342-c3d3-4d80-9fd2-50201c4ea348 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:50.460251 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 507/1037] 10.222.0.40 () {56 vars in 1148 bytes} [Thu Jul 14 09:25:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:25:50.466564 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6561654-74fc-4e4c-ae50-a6f98e1324cf None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:50.597384 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6561654-74fc-4e4c-ae50-a6f98e1324cf None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:50.623320 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:50.636528 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0eb8ae-d023-48f5-ada3-ff671b92b67a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:50.637202 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0eb8ae-d023-48f5-ada3-ff671b92b67a None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:50.637478 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0eb8ae-d023-48f5-ada3-ff671b92b67a None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:50.637750 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0eb8ae-d023-48f5-ada3-ff671b92b67a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:50.638623 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0eb8ae-d023-48f5-ada3-ff671b92b67a None admin] RBAC: Adding query filter params (role.id=717b56da664944778c6bfc5e1c95909f, scope.project.id=a478e76f04dd413f89ddfba7b0cdc9cc, user.id=1f6962106dfa4c4c9af551053f8095e9) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:50.638935 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0eb8ae-d023-48f5-ada3-ff671b92b67a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:50.640378 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0eb8ae-d023-48f5-ada3-ff671b92b67a None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:50.658267 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 531/1038] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jul 14 09:25:50 2022] GET /identity/v3/role_assignments?user.id=1f6962106dfa4c4c9af551053f8095e9&scope.project.id=a478e76f04dd413f89ddfba7b0cdc9cc&role.id=717b56da664944778c6bfc5e1c95909f => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:25:50.659495 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a49a07-c7ee-400a-9f0e-89d18023e241 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:50.659826 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a49a07-c7ee-400a-9f0e-89d18023e241 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:50.660116 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a49a07-c7ee-400a-9f0e-89d18023e241 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:50.661785 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 508/1039] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:25:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:25:50.667523 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa51f84-b5a4-4770-a02b-c9b4042803fc None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:50.667876 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa51f84-b5a4-4770-a02b-c9b4042803fc None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:50.668173 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa51f84-b5a4-4770-a02b-c9b4042803fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:50.686143 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-dfa51f84-b5a4-4770-a02b-c9b4042803fc None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:25:50.687442 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-dfa51f84-b5a4-4770-a02b-c9b4042803fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:50.780456 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 532/1040] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:25:50 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 09:25:50.803592 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a49a07-c7ee-400a-9f0e-89d18023e241 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:50.935874 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a49a07-c7ee-400a-9f0e-89d18023e241 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:50.978424 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69bac09-af52-4156-9d70-bc8011bb30a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:50.979213 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69bac09-af52-4156-9d70-bc8011bb30a2 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:50.979493 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69bac09-af52-4156-9d70-bc8011bb30a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:50.979762 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69bac09-af52-4156-9d70-bc8011bb30a2 None admin] PATH_INFO: `/v3/services/image` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:50.980428 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69bac09-af52-4156-9d70-bc8011bb30a2 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:50.981809 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69bac09-af52-4156-9d70-bc8011bb30a2 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:50.995861 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-f69bac09-af52-4156-9d70-bc8011bb30a2 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 14 09:25:50.995861 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:25:50.995861 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 09:25:50.995861 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 09:25:50.995861 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 09:25:50.995861 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 09:25:50.995861 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 09:25:50.995861 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 09:25:50.995861 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 14 09:25:50.995861 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:25:50.995861 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 09:25:50.995861 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:25:50.995861 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:25:50.995861 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:25:50.995861 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:25:50.995861 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:25:50.995861 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:25:50.996954 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:25:50.996954 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:25:50.996954 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:25:50.996954 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:25:50.996954 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:25:50.996954 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:25:50.996954 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 09:25:50.996954 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 09:25:50.996954 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 09:25:50.996954 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 09:25:50.996954 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:25:50.996954 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:25:50.996954 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:25:50.996954 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:25:50.996954 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:25:50.996954 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:25:50.997785 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:25:50.997785 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( Jul 14 09:25:50.997785 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:25:50.997785 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:25:50.997785 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:25:50.997785 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:25:50.997785 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:25:50.997785 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:25:50.997785 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:25:50.997785 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:25:50.997785 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 09:25:50.997785 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 09:25:50.997785 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 14 09:25:50.997785 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:25:50.997785 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 509/1041] 10.222.0.40 () {56 vars in 1105 bytes} [Thu Jul 14 09:25:50 2022] GET /identity/v3/services/image => generated 86 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:25:51.005720 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa51f84-b5a4-4770-a02b-c9b4042803fc None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:51.138804 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa51f84-b5a4-4770-a02b-c9b4042803fc None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:51.156922 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:51.178854 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4afff29-aae5-4f30-91e8-81280a1e336b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:51.179541 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4afff29-aae5-4f30-91e8-81280a1e336b None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:51.179832 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4afff29-aae5-4f30-91e8-81280a1e336b None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:51.180111 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4afff29-aae5-4f30-91e8-81280a1e336b None admin] PATH_INFO: `/v3/services` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:51.180833 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4afff29-aae5-4f30-91e8-81280a1e336b None admin] RBAC: Adding query filter params (name=image) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:51.181145 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4afff29-aae5-4f30-91e8-81280a1e336b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:51.182551 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4afff29-aae5-4f30-91e8-81280a1e336b None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:51.188087 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 533/1042] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 09:25:51 2022] GET /identity/v3/services?name=image => generated 122 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:25:51.194114 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69bac09-af52-4156-9d70-bc8011bb30a2 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:51.225979 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:51.318279 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69bac09-af52-4156-9d70-bc8011bb30a2 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:51.354336 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dacde4-74c3-4c9b-bc5b-a618a63e9616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:51.355029 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dacde4-74c3-4c9b-bc5b-a618a63e9616 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:51.355318 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dacde4-74c3-4c9b-bc5b-a618a63e9616 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:51.355598 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dacde4-74c3-4c9b-bc5b-a618a63e9616 None admin] PATH_INFO: `/v3/services` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:51.356357 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dacde4-74c3-4c9b-bc5b-a618a63e9616 None admin] RBAC: Adding query filter params (type=image) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:51.356673 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dacde4-74c3-4c9b-bc5b-a618a63e9616 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:51.358138 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dacde4-74c3-4c9b-bc5b-a618a63e9616 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:51.370550 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 510/1043] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 09:25:51 2022] GET /identity/v3/services?type=image => generated 350 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:25:51.371521 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4afff29-aae5-4f30-91e8-81280a1e336b None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:51.485008 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4afff29-aae5-4f30-91e8-81280a1e336b None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:51.522485 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08602974-e559-4649-bba4-a9aab106e325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:51.523164 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08602974-e559-4649-bba4-a9aab106e325 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:51.523453 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08602974-e559-4649-bba4-a9aab106e325 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:51.523734 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08602974-e559-4649-bba4-a9aab106e325 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:51.527467 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08602974-e559-4649-bba4-a9aab106e325 None admin] RBAC: Adding query filter params (interface=public, service_id=0ef078c491a346619cb794540a303ba0, region_id=RegionOne) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:51.527467 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08602974-e559-4649-bba4-a9aab106e325 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:51.527467 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08602974-e559-4649-bba4-a9aab106e325 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:51.538992 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 534/1044] 10.222.0.40 () {56 vars in 1251 bytes} [Thu Jul 14 09:25:51 2022] GET /identity/v3/endpoints?service_id=0ef078c491a346619cb794540a303ba0&interface=public®ion_id=RegionOne => generated 194 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:25:51.547600 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dacde4-74c3-4c9b-bc5b-a618a63e9616 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:51.710096 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:51.720864 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dacde4-74c3-4c9b-bc5b-a618a63e9616 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:51.761516 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9352a6-711f-41fe-b411-b6218828fb9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:51.762101 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9352a6-711f-41fe-b411-b6218828fb9a None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:51.762417 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9352a6-711f-41fe-b411-b6218828fb9a None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:51.762691 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9352a6-711f-41fe-b411-b6218828fb9a None admin] PATH_INFO: `/v3/services` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:51.763460 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9352a6-711f-41fe-b411-b6218828fb9a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:51.764756 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9352a6-711f-41fe-b411-b6218828fb9a None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:51.772607 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 511/1045] 10.222.0.40 () {56 vars in 1087 bytes} [Thu Jul 14 09:25:51 2022] GET /identity/v3/services => generated 1957 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:25:52.389478 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974f28bb-2c38-4155-b949-2c08e27c9910 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:52.390014 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974f28bb-2c38-4155-b949-2c08e27c9910 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:52.390014 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974f28bb-2c38-4155-b949-2c08e27c9910 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:52.391578 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 535/1046] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:25:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 09:25:52.397540 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772fd1b3-8e3e-4878-b478-4a24c5565d12 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:52.398477 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772fd1b3-8e3e-4878-b478-4a24c5565d12 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:52.398477 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772fd1b3-8e3e-4878-b478-4a24c5565d12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:52.417323 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-772fd1b3-8e3e-4878-b478-4a24c5565d12 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:25:52.418785 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-772fd1b3-8e3e-4878-b478-4a24c5565d12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:52.494685 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 512/1047] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:25:52 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 09:25:52.518013 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974f28bb-2c38-4155-b949-2c08e27c9910 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:52.583007 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:52.647677 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974f28bb-2c38-4155-b949-2c08e27c9910 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:52.687156 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3ca961-2f37-44c2-a64d-455854e2804a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:52.687966 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3ca961-2f37-44c2-a64d-455854e2804a None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:52.688254 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3ca961-2f37-44c2-a64d-455854e2804a None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:52.688532 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3ca961-2f37-44c2-a64d-455854e2804a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:52.710476 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3ca961-2f37-44c2-a64d-455854e2804a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:25:52.719811 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-da3ca961-2f37-44c2-a64d-455854e2804a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 09:25:52.719811 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:25:52.719811 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:25:52.719811 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:25:52.719811 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:25:52.719811 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:25:52.719811 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:25:52.719811 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:25:52.719811 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:25:52.719811 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:25:52.719811 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:25:52.719811 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:25:52.719811 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:25:52.719811 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:25:52.719811 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:25:52.719811 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:25:52.720805 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:25:52.720805 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:25:52.720805 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:25:52.720805 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:25:52.720805 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:25:52.720805 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:25:52.720805 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:25:52.720805 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:25:52.720805 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:25:52.720805 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:25:52.720805 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:25:52.720805 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( Jul 14 09:25:52.720805 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:25:52.720805 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:25:52.720805 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:25:52.720805 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:25:52.721711 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:25:52.721711 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:25:52.721711 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:25:52.721711 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:25:52.721711 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:25:52.721711 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:25:52.721711 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:25:52.721711 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:25:52.721711 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:25:52.721711 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:25:52.721711 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 09:25:52.721711 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Jul 14 09:25:52.726550 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 536/1048] 10.222.0.40 () {56 vars in 1096 bytes} [Thu Jul 14 09:25:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:25:52.730580 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772fd1b3-8e3e-4878-b478-4a24c5565d12 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:52.845140 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:52.862214 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772fd1b3-8e3e-4878-b478-4a24c5565d12 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:52.903404 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d959df9f-d3b9-4c42-a6f2-209046a632e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:52.903983 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d959df9f-d3b9-4c42-a6f2-209046a632e9 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:52.904267 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d959df9f-d3b9-4c42-a6f2-209046a632e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:52.904547 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d959df9f-d3b9-4c42-a6f2-209046a632e9 None admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:52.905321 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d959df9f-d3b9-4c42-a6f2-209046a632e9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:52.905959 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d959df9f-d3b9-4c42-a6f2-209046a632e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:52.907080 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d959df9f-d3b9-4c42-a6f2-209046a632e9 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:52.907525 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d02e89d-524b-443c-b55d-a6b404f8e99e None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:52.907820 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d02e89d-524b-443c-b55d-a6b404f8e99e None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:52.908102 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d02e89d-524b-443c-b55d-a6b404f8e99e None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:52.910208 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 537/1049] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:25:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 09:25:52.915826 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a23dbb9-3ede-42c5-a144-9967b3647378 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:52.916109 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a23dbb9-3ede-42c5-a144-9967b3647378 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:52.916392 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a23dbb9-3ede-42c5-a144-9967b3647378 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:52.927697 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 513/1050] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 14 09:25:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:25:52.929306 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d959df9f-d3b9-4c42-a6f2-209046a632e9 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:52.945350 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-6a23dbb9-3ede-42c5-a144-9967b3647378 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:25:52.946629 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-6a23dbb9-3ede-42c5-a144-9967b3647378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:53.034023 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 538/1051] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:25:52 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 09:25:53.061374 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d959df9f-d3b9-4c42-a6f2-209046a632e9 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:53.072123 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a23dbb9-3ede-42c5-a144-9967b3647378 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:53.101699 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cd0b59-aaf1-47ab-9898-81e9586de639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:53.103038 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cd0b59-aaf1-47ab-9898-81e9586de639 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:53.103818 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cd0b59-aaf1-47ab-9898-81e9586de639 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:53.104533 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cd0b59-aaf1-47ab-9898-81e9586de639 None admin] PATH_INFO: `/v3/users/602d56b536e94914b97a841cbf23e182` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:53.112229 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:53.122781 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cd0b59-aaf1-47ab-9898-81e9586de639 None admin] RBAC: Authorizing `identity:get_user(user_id=602d56b536e94914b97a841cbf23e182)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:53.124245 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cd0b59-aaf1-47ab-9898-81e9586de639 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:53.130286 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 514/1052] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jul 14 09:25:52 2022] GET /identity/v3/users/602d56b536e94914b97a841cbf23e182 => generated 285 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:25:53.132242 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cd0b59-aaf1-47ab-9898-81e9586de639 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:53.141594 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:53.197150 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a23dbb9-3ede-42c5-a144-9967b3647378 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:53.241834 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622292ab-8b5d-4781-8ed7-cd03c07b5c20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:53.242703 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622292ab-8b5d-4781-8ed7-cd03c07b5c20 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:53.242996 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622292ab-8b5d-4781-8ed7-cd03c07b5c20 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:53.243276 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622292ab-8b5d-4781-8ed7-cd03c07b5c20 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:53.254325 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622292ab-8b5d-4781-8ed7-cd03c07b5c20 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:25:53.262312 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cd0b59-aaf1-47ab-9898-81e9586de639 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:53.262840 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-622292ab-8b5d-4781-8ed7-cd03c07b5c20 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 14 09:25:53.262840 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:25:53.262840 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:25:53.262840 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:25:53.262840 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:25:53.262840 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:25:53.262840 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:25:53.262840 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:25:53.262840 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:25:53.262840 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:25:53.262840 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:25:53.262840 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:25:53.262840 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:25:53.262840 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:25:53.262840 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:25:53.262840 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:25:53.263772 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:25:53.263772 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:25:53.263772 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:25:53.263772 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:25:53.263772 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:25:53.263772 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:25:53.263772 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:25:53.263772 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:25:53.263772 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:25:53.263772 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:25:53.263772 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:25:53.263772 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( Jul 14 09:25:53.263772 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:25:53.263772 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:25:53.263772 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:25:53.263772 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:25:53.264629 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:25:53.264629 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:25:53.264629 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:25:53.264629 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:25:53.264629 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:25:53.264629 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:25:53.264629 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:25:53.264629 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:25:53.264629 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:25:53.264629 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:25:53.264629 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 14 09:25:53.264629 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Jul 14 09:25:53.270017 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 539/1053] 10.222.0.40 () {56 vars in 1120 bytes} [Thu Jul 14 09:25:53 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 09:25:53.270952 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622292ab-8b5d-4781-8ed7-cd03c07b5c20 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:53.306524 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2171072c-f041-4aa4-9e3f-1f9eb7f0af3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:53.307216 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2171072c-f041-4aa4-9e3f-1f9eb7f0af3b None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:53.307477 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2171072c-f041-4aa4-9e3f-1f9eb7f0af3b None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:53.307757 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2171072c-f041-4aa4-9e3f-1f9eb7f0af3b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:53.391897 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2171072c-f041-4aa4-9e3f-1f9eb7f0af3b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:53.393373 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2171072c-f041-4aa4-9e3f-1f9eb7f0af3b None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:53.400401 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:53.404105 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:53.412087 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622292ab-8b5d-4781-8ed7-cd03c07b5c20 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:53.453010 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e185a534-abca-444d-bace-1e558714cbe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:53.453616 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e185a534-abca-444d-bace-1e558714cbe6 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:53.453899 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e185a534-abca-444d-bace-1e558714cbe6 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:53.454175 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e185a534-abca-444d-bace-1e558714cbe6 None admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:53.455423 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e185a534-abca-444d-bace-1e558714cbe6 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:53.455745 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e185a534-abca-444d-bace-1e558714cbe6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:53.457942 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e185a534-abca-444d-bace-1e558714cbe6 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:53.467581 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 540/1054] 10.222.0.40 () {56 vars in 1115 bytes} [Thu Jul 14 09:25:53 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:25:53.474233 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e185a534-abca-444d-bace-1e558714cbe6 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:53.512348 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 515/1055] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 14 09:25:53 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 14 09:25:53.518061 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2171072c-f041-4aa4-9e3f-1f9eb7f0af3b None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:53.632693 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e185a534-abca-444d-bace-1e558714cbe6 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:53.658339 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2171072c-f041-4aa4-9e3f-1f9eb7f0af3b None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:53.667275 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:53.674219 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29762b6f-2dfa-42b8-9353-a22f69a0be6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:53.676307 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29762b6f-2dfa-42b8-9353-a22f69a0be6e None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:53.676809 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29762b6f-2dfa-42b8-9353-a22f69a0be6e None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:53.677492 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29762b6f-2dfa-42b8-9353-a22f69a0be6e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:53.689665 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29762b6f-2dfa-42b8-9353-a22f69a0be6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:53.692665 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29762b6f-2dfa-42b8-9353-a22f69a0be6e None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:53.697333 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cdf9da-4530-45fb-b7a4-8802bf704302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:53.698234 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cdf9da-4530-45fb-b7a4-8802bf704302 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:53.698518 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cdf9da-4530-45fb-b7a4-8802bf704302 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:53.698798 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cdf9da-4530-45fb-b7a4-8802bf704302 None admin] PATH_INFO: `/v3/projects/4968ea36db5e4272910e325c990ee691` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:53.700049 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cdf9da-4530-45fb-b7a4-8802bf704302 None admin] RBAC: Authorizing `identity:get_project(project_id=4968ea36db5e4272910e325c990ee691)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:53.701509 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cdf9da-4530-45fb-b7a4-8802bf704302 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:53.703943 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 516/1056] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jul 14 09:25:53 2022] GET /identity/v3/projects/4968ea36db5e4272910e325c990ee691 => generated 311 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:25:53.711258 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cdf9da-4530-45fb-b7a4-8802bf704302 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:53.724185 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-29762b6f-2dfa-42b8-9353-a22f69a0be6e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:25:53.724185 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:25:53.724185 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:25:53.724185 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:25:53.724185 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:25:53.724185 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:25:53.724185 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:25:53.724185 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:25:53.724185 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:25:53.724185 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:25:53.724185 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:25:53.724185 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:25:53.724185 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 09:25:53.724185 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 09:25:53.724185 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 09:25:53.725261 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 09:25:53.725261 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:25:53.725261 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:25:53.725261 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:25:53.725261 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:25:53.725261 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:25:53.725261 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:25:53.725261 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:25:53.725261 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( Jul 14 09:25:53.725261 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:25:53.725261 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:25:53.725261 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:25:53.725261 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:25:53.725261 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:25:53.725261 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:25:53.725261 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:25:53.725261 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:25:53.726155 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 09:25:53.726155 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 09:25:53.726155 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:25:53.726155 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Jul 14 09:25:53.726905 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 541/1057] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 09:25:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 09:25:53.732291 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29762b6f-2dfa-42b8-9353-a22f69a0be6e None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:53.748599 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:53.838583 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cdf9da-4530-45fb-b7a4-8802bf704302 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:53.871723 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29762b6f-2dfa-42b8-9353-a22f69a0be6e None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:53.895125 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80f90f5-8d7e-40ff-aa59-00c93ee05f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:53.895802 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80f90f5-8d7e-40ff-aa59-00c93ee05f67 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:53.896083 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80f90f5-8d7e-40ff-aa59-00c93ee05f67 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:53.896364 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80f90f5-8d7e-40ff-aa59-00c93ee05f67 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:53.897214 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80f90f5-8d7e-40ff-aa59-00c93ee05f67 None admin] RBAC: Adding query filter params (role.id=e3965bd0d5f1427a86a313c0c90bfef3, scope.project.id=4968ea36db5e4272910e325c990ee691, user.id=602d56b536e94914b97a841cbf23e182) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:53.897524 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80f90f5-8d7e-40ff-aa59-00c93ee05f67 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:53.901315 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80f90f5-8d7e-40ff-aa59-00c93ee05f67 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:53.912640 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 517/1058] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jul 14 09:25:53 2022] GET /identity/v3/role_assignments?user.id=602d56b536e94914b97a841cbf23e182&scope.project.id=4968ea36db5e4272910e325c990ee691&role.id=e3965bd0d5f1427a86a313c0c90bfef3 => generated 259 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:25:53.914375 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a676935a-378d-4858-9a15-3c57c4683a1a None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:53.914876 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a676935a-378d-4858-9a15-3c57c4683a1a None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:53.915362 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a676935a-378d-4858-9a15-3c57c4683a1a None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:53.917254 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 518/1059] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:25:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:25:53.919717 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb409f3d-db7b-47b6-b26e-6cbd4b0e761e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:53.920830 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb409f3d-db7b-47b6-b26e-6cbd4b0e761e None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:53.921352 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb409f3d-db7b-47b6-b26e-6cbd4b0e761e None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:53.921832 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb409f3d-db7b-47b6-b26e-6cbd4b0e761e None admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:53.923211 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb409f3d-db7b-47b6-b26e-6cbd4b0e761e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:53.923729 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb409f3d-db7b-47b6-b26e-6cbd4b0e761e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:53.926247 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb409f3d-db7b-47b6-b26e-6cbd4b0e761e None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:53.931961 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c75cdf0-cd45-4b64-8695-a5a194d4305a None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:53.932267 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c75cdf0-cd45-4b64-8695-a5a194d4305a None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:53.932525 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c75cdf0-cd45-4b64-8695-a5a194d4305a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:53.956103 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 542/1060] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 14 09:25:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:25:53.958203 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb409f3d-db7b-47b6-b26e-6cbd4b0e761e None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:53.960868 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-1c75cdf0-cd45-4b64-8695-a5a194d4305a None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:25:53.962729 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-1c75cdf0-cd45-4b64-8695-a5a194d4305a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:54.021335 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:54.061057 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:54.074156 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 519/1061] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:25:53 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 09:25:54.097762 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c75cdf0-cd45-4b64-8695-a5a194d4305a None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:54.117253 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb409f3d-db7b-47b6-b26e-6cbd4b0e761e None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:54.153431 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a69f12-98aa-4a17-981d-d22d59bd8bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:54.154322 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a69f12-98aa-4a17-981d-d22d59bd8bdb None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:54.154614 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a69f12-98aa-4a17-981d-d22d59bd8bdb None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:54.154895 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a69f12-98aa-4a17-981d-d22d59bd8bdb None admin] PATH_INFO: `/v3/users/nova` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:54.162515 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a69f12-98aa-4a17-981d-d22d59bd8bdb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:54.164053 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a69f12-98aa-4a17-981d-d22d59bd8bdb None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:54.189244 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-89a69f12-98aa-4a17-981d-d22d59bd8bdb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 14 09:25:54.189244 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:25:54.189244 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:25:54.189244 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:25:54.189244 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:25:54.189244 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:25:54.189244 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:25:54.189244 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:25:54.189244 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:25:54.189244 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:25:54.189244 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:25:54.189244 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:25:54.189244 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 09:25:54.189244 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 09:25:54.189244 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 09:25:54.189244 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 09:25:54.190322 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:25:54.190322 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:25:54.190322 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 09:25:54.190322 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 09:25:54.190322 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 09:25:54.190322 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 09:25:54.190322 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:25:54.190322 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:25:54.190322 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:25:54.190322 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:25:54.190322 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:25:54.190322 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( Jul 14 09:25:54.190322 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:25:54.190322 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:25:54.190322 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:25:54.190322 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:25:54.190322 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:25:54.190322 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:25:54.192025 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:25:54.192025 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:25:54.192025 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 09:25:54.192025 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 09:25:54.192025 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 09:25:54.192025 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 09:25:54.192025 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 09:25:54.192025 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 09:25:54.192025 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 14 09:25:54.192025 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Jul 14 09:25:54.192025 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 543/1062] 10.222.0.40 () {56 vars in 1093 bytes} [Thu Jul 14 09:25:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:25:54.197340 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a69f12-98aa-4a17-981d-d22d59bd8bdb None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:54.235264 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c75cdf0-cd45-4b64-8695-a5a194d4305a None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:54.289689 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211d90e3-6b03-44a1-907c-8a9eef5790b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:54.291163 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211d90e3-6b03-44a1-907c-8a9eef5790b7 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:54.291465 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211d90e3-6b03-44a1-907c-8a9eef5790b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:54.291743 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211d90e3-6b03-44a1-907c-8a9eef5790b7 None admin] PATH_INFO: `/v3/services/image` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:54.292415 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211d90e3-6b03-44a1-907c-8a9eef5790b7 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:54.294163 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211d90e3-6b03-44a1-907c-8a9eef5790b7 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:54.310731 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-211d90e3-6b03-44a1-907c-8a9eef5790b7 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 14 09:25:54.310731 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:25:54.310731 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 09:25:54.310731 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 09:25:54.310731 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 09:25:54.310731 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 09:25:54.310731 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 09:25:54.310731 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 09:25:54.310731 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 14 09:25:54.310731 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:25:54.310731 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 09:25:54.310731 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:25:54.310731 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:25:54.310731 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:25:54.310731 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:25:54.310731 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:25:54.310731 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:25:54.311809 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:25:54.311809 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:25:54.311809 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:25:54.311809 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:25:54.311809 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:25:54.311809 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:25:54.311809 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 09:25:54.311809 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 09:25:54.311809 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 09:25:54.311809 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 09:25:54.311809 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:25:54.311809 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:25:54.311809 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:25:54.311809 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:25:54.311809 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:25:54.311809 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:25:54.312648 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:25:54.312648 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( Jul 14 09:25:54.312648 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:25:54.312648 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:25:54.312648 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:25:54.312648 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:25:54.312648 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:25:54.312648 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:25:54.312648 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:25:54.312648 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:25:54.312648 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 09:25:54.312648 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 09:25:54.312648 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 14 09:25:54.312648 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:25:54.312648 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 520/1063] 10.222.0.40 () {56 vars in 1105 bytes} [Thu Jul 14 09:25:54 2022] GET /identity/v3/services/image => generated 86 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 09:25:54.318973 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211d90e3-6b03-44a1-907c-8a9eef5790b7 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:54.335262 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a69f12-98aa-4a17-981d-d22d59bd8bdb None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:54.365600 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:54.369788 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:54.379921 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66c8c0a-3ca5-4010-8b14-93eb22fcbc04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:54.380627 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66c8c0a-3ca5-4010-8b14-93eb22fcbc04 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:54.381261 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66c8c0a-3ca5-4010-8b14-93eb22fcbc04 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:54.381544 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66c8c0a-3ca5-4010-8b14-93eb22fcbc04 None admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:54.382440 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66c8c0a-3ca5-4010-8b14-93eb22fcbc04 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:54.382771 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66c8c0a-3ca5-4010-8b14-93eb22fcbc04 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:54.384569 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66c8c0a-3ca5-4010-8b14-93eb22fcbc04 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:54.403647 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 544/1064] 10.222.0.40 () {56 vars in 1133 bytes} [Thu Jul 14 09:25:54 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:25:54.410556 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66c8c0a-3ca5-4010-8b14-93eb22fcbc04 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:54.461018 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211d90e3-6b03-44a1-907c-8a9eef5790b7 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:54.505636 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7d8fad-a877-49b8-99b6-bdcac1d95618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:54.506255 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7d8fad-a877-49b8-99b6-bdcac1d95618 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:54.506549 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7d8fad-a877-49b8-99b6-bdcac1d95618 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:54.506827 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7d8fad-a877-49b8-99b6-bdcac1d95618 None admin] PATH_INFO: `/v3/services` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:54.507550 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7d8fad-a877-49b8-99b6-bdcac1d95618 None admin] RBAC: Adding query filter params (name=image) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:54.507860 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7d8fad-a877-49b8-99b6-bdcac1d95618 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:54.509239 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7d8fad-a877-49b8-99b6-bdcac1d95618 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:54.519634 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 521/1065] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 09:25:54 2022] GET /identity/v3/services?name=image => generated 122 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:25:54.520841 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7d8fad-a877-49b8-99b6-bdcac1d95618 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:54.555696 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66c8c0a-3ca5-4010-8b14-93eb22fcbc04 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:54.605003 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bde2e72-6cc3-4f54-b927-9866ba643c68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:54.605823 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bde2e72-6cc3-4f54-b927-9866ba643c68 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:54.606115 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bde2e72-6cc3-4f54-b927-9866ba643c68 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:54.606441 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bde2e72-6cc3-4f54-b927-9866ba643c68 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:54.619231 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bde2e72-6cc3-4f54-b927-9866ba643c68 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:54.620722 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bde2e72-6cc3-4f54-b927-9866ba643c68 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:54.640783 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-9bde2e72-6cc3-4f54-b927-9866ba643c68 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:25:54.640783 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:25:54.640783 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:25:54.640783 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:25:54.640783 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:25:54.640783 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:25:54.640783 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:25:54.640783 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:25:54.640783 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:25:54.640783 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:25:54.640783 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:25:54.640783 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:25:54.640783 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 09:25:54.640783 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 09:25:54.640783 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 09:25:54.641769 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 09:25:54.641769 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:25:54.641769 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:25:54.641769 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:25:54.641769 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:25:54.641769 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:25:54.641769 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:25:54.641769 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:25:54.641769 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( Jul 14 09:25:54.641769 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:25:54.641769 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:25:54.641769 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:25:54.641769 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:25:54.641769 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:25:54.641769 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:25:54.641769 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:25:54.641769 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:25:54.642700 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 09:25:54.642700 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 09:25:54.642700 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:25:54.642700 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Jul 14 09:25:54.642700 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 545/1066] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 09:25:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 09:25:54.647974 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bde2e72-6cc3-4f54-b927-9866ba643c68 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:54.651626 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:54.660823 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7d8fad-a877-49b8-99b6-bdcac1d95618 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:54.695301 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:54.704592 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39ffb3b-0e83-4962-88ad-ceadbd3fcec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:54.705373 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39ffb3b-0e83-4962-88ad-ceadbd3fcec3 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:54.705648 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39ffb3b-0e83-4962-88ad-ceadbd3fcec3 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:54.705923 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39ffb3b-0e83-4962-88ad-ceadbd3fcec3 None admin] PATH_INFO: `/v3/services` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:54.706886 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39ffb3b-0e83-4962-88ad-ceadbd3fcec3 None admin] RBAC: Adding query filter params (type=image) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:54.707331 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39ffb3b-0e83-4962-88ad-ceadbd3fcec3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:54.708691 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39ffb3b-0e83-4962-88ad-ceadbd3fcec3 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:54.714650 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 522/1067] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 09:25:54 2022] GET /identity/v3/services?type=image => generated 350 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:25:54.720196 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39ffb3b-0e83-4962-88ad-ceadbd3fcec3 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:54.770397 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bde2e72-6cc3-4f54-b927-9866ba643c68 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:54.821016 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20cc9e6-f791-41f6-acfb-c7af195a91ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:54.821987 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20cc9e6-f791-41f6-acfb-c7af195a91ea None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:54.822304 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20cc9e6-f791-41f6-acfb-c7af195a91ea None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:54.822586 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20cc9e6-f791-41f6-acfb-c7af195a91ea None admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:54.823323 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20cc9e6-f791-41f6-acfb-c7af195a91ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:54.823639 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20cc9e6-f791-41f6-acfb-c7af195a91ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:54.825488 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20cc9e6-f791-41f6-acfb-c7af195a91ea None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:54.837248 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39ffb3b-0e83-4962-88ad-ceadbd3fcec3 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:54.844262 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 546/1068] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 14 09:25:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:25:54.850281 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20cc9e6-f791-41f6-acfb-c7af195a91ea None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:54.885230 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e2efd1-3b1d-411c-b4cc-719cd4d4f5d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:54.886206 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e2efd1-3b1d-411c-b4cc-719cd4d4f5d5 None admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:54.886624 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e2efd1-3b1d-411c-b4cc-719cd4d4f5d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:54.887051 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e2efd1-3b1d-411c-b4cc-719cd4d4f5d5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:54.888075 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e2efd1-3b1d-411c-b4cc-719cd4d4f5d5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:54.889846 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e2efd1-3b1d-411c-b4cc-719cd4d4f5d5 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:54.916789 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 523/1069] 10.222.0.40 () {60 vars in 1144 bytes} [Thu Jul 14 09:25:54 2022] POST /identity/v3/endpoints => generated 327 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 09:25:54.974659 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:54.980759 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20cc9e6-f791-41f6-acfb-c7af195a91ea None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:55.039868 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f8f8f8-6d6c-43aa-8c70-b8dfec29ef68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:55.040642 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f8f8f8-6d6c-43aa-8c70-b8dfec29ef68 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:55.040926 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f8f8f8-6d6c-43aa-8c70-b8dfec29ef68 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:55.041199 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f8f8f8-6d6c-43aa-8c70-b8dfec29ef68 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:55.049447 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f8f8f8-6d6c-43aa-8c70-b8dfec29ef68 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:55.051118 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f8f8f8-6d6c-43aa-8c70-b8dfec29ef68 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:55.067144 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-24f8f8f8-6d6c-43aa-8c70-b8dfec29ef68 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 09:25:55.067144 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:25:55.067144 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:25:55.067144 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:25:55.067144 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:25:55.067144 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:25:55.067144 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:25:55.067144 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:25:55.067144 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:25:55.067144 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:25:55.067144 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:25:55.067144 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:25:55.067144 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 09:25:55.067144 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 09:25:55.067144 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 09:25:55.068120 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 09:25:55.068120 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:25:55.068120 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:25:55.068120 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:25:55.068120 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:25:55.068120 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:25:55.068120 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:25:55.068120 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:25:55.068120 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( Jul 14 09:25:55.068120 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:25:55.068120 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:25:55.068120 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:25:55.068120 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:25:55.068120 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:25:55.068120 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:25:55.068120 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:25:55.068120 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:25:55.069280 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 09:25:55.069280 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 09:25:55.069280 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 09:25:55.069280 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 09:25:55.069280 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 09:25:55.069280 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 09:25:55.069280 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 09:25:55.069280 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Jul 14 09:25:55.069280 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 547/1070] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jul 14 09:25:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 09:25:55.074740 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e2efd1-3b1d-411c-b4cc-719cd4d4f5d5 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:55.096798 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:55.199658 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e2efd1-3b1d-411c-b4cc-719cd4d4f5d5 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:55.238296 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44be7ea4-a8cc-478f-ba40-54c22a15d9c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:55.238977 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44be7ea4-a8cc-478f-ba40-54c22a15d9c1 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:55.239262 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44be7ea4-a8cc-478f-ba40-54c22a15d9c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:55.239540 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44be7ea4-a8cc-478f-ba40-54c22a15d9c1 None admin] PATH_INFO: `/v3/projects` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:55.240341 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44be7ea4-a8cc-478f-ba40-54c22a15d9c1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:55.240656 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44be7ea4-a8cc-478f-ba40-54c22a15d9c1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:55.242396 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44be7ea4-a8cc-478f-ba40-54c22a15d9c1 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:55.256028 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 524/1071] 10.222.0.40 () {56 vars in 1148 bytes} [Thu Jul 14 09:25:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:25:55.261633 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f8f8f8-6d6c-43aa-8c70-b8dfec29ef68 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:55.397237 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f8f8f8-6d6c-43aa-8c70-b8dfec29ef68 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:55.442817 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95bb3fb-0182-4ed2-bfb8-4cde874f8235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:55.443722 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95bb3fb-0182-4ed2-bfb8-4cde874f8235 None admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:55.444008 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95bb3fb-0182-4ed2-bfb8-4cde874f8235 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:55.444285 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95bb3fb-0182-4ed2-bfb8-4cde874f8235 None admin] PATH_INFO: `/v3/projects/a478e76f04dd413f89ddfba7b0cdc9cc/users/1f6962106dfa4c4c9af551053f8095e9/roles/717b56da664944778c6bfc5e1c95909f` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:55.446561 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95bb3fb-0182-4ed2-bfb8-4cde874f8235 None admin] RBAC: Authorizing `identity:create_grant(project_id=a478e76f04dd413f89ddfba7b0cdc9cc, user_id=1f6962106dfa4c4c9af551053f8095e9, role_id=717b56da664944778c6bfc5e1c95909f)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:55.448017 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95bb3fb-0182-4ed2-bfb8-4cde874f8235 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:55.464177 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 548/1072] 10.222.0.40 () {58 vars in 1439 bytes} [Thu Jul 14 09:25:55 2022] PUT /identity/v3/projects/a478e76f04dd413f89ddfba7b0cdc9cc/users/1f6962106dfa4c4c9af551053f8095e9/roles/717b56da664944778c6bfc5e1c95909f => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:25:56.083077 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1196bb-f755-4f87-a35b-87f621692587 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:56.083705 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1196bb-f755-4f87-a35b-87f621692587 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:56.083705 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1196bb-f755-4f87-a35b-87f621692587 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:56.085034 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 525/1073] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:25:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:25:56.090642 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80a984d-4857-4f61-acef-fbbddb46f6c4 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:56.090968 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80a984d-4857-4f61-acef-fbbddb46f6c4 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:56.091314 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80a984d-4857-4f61-acef-fbbddb46f6c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:56.110530 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-a80a984d-4857-4f61-acef-fbbddb46f6c4 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:25:56.111803 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-a80a984d-4857-4f61-acef-fbbddb46f6c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:56.128808 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:56.202326 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 549/1074] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:25:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 09:25:56.225223 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1196bb-f755-4f87-a35b-87f621692587 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:56.315054 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:56.341607 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1196bb-f755-4f87-a35b-87f621692587 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:56.378544 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b82956-a759-4234-80d7-b0af49d4cb4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:56.379344 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b82956-a759-4234-80d7-b0af49d4cb4e None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:56.379626 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b82956-a759-4234-80d7-b0af49d4cb4e None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:56.379899 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b82956-a759-4234-80d7-b0af49d4cb4e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:56.390815 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b82956-a759-4234-80d7-b0af49d4cb4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:25:56.399178 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-88b82956-a759-4234-80d7-b0af49d4cb4e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 09:25:56.399178 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:25:56.399178 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:25:56.399178 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:25:56.399178 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:25:56.399178 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:25:56.399178 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:25:56.399178 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:25:56.399178 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:25:56.399178 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:25:56.399178 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:25:56.399178 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:25:56.399178 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:25:56.399178 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:25:56.399178 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:25:56.399178 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:25:56.400223 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:25:56.400223 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:25:56.400223 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:25:56.400223 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:25:56.400223 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:25:56.400223 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:25:56.400223 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:25:56.400223 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:25:56.400223 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:25:56.400223 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:25:56.400223 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:25:56.400223 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( Jul 14 09:25:56.400223 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:25:56.400223 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:25:56.400223 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:25:56.400223 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:25:56.406549 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:25:56.406549 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:25:56.406549 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:25:56.406549 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:25:56.406549 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:25:56.406549 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:25:56.406549 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:25:56.406549 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:25:56.406549 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:25:56.406549 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:25:56.406549 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 09:25:56.406549 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:25:56.406549 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 526/1075] 10.222.0.40 () {56 vars in 1096 bytes} [Thu Jul 14 09:25:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:25:56.407305 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80a984d-4857-4f61-acef-fbbddb46f6c4 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:56.510450 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80a984d-4857-4f61-acef-fbbddb46f6c4 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:56.565609 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced67684-32f4-496e-b78e-135d0d2bff23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:56.566393 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced67684-32f4-496e-b78e-135d0d2bff23 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:56.566680 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced67684-32f4-496e-b78e-135d0d2bff23 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:56.566955 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced67684-32f4-496e-b78e-135d0d2bff23 None admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:56.567717 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced67684-32f4-496e-b78e-135d0d2bff23 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:56.568021 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced67684-32f4-496e-b78e-135d0d2bff23 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:56.569403 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced67684-32f4-496e-b78e-135d0d2bff23 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:56.583174 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 550/1076] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 14 09:25:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:25:56.585362 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b82956-a759-4234-80d7-b0af49d4cb4e None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:56.711992 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b82956-a759-4234-80d7-b0af49d4cb4e None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:56.752018 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7596c32-d320-4417-93d1-2731a3e75676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:56.753981 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7596c32-d320-4417-93d1-2731a3e75676 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:56.754482 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7596c32-d320-4417-93d1-2731a3e75676 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:56.754929 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7596c32-d320-4417-93d1-2731a3e75676 None admin] PATH_INFO: `/v3/users/602d56b536e94914b97a841cbf23e182` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:56.756982 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7596c32-d320-4417-93d1-2731a3e75676 None admin] RBAC: Authorizing `identity:get_user(user_id=602d56b536e94914b97a841cbf23e182)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:56.759484 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7596c32-d320-4417-93d1-2731a3e75676 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:56.767236 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 527/1077] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jul 14 09:25:56 2022] GET /identity/v3/users/602d56b536e94914b97a841cbf23e182 => generated 285 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:25:56.771425 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced67684-32f4-496e-b78e-135d0d2bff23 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:56.783375 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:56.886617 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced67684-32f4-496e-b78e-135d0d2bff23 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:56.928019 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e718eb7e-23cf-4748-bab7-2b3c4ddd6559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:56.931069 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e718eb7e-23cf-4748-bab7-2b3c4ddd6559 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:56.931069 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e718eb7e-23cf-4748-bab7-2b3c4ddd6559 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:56.931069 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e718eb7e-23cf-4748-bab7-2b3c4ddd6559 None admin] PATH_INFO: `/v3/projects/4968ea36db5e4272910e325c990ee691` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:56.931069 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e718eb7e-23cf-4748-bab7-2b3c4ddd6559 None admin] RBAC: Authorizing `identity:get_project(project_id=4968ea36db5e4272910e325c990ee691)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:56.932320 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e718eb7e-23cf-4748-bab7-2b3c4ddd6559 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:56.934239 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 551/1078] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jul 14 09:25:56 2022] GET /identity/v3/projects/4968ea36db5e4272910e325c990ee691 => generated 311 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:25:56.940185 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7596c32-d320-4417-93d1-2731a3e75676 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:56.944752 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:57.089680 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7596c32-d320-4417-93d1-2731a3e75676 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:57.133803 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3ade15-23d9-42dd-a25e-95c185a73db9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:57.134678 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3ade15-23d9-42dd-a25e-95c185a73db9 None admin] REQUEST_METHOD: `PUT` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:57.134967 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3ade15-23d9-42dd-a25e-95c185a73db9 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:57.135245 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3ade15-23d9-42dd-a25e-95c185a73db9 None admin] PATH_INFO: `/v3/projects/4968ea36db5e4272910e325c990ee691/users/602d56b536e94914b97a841cbf23e182/roles/e3965bd0d5f1427a86a313c0c90bfef3` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:57.137262 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3ade15-23d9-42dd-a25e-95c185a73db9 None admin] RBAC: Authorizing `identity:create_grant(project_id=4968ea36db5e4272910e325c990ee691, user_id=602d56b536e94914b97a841cbf23e182, role_id=e3965bd0d5f1427a86a313c0c90bfef3)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:57.138792 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3ade15-23d9-42dd-a25e-95c185a73db9 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:57.153418 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 528/1079] 10.222.0.40 () {58 vars in 1439 bytes} [Thu Jul 14 09:25:56 2022] PUT /identity/v3/projects/4968ea36db5e4272910e325c990ee691/users/602d56b536e94914b97a841cbf23e182/roles/e3965bd0d5f1427a86a313c0c90bfef3 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:25:57.169047 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5321e7-12f2-4bec-84eb-a86d956aef1a None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:57.169397 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5321e7-12f2-4bec-84eb-a86d956aef1a None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:57.169648 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5321e7-12f2-4bec-84eb-a86d956aef1a None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:57.172548 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 552/1080] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:25:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:25:57.180104 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754655d9-b092-42b2-9c06-101e1766f2bd None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:57.180400 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754655d9-b092-42b2-9c06-101e1766f2bd None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:57.180725 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754655d9-b092-42b2-9c06-101e1766f2bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:57.200404 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-754655d9-b092-42b2-9c06-101e1766f2bd None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:25:57.201693 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-754655d9-b092-42b2-9c06-101e1766f2bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:57.281156 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:57.295397 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 529/1081] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:25:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 09:25:57.323408 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5321e7-12f2-4bec-84eb-a86d956aef1a None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:57.412398 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:57.442569 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5321e7-12f2-4bec-84eb-a86d956aef1a None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:57.485057 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5854b08-6d90-4747-971b-e50d9e485d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:57.485057 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5854b08-6d90-4747-971b-e50d9e485d91 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:57.485057 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5854b08-6d90-4747-971b-e50d9e485d91 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:57.485640 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5854b08-6d90-4747-971b-e50d9e485d91 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:57.577495 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5854b08-6d90-4747-971b-e50d9e485d91 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:57.578150 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e6f3f5-7e78-4cd9-bf0c-02f4d6f86495 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:57.578150 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e6f3f5-7e78-4cd9-bf0c-02f4d6f86495 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:57.578658 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e6f3f5-7e78-4cd9-bf0c-02f4d6f86495 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:57.581109 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5854b08-6d90-4747-971b-e50d9e485d91 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:57.581383 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 530/1082] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:25:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 09:25:57.589818 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c594cc8d-a44b-4913-8636-0cefe19f1081 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:57.590147 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c594cc8d-a44b-4913-8636-0cefe19f1081 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:57.590432 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c594cc8d-a44b-4913-8636-0cefe19f1081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:57.608423 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-c594cc8d-a44b-4913-8636-0cefe19f1081 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:25:57.609631 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-c594cc8d-a44b-4913-8636-0cefe19f1081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:57.683837 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:57.699748 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 531/1083] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:25:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 09:25:57.722541 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 553/1084] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 14 09:25:57 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 09:25:57.723754 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c594cc8d-a44b-4913-8636-0cefe19f1081 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:57.725107 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5854b08-6d90-4747-971b-e50d9e485d91 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:57.843026 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5854b08-6d90-4747-971b-e50d9e485d91 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:57.851878 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c594cc8d-a44b-4913-8636-0cefe19f1081 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:57.882732 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdb9284-aae2-4693-8fef-a407b88e9aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:57.883546 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdb9284-aae2-4693-8fef-a407b88e9aee None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:57.883837 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdb9284-aae2-4693-8fef-a407b88e9aee None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:57.884300 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdb9284-aae2-4693-8fef-a407b88e9aee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:57.885284 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:57.899489 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33b8460-ac07-4abb-b66d-ba3adc75ea8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:57.900324 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33b8460-ac07-4abb-b66d-ba3adc75ea8e None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:57.900610 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33b8460-ac07-4abb-b66d-ba3adc75ea8e None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:57.900890 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33b8460-ac07-4abb-b66d-ba3adc75ea8e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:57.904049 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdb9284-aae2-4693-8fef-a407b88e9aee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:57.906403 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdb9284-aae2-4693-8fef-a407b88e9aee None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:57.915985 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33b8460-ac07-4abb-b66d-ba3adc75ea8e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:25:57.928473 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-2cdb9284-aae2-4693-8fef-a407b88e9aee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:25:57.928473 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:25:57.928473 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:25:57.928473 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:25:57.928473 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:25:57.928473 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:25:57.928473 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:25:57.928473 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:25:57.928473 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:25:57.928473 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:25:57.928473 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:25:57.928473 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:25:57.928473 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 09:25:57.928473 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 09:25:57.928473 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 09:25:57.929602 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 09:25:57.929602 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:25:57.929602 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:25:57.929602 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:25:57.929602 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:25:57.929602 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:25:57.929602 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:25:57.929602 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:25:57.929602 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( Jul 14 09:25:57.929602 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:25:57.929602 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:25:57.929602 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:25:57.929602 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:25:57.929602 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:25:57.929602 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:25:57.929602 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:25:57.929602 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:25:57.930608 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 09:25:57.930608 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 09:25:57.930608 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:25:57.930608 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Jul 14 09:25:57.930852 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-e33b8460-ac07-4abb-b66d-ba3adc75ea8e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 14 09:25:57.930852 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:25:57.930852 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:25:57.930852 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:25:57.930852 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:25:57.930852 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:25:57.930852 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:25:57.930852 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:25:57.930852 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:25:57.930852 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:25:57.930852 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:25:57.930852 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:25:57.930852 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:25:57.930852 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:25:57.930852 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:25:57.930852 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:25:57.931723 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:25:57.931723 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:25:57.931723 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:25:57.931723 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:25:57.931723 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:25:57.931723 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:25:57.931723 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:25:57.931723 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:25:57.931723 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:25:57.931723 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:25:57.931723 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:25:57.931723 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( Jul 14 09:25:57.931723 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:25:57.931723 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:25:57.931723 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:25:57.931723 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:25:57.932567 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:25:57.932567 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:25:57.932567 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:25:57.932567 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:25:57.932567 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:25:57.932567 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:25:57.932567 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:25:57.932567 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:25:57.932567 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:25:57.932567 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:25:57.932567 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 14 09:25:57.932567 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:25:57.934933 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 554/1085] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 09:25:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 09:25:57.935428 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 532/1086] 10.222.0.40 () {56 vars in 1120 bytes} [Thu Jul 14 09:25:57 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 09:25:57.935810 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdb9284-aae2-4693-8fef-a407b88e9aee None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:57.941806 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33b8460-ac07-4abb-b66d-ba3adc75ea8e None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:57.974007 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:58.056547 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33b8460-ac07-4abb-b66d-ba3adc75ea8e None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:58.059036 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdb9284-aae2-4693-8fef-a407b88e9aee None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:58.094698 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438ff884-c8e1-4f12-b515-82dd40140c0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:58.095408 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438ff884-c8e1-4f12-b515-82dd40140c0f None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:58.095659 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438ff884-c8e1-4f12-b515-82dd40140c0f None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:58.095939 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438ff884-c8e1-4f12-b515-82dd40140c0f None admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:58.096714 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438ff884-c8e1-4f12-b515-82dd40140c0f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:58.097035 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438ff884-c8e1-4f12-b515-82dd40140c0f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:58.098074 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10699639-4209-4b5b-9c2d-2b1d1f28198b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:58.098439 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438ff884-c8e1-4f12-b515-82dd40140c0f None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:58.098789 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10699639-4209-4b5b-9c2d-2b1d1f28198b None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:58.099079 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10699639-4209-4b5b-9c2d-2b1d1f28198b None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:58.099361 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10699639-4209-4b5b-9c2d-2b1d1f28198b None admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:58.100100 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10699639-4209-4b5b-9c2d-2b1d1f28198b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:58.100416 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10699639-4209-4b5b-9c2d-2b1d1f28198b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:58.101803 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10699639-4209-4b5b-9c2d-2b1d1f28198b None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:58.113683 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 533/1087] 10.222.0.40 () {56 vars in 1115 bytes} [Thu Jul 14 09:25:57 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:25:58.114339 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438ff884-c8e1-4f12-b515-82dd40140c0f None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:58.121039 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 555/1088] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 14 09:25:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:25:58.185277 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:58.261268 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438ff884-c8e1-4f12-b515-82dd40140c0f None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:58.307157 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d554fea-f8c0-4209-a359-fda6870040b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:58.307984 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d554fea-f8c0-4209-a359-fda6870040b5 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:58.308263 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d554fea-f8c0-4209-a359-fda6870040b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:58.308547 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d554fea-f8c0-4209-a359-fda6870040b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:58.321578 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d554fea-f8c0-4209-a359-fda6870040b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:58.323093 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d554fea-f8c0-4209-a359-fda6870040b5 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:58.349689 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-4d554fea-f8c0-4209-a359-fda6870040b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:25:58.349689 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:25:58.349689 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:25:58.349689 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:25:58.349689 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:25:58.349689 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:25:58.349689 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:25:58.349689 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:25:58.349689 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:25:58.349689 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:25:58.349689 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:25:58.349689 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:25:58.349689 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 09:25:58.349689 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 09:25:58.349689 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 09:25:58.350761 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 09:25:58.350761 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:25:58.350761 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:25:58.350761 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:25:58.350761 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:25:58.350761 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:25:58.350761 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:25:58.350761 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:25:58.350761 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( Jul 14 09:25:58.350761 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:25:58.350761 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:25:58.350761 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:25:58.350761 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:25:58.350761 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:25:58.350761 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:25:58.350761 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:25:58.350761 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:25:58.351872 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 09:25:58.351872 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 09:25:58.351872 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:25:58.351872 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:25:58.352217 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 534/1089] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 09:25:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 09:25:58.357965 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10699639-4209-4b5b-9c2d-2b1d1f28198b None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:58.462976 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:58.483213 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10699639-4209-4b5b-9c2d-2b1d1f28198b None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:58.523383 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73e7565-a8ba-4377-b86b-d53e222174ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:58.524189 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73e7565-a8ba-4377-b86b-d53e222174ac None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:58.527309 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73e7565-a8ba-4377-b86b-d53e222174ac None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:58.527309 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73e7565-a8ba-4377-b86b-d53e222174ac None admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:58.527309 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73e7565-a8ba-4377-b86b-d53e222174ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:58.527309 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73e7565-a8ba-4377-b86b-d53e222174ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:58.527679 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73e7565-a8ba-4377-b86b-d53e222174ac None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:58.543489 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 556/1090] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 14 09:25:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:25:58.548898 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d554fea-f8c0-4209-a359-fda6870040b5 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:58.649857 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:58.653954 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d554fea-f8c0-4209-a359-fda6870040b5 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:58.695186 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373cdf19-720d-42ad-92f4-35339f519945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:58.695995 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373cdf19-720d-42ad-92f4-35339f519945 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:58.696279 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373cdf19-720d-42ad-92f4-35339f519945 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:58.696559 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373cdf19-720d-42ad-92f4-35339f519945 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:58.705533 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373cdf19-720d-42ad-92f4-35339f519945 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:58.707524 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373cdf19-720d-42ad-92f4-35339f519945 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:58.722707 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-373cdf19-720d-42ad-92f4-35339f519945 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 14 09:25:58.722707 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:25:58.722707 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:25:58.722707 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:25:58.722707 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:25:58.722707 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:25:58.722707 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:25:58.722707 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:25:58.722707 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:25:58.722707 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:25:58.722707 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:25:58.722707 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:25:58.722707 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 09:25:58.722707 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 09:25:58.722707 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 09:25:58.722707 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 09:25:58.723782 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:25:58.723782 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:25:58.723782 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 09:25:58.723782 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 09:25:58.723782 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 09:25:58.723782 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 09:25:58.723782 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:25:58.723782 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:25:58.723782 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:25:58.723782 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:25:58.723782 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:25:58.723782 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( Jul 14 09:25:58.723782 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:25:58.723782 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:25:58.723782 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:25:58.723782 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:25:58.723782 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:25:58.723782 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:25:58.724755 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:25:58.724755 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:25:58.724755 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 09:25:58.724755 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 09:25:58.724755 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 09:25:58.724755 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 09:25:58.724755 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 09:25:58.724755 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 09:25:58.724755 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 14 09:25:58.724755 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:25:58.724755 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 535/1091] 10.222.0.40 () {56 vars in 1093 bytes} [Thu Jul 14 09:25:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:25:58.729809 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73e7565-a8ba-4377-b86b-d53e222174ac None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:58.839281 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73e7565-a8ba-4377-b86b-d53e222174ac None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:58.875953 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a65445-95e2-4304-ba37-d039417eb88d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:58.876642 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a65445-95e2-4304-ba37-d039417eb88d None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:58.876924 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a65445-95e2-4304-ba37-d039417eb88d None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:58.877197 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a65445-95e2-4304-ba37-d039417eb88d None admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:58.878619 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a65445-95e2-4304-ba37-d039417eb88d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:58.878944 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a65445-95e2-4304-ba37-d039417eb88d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:58.880383 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a65445-95e2-4304-ba37-d039417eb88d None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:58.905694 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 557/1092] 10.222.0.40 () {56 vars in 1133 bytes} [Thu Jul 14 09:25:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:25:58.911510 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373cdf19-720d-42ad-92f4-35339f519945 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:59.015666 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373cdf19-720d-42ad-92f4-35339f519945 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:59.050403 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fe45ea-5d0f-4ea0-8842-3378fad9d072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:59.051049 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fe45ea-5d0f-4ea0-8842-3378fad9d072 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:59.051331 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fe45ea-5d0f-4ea0-8842-3378fad9d072 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:59.051605 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fe45ea-5d0f-4ea0-8842-3378fad9d072 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:59.086918 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:59.133454 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fe45ea-5d0f-4ea0-8842-3378fad9d072 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:59.134940 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fe45ea-5d0f-4ea0-8842-3378fad9d072 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:59.234634 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22ff63c-ecc1-4362-9ea2-08936400d5ab None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:59.235035 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22ff63c-ecc1-4362-9ea2-08936400d5ab None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:59.235390 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22ff63c-ecc1-4362-9ea2-08936400d5ab None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:59.236889 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 558/1093] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:25:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 09:25:59.238875 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 536/1094] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 14 09:25:58 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 09:25:59.245092 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22ff63c-ecc1-4362-9ea2-08936400d5ab None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:59.246358 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24302cc5-181a-4898-a773-d56191547bf5 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:59.246647 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24302cc5-181a-4898-a773-d56191547bf5 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:59.246919 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24302cc5-181a-4898-a773-d56191547bf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:59.249020 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:59.266540 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-24302cc5-181a-4898-a773-d56191547bf5 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:25:59.267653 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-24302cc5-181a-4898-a773-d56191547bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:25:59.327845 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:59.342602 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 537/1095] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:25:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 09:25:59.367636 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24302cc5-181a-4898-a773-d56191547bf5 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:59.368187 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22ff63c-ecc1-4362-9ea2-08936400d5ab None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:59.403835 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158c57ab-dbb1-4506-84d0-897f6b1e0a91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:59.404649 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158c57ab-dbb1-4506-84d0-897f6b1e0a91 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:59.405002 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158c57ab-dbb1-4506-84d0-897f6b1e0a91 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:59.405216 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158c57ab-dbb1-4506-84d0-897f6b1e0a91 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:59.416504 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158c57ab-dbb1-4506-84d0-897f6b1e0a91 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:59.418220 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158c57ab-dbb1-4506-84d0-897f6b1e0a91 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:59.437241 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-158c57ab-dbb1-4506-84d0-897f6b1e0a91 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:25:59.437241 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:25:59.437241 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:25:59.437241 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:25:59.437241 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:25:59.437241 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:25:59.437241 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:25:59.437241 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:25:59.437241 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:25:59.437241 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:25:59.437241 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:25:59.437241 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:25:59.437241 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 09:25:59.437241 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 09:25:59.437241 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 09:25:59.438601 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 09:25:59.438601 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:25:59.438601 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:25:59.438601 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:25:59.438601 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:25:59.438601 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:25:59.438601 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:25:59.438601 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:25:59.438601 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( Jul 14 09:25:59.438601 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:25:59.438601 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:25:59.438601 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:25:59.438601 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:25:59.438601 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:25:59.438601 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:25:59.438601 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:25:59.438601 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:25:59.439963 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 09:25:59.439963 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 09:25:59.439963 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:25:59.439963 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Jul 14 09:25:59.439963 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 559/1096] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 09:25:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 09:25:59.444294 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158c57ab-dbb1-4506-84d0-897f6b1e0a91 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:59.484332 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24302cc5-181a-4898-a773-d56191547bf5 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:59.507572 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:59.523248 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa9daef-0c04-40f4-b0ab-379401561a4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:59.523974 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa9daef-0c04-40f4-b0ab-379401561a4f None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:59.524257 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa9daef-0c04-40f4-b0ab-379401561a4f None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:59.524535 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa9daef-0c04-40f4-b0ab-379401561a4f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:59.539486 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa9daef-0c04-40f4-b0ab-379401561a4f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:25:59.547242 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-6fa9daef-0c04-40f4-b0ab-379401561a4f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 09:25:59.547242 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:25:59.547242 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:25:59.547242 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:25:59.547242 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:25:59.547242 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:25:59.547242 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:25:59.547242 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:25:59.547242 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:25:59.547242 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:25:59.547242 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:25:59.547242 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:25:59.547242 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:25:59.547242 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:25:59.547242 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:25:59.547242 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:25:59.548432 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:25:59.548432 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:25:59.548432 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:25:59.548432 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:25:59.548432 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:25:59.548432 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:25:59.548432 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:25:59.548432 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:25:59.548432 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:25:59.548432 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:25:59.548432 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:25:59.548432 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( Jul 14 09:25:59.548432 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:25:59.548432 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:25:59.548432 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:25:59.548432 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:25:59.549291 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:25:59.549291 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:25:59.549291 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:25:59.549291 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:25:59.549291 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:25:59.549291 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:25:59.549291 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:25:59.549291 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:25:59.549291 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:25:59.549291 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:25:59.549291 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 09:25:59.549291 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:25:59.549291 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 538/1097] 10.222.0.40 () {56 vars in 1096 bytes} [Thu Jul 14 09:25:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 09:25:59.555647 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa9daef-0c04-40f4-b0ab-379401561a4f None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:59.557082 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158c57ab-dbb1-4506-84d0-897f6b1e0a91 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:59.598885 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb22440-7a61-492a-a8a4-52915409d692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:59.599653 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb22440-7a61-492a-a8a4-52915409d692 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:59.599992 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb22440-7a61-492a-a8a4-52915409d692 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:59.600328 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb22440-7a61-492a-a8a4-52915409d692 None admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:59.601118 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb22440-7a61-492a-a8a4-52915409d692 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:59.601483 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb22440-7a61-492a-a8a4-52915409d692 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:59.602996 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb22440-7a61-492a-a8a4-52915409d692 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:59.615308 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:59.626393 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 560/1098] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 14 09:25:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:25:59.632760 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb22440-7a61-492a-a8a4-52915409d692 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:59.669747 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa9daef-0c04-40f4-b0ab-379401561a4f None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:59.706544 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082d6629-bfc0-47ce-a76d-90e4d416842a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:59.707224 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082d6629-bfc0-47ce-a76d-90e4d416842a None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:59.707505 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082d6629-bfc0-47ce-a76d-90e4d416842a None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:59.707781 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082d6629-bfc0-47ce-a76d-90e4d416842a None admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:59.708726 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082d6629-bfc0-47ce-a76d-90e4d416842a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:59.709033 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082d6629-bfc0-47ce-a76d-90e4d416842a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:59.710438 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082d6629-bfc0-47ce-a76d-90e4d416842a None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:59.719222 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 539/1099] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 14 09:25:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:25:59.725589 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082d6629-bfc0-47ce-a76d-90e4d416842a None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:59.741530 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb22440-7a61-492a-a8a4-52915409d692 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:59.758288 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:59.779111 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7caa5d7-7229-46db-b4f2-986bdf0165b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:59.779821 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7caa5d7-7229-46db-b4f2-986bdf0165b9 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:59.780104 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7caa5d7-7229-46db-b4f2-986bdf0165b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:59.780380 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7caa5d7-7229-46db-b4f2-986bdf0165b9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:59.790593 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7caa5d7-7229-46db-b4f2-986bdf0165b9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:59.792245 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7caa5d7-7229-46db-b4f2-986bdf0165b9 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:59.807738 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-b7caa5d7-7229-46db-b4f2-986bdf0165b9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 09:25:59.807738 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:25:59.807738 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:25:59.807738 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:25:59.807738 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:25:59.807738 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:25:59.807738 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:25:59.807738 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:25:59.807738 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:25:59.807738 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:25:59.807738 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:25:59.807738 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:25:59.807738 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 09:25:59.807738 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 09:25:59.807738 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 09:25:59.808874 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 09:25:59.808874 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:25:59.808874 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:25:59.808874 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:25:59.808874 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:25:59.808874 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:25:59.808874 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:25:59.808874 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:25:59.808874 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( Jul 14 09:25:59.808874 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:25:59.808874 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:25:59.808874 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:25:59.808874 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:25:59.808874 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:25:59.808874 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:25:59.808874 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:25:59.808874 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:25:59.810135 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 09:25:59.810135 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 09:25:59.810135 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 09:25:59.810135 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 09:25:59.810135 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 09:25:59.810135 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 09:25:59.810135 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 09:25:59.810135 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Jul 14 09:25:59.810135 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 561/1100] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jul 14 09:25:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 09:25:59.814932 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7caa5d7-7229-46db-b4f2-986bdf0165b9 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:59.842606 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082d6629-bfc0-47ce-a76d-90e4d416842a None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:59.854179 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:25:59.885839 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aa9810-ec1b-4bb0-b2db-6b160670bd75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:59.886862 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aa9810-ec1b-4bb0-b2db-6b160670bd75 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:59.887260 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aa9810-ec1b-4bb0-b2db-6b160670bd75 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:59.887647 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aa9810-ec1b-4bb0-b2db-6b160670bd75 None admin] PATH_INFO: `/v3/users/602d56b536e94914b97a841cbf23e182` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:59.889123 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83aa9810-ec1b-4bb0-b2db-6b160670bd75 None admin] RBAC: Authorizing `identity:get_user(user_id=602d56b536e94914b97a841cbf23e182)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:59.890666 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83aa9810-ec1b-4bb0-b2db-6b160670bd75 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:59.892359 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 540/1101] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jul 14 09:25:59 2022] GET /identity/v3/users/602d56b536e94914b97a841cbf23e182 => generated 285 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:25:59.898249 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aa9810-ec1b-4bb0-b2db-6b160670bd75 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:25:59.922769 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7caa5d7-7229-46db-b4f2-986bdf0165b9 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:25:59.957872 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0754bfb1-48c9-474c-9c1f-4da2e62eb9f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:25:59.958661 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0754bfb1-48c9-474c-9c1f-4da2e62eb9f0 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:25:59.958948 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0754bfb1-48c9-474c-9c1f-4da2e62eb9f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:25:59.959223 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0754bfb1-48c9-474c-9c1f-4da2e62eb9f0 None admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:25:59.960021 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0754bfb1-48c9-474c-9c1f-4da2e62eb9f0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:25:59.960327 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0754bfb1-48c9-474c-9c1f-4da2e62eb9f0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:25:59.961766 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0754bfb1-48c9-474c-9c1f-4da2e62eb9f0 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:25:59.975246 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 562/1102] 10.222.0.40 () {56 vars in 1148 bytes} [Thu Jul 14 09:25:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:25:59.981584 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0754bfb1-48c9-474c-9c1f-4da2e62eb9f0 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:00.007872 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aa9810-ec1b-4bb0-b2db-6b160670bd75 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:00.018367 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:26:00.044502 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d85ee7-2ff6-45a9-9237-bd9045a64beb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:00.045081 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d85ee7-2ff6-45a9-9237-bd9045a64beb None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:00.045370 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d85ee7-2ff6-45a9-9237-bd9045a64beb None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:00.045649 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d85ee7-2ff6-45a9-9237-bd9045a64beb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:00.091623 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0754bfb1-48c9-474c-9c1f-4da2e62eb9f0 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:00.093391 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:26:00.119171 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d85ee7-2ff6-45a9-9237-bd9045a64beb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:00.120636 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d85ee7-2ff6-45a9-9237-bd9045a64beb None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:00.136579 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a9fb29-35a0-45ca-b91f-400feceff8bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:00.137282 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a9fb29-35a0-45ca-b91f-400feceff8bb None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:00.137563 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a9fb29-35a0-45ca-b91f-400feceff8bb None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:00.137837 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a9fb29-35a0-45ca-b91f-400feceff8bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:00.138708 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a9fb29-35a0-45ca-b91f-400feceff8bb None admin] RBAC: Adding query filter params (role.id=717b56da664944778c6bfc5e1c95909f, scope.project.id=a478e76f04dd413f89ddfba7b0cdc9cc, user.id=1f6962106dfa4c4c9af551053f8095e9) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:26:00.139026 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a9fb29-35a0-45ca-b91f-400feceff8bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:00.140482 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a9fb29-35a0-45ca-b91f-400feceff8bb None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:00.162217 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 563/1103] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jul 14 09:25:59 2022] GET /identity/v3/role_assignments?user.id=1f6962106dfa4c4c9af551053f8095e9&scope.project.id=a478e76f04dd413f89ddfba7b0cdc9cc&role.id=717b56da664944778c6bfc5e1c95909f => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:26:00.233591 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 541/1104] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 14 09:25:59 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 14 09:26:00.239834 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a9fb29-35a0-45ca-b91f-400feceff8bb None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:00.348227 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:26:00.352879 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a9fb29-35a0-45ca-b91f-400feceff8bb None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:00.390268 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fe30eb-8128-4776-9e22-884ee7949d47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:00.391151 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fe30eb-8128-4776-9e22-884ee7949d47 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:00.391433 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fe30eb-8128-4776-9e22-884ee7949d47 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:00.391708 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fe30eb-8128-4776-9e22-884ee7949d47 None admin] PATH_INFO: `/v3/projects/4968ea36db5e4272910e325c990ee691` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:00.392916 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fe30eb-8128-4776-9e22-884ee7949d47 None admin] RBAC: Authorizing `identity:get_project(project_id=4968ea36db5e4272910e325c990ee691)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:00.394945 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fe30eb-8128-4776-9e22-884ee7949d47 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:00.397438 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 564/1105] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jul 14 09:26:00 2022] GET /identity/v3/projects/4968ea36db5e4272910e325c990ee691 => generated 311 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:26:00.403122 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d85ee7-2ff6-45a9-9237-bd9045a64beb None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:00.500267 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:26:00.528994 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d85ee7-2ff6-45a9-9237-bd9045a64beb None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:00.568244 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9f332c-d644-4d7e-81e7-15ef0313fc0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:00.568916 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9f332c-d644-4d7e-81e7-15ef0313fc0e None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:00.569211 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9f332c-d644-4d7e-81e7-15ef0313fc0e None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:00.569495 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9f332c-d644-4d7e-81e7-15ef0313fc0e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:00.570380 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9f332c-d644-4d7e-81e7-15ef0313fc0e None admin] RBAC: Adding query filter params (role.id=e3965bd0d5f1427a86a313c0c90bfef3, scope.project.id=4968ea36db5e4272910e325c990ee691, user.id=602d56b536e94914b97a841cbf23e182) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:26:00.570708 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9f332c-d644-4d7e-81e7-15ef0313fc0e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:00.572157 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9f332c-d644-4d7e-81e7-15ef0313fc0e None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:00.579085 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 542/1106] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jul 14 09:26:00 2022] GET /identity/v3/role_assignments?user.id=602d56b536e94914b97a841cbf23e182&scope.project.id=4968ea36db5e4272910e325c990ee691&role.id=e3965bd0d5f1427a86a313c0c90bfef3 => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:26:02.709269 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef490dbf-edf6-492b-9faa-15b15660ba6f None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:02.709841 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef490dbf-edf6-492b-9faa-15b15660ba6f None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:02.709841 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef490dbf-edf6-492b-9faa-15b15660ba6f None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:02.711188 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 565/1107] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:26:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:26:02.716663 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba06b071-8256-4d4f-a32f-9697f93ddf5b None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:02.717124 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba06b071-8256-4d4f-a32f-9697f93ddf5b None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:02.717246 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba06b071-8256-4d4f-a32f-9697f93ddf5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:02.735784 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-ba06b071-8256-4d4f-a32f-9697f93ddf5b None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:26:02.736977 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-ba06b071-8256-4d4f-a32f-9697f93ddf5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:26:02.806544 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 543/1108] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:26:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 09:26:02.831225 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef490dbf-edf6-492b-9faa-15b15660ba6f None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:02.934716 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef490dbf-edf6-492b-9faa-15b15660ba6f None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:02.968099 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42008b43-767f-4bfb-95f9-1680031567e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:02.968895 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42008b43-767f-4bfb-95f9-1680031567e8 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:02.969175 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42008b43-767f-4bfb-95f9-1680031567e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:02.969448 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42008b43-767f-4bfb-95f9-1680031567e8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:02.970643 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42008b43-767f-4bfb-95f9-1680031567e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:02.972645 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42008b43-767f-4bfb-95f9-1680031567e8 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:02.974266 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 566/1109] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 09:26:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:26:02.980245 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba06b071-8256-4d4f-a32f-9697f93ddf5b None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:03.055579 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:26:03.084856 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba06b071-8256-4d4f-a32f-9697f93ddf5b None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:03.119271 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6093a37c-0e0a-422d-9de2-0abf471964b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:03.120034 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6093a37c-0e0a-422d-9de2-0abf471964b3 None admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:03.120330 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6093a37c-0e0a-422d-9de2-0abf471964b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:03.120609 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6093a37c-0e0a-422d-9de2-0abf471964b3 None admin] PATH_INFO: `/v3/users` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:03.121339 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6093a37c-0e0a-422d-9de2-0abf471964b3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:03.122905 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6093a37c-0e0a-422d-9de2-0abf471964b3 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:03.142660 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 544/1110] 10.222.0.40 () {60 vars in 1132 bytes} [Thu Jul 14 09:26:02 2022] POST /identity/v3/users => generated 286 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 09:26:05.232748 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c2b459-d007-4aab-a125-96f61f31533e None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:05.233332 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c2b459-d007-4aab-a125-96f61f31533e None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:05.233332 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c2b459-d007-4aab-a125-96f61f31533e None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:05.234802 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 567/1111] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:26:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:26:05.245606 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6100f0e-7952-450c-ade7-9a4d4d4a8b14 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:05.246103 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6100f0e-7952-450c-ade7-9a4d4d4a8b14 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:05.246234 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6100f0e-7952-450c-ade7-9a4d4d4a8b14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:05.263749 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-e6100f0e-7952-450c-ade7-9a4d4d4a8b14 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:26:05.264941 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-e6100f0e-7952-450c-ade7-9a4d4d4a8b14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:26:05.332616 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 545/1112] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:26:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 09:26:05.355772 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c2b459-d007-4aab-a125-96f61f31533e None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:05.392909 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:26:05.471660 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c2b459-d007-4aab-a125-96f61f31533e None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:05.515798 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1355ab9-72dc-4c9b-8a63-2472a1b3b751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:05.516508 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1355ab9-72dc-4c9b-8a63-2472a1b3b751 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:05.516798 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1355ab9-72dc-4c9b-8a63-2472a1b3b751 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:05.517078 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1355ab9-72dc-4c9b-8a63-2472a1b3b751 None admin] PATH_INFO: `/v3/roles/f755c764373f47bababa1e942a53c2e1` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:05.518640 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1355ab9-72dc-4c9b-8a63-2472a1b3b751 None admin] RBAC: Authorizing `identity:get_role(role_id=f755c764373f47bababa1e942a53c2e1)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:05.520025 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1355ab9-72dc-4c9b-8a63-2472a1b3b751 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:05.521419 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 568/1113] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jul 14 09:26:05 2022] GET /identity/v3/roles/f755c764373f47bababa1e942a53c2e1 => generated 223 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:26:05.527287 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6100f0e-7952-450c-ade7-9a4d4d4a8b14 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:05.585820 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:26:05.634394 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6100f0e-7952-450c-ade7-9a4d4d4a8b14 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:05.668691 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7fc7bb-3be2-4d5b-b037-8c0864f8b9f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:05.669569 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7fc7bb-3be2-4d5b-b037-8c0864f8b9f7 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:05.669856 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7fc7bb-3be2-4d5b-b037-8c0864f8b9f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:05.670134 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7fc7bb-3be2-4d5b-b037-8c0864f8b9f7 None admin] PATH_INFO: `/v3/users/8ee149680b3c4907af7db114b09282e7` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:05.685559 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7fc7bb-3be2-4d5b-b037-8c0864f8b9f7 None admin] RBAC: Authorizing `identity:get_user(user_id=8ee149680b3c4907af7db114b09282e7)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:05.687055 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7fc7bb-3be2-4d5b-b037-8c0864f8b9f7 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:05.688808 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 546/1114] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jul 14 09:26:05 2022] GET /identity/v3/users/8ee149680b3c4907af7db114b09282e7 => generated 286 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:26:05.695301 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1355ab9-72dc-4c9b-8a63-2472a1b3b751 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:05.807381 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1355ab9-72dc-4c9b-8a63-2472a1b3b751 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:05.809651 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:26:05.844041 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae0d8bd-84c3-472a-824e-9470e6bbf522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:05.844695 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae0d8bd-84c3-472a-824e-9470e6bbf522 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:05.844979 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae0d8bd-84c3-472a-824e-9470e6bbf522 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:05.845255 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae0d8bd-84c3-472a-824e-9470e6bbf522 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:05.914464 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae0d8bd-84c3-472a-824e-9470e6bbf522 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:05.915929 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae0d8bd-84c3-472a-824e-9470e6bbf522 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:06.014912 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 569/1115] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 14 09:26:05 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 09:26:06.021572 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7fc7bb-3be2-4d5b-b037-8c0864f8b9f7 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:06.121952 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7fc7bb-3be2-4d5b-b037-8c0864f8b9f7 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:06.138920 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:26:06.156547 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c800ebf-1679-492f-b999-2958a52bf09e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:06.157403 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c800ebf-1679-492f-b999-2958a52bf09e None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:06.157689 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c800ebf-1679-492f-b999-2958a52bf09e None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:06.157962 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c800ebf-1679-492f-b999-2958a52bf09e None admin] PATH_INFO: `/v3/projects/4968ea36db5e4272910e325c990ee691` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:06.159173 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c800ebf-1679-492f-b999-2958a52bf09e None admin] RBAC: Authorizing `identity:get_project(project_id=4968ea36db5e4272910e325c990ee691)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:06.160599 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c800ebf-1679-492f-b999-2958a52bf09e None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:06.162489 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 547/1116] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jul 14 09:26:06 2022] GET /identity/v3/projects/4968ea36db5e4272910e325c990ee691 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:26:06.168710 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae0d8bd-84c3-472a-824e-9470e6bbf522 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:06.175091 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:26:06.272592 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae0d8bd-84c3-472a-824e-9470e6bbf522 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:06.306439 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba77279-b016-44b5-bfcc-89d20b1eca6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:06.307102 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba77279-b016-44b5-bfcc-89d20b1eca6d None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:06.307388 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba77279-b016-44b5-bfcc-89d20b1eca6d None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:06.307666 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba77279-b016-44b5-bfcc-89d20b1eca6d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:06.308502 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba77279-b016-44b5-bfcc-89d20b1eca6d None admin] RBAC: Adding query filter params (role.id=f755c764373f47bababa1e942a53c2e1, scope.project.id=4968ea36db5e4272910e325c990ee691, user.id=8ee149680b3c4907af7db114b09282e7) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:26:06.308815 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba77279-b016-44b5-bfcc-89d20b1eca6d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:06.310268 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba77279-b016-44b5-bfcc-89d20b1eca6d None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:06.316567 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 570/1117] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jul 14 09:26:06 2022] GET /identity/v3/role_assignments?user.id=8ee149680b3c4907af7db114b09282e7&scope.project.id=4968ea36db5e4272910e325c990ee691&role.id=f755c764373f47bababa1e942a53c2e1 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:26:08.343330 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7103c591-e44c-4a4e-8a14-f890a47282b5 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:08.343879 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7103c591-e44c-4a4e-8a14-f890a47282b5 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:08.343879 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7103c591-e44c-4a4e-8a14-f890a47282b5 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:08.345255 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 548/1118] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:26:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:26:08.350807 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464a162e-02c5-4c59-9303-cf093b84b51b None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:08.351256 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464a162e-02c5-4c59-9303-cf093b84b51b None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:08.351347 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464a162e-02c5-4c59-9303-cf093b84b51b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:08.369052 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-464a162e-02c5-4c59-9303-cf093b84b51b None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:26:08.370289 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-464a162e-02c5-4c59-9303-cf093b84b51b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:26:08.432678 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:26:08.438498 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 571/1119] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:26:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 09:26:08.465761 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7103c591-e44c-4a4e-8a14-f890a47282b5 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:08.575126 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7103c591-e44c-4a4e-8a14-f890a47282b5 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:08.624060 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3df6715-e363-4c25-877e-f3bfea14c38d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:08.625382 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3df6715-e363-4c25-877e-f3bfea14c38d None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:08.625830 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3df6715-e363-4c25-877e-f3bfea14c38d None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:08.626317 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3df6715-e363-4c25-877e-f3bfea14c38d None admin] PATH_INFO: `/v3/roles/f755c764373f47bababa1e942a53c2e1` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:08.629378 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3df6715-e363-4c25-877e-f3bfea14c38d None admin] RBAC: Authorizing `identity:get_role(role_id=f755c764373f47bababa1e942a53c2e1)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:08.631738 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3df6715-e363-4c25-877e-f3bfea14c38d None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:08.634134 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 549/1120] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jul 14 09:26:08 2022] GET /identity/v3/roles/f755c764373f47bababa1e942a53c2e1 => generated 223 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:26:08.639986 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464a162e-02c5-4c59-9303-cf093b84b51b None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:08.738621 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464a162e-02c5-4c59-9303-cf093b84b51b None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:08.771909 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69c45cd-e03a-44bd-82e3-83e9c286060f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:08.772789 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69c45cd-e03a-44bd-82e3-83e9c286060f None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:08.773072 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69c45cd-e03a-44bd-82e3-83e9c286060f None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:08.773349 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69c45cd-e03a-44bd-82e3-83e9c286060f None admin] PATH_INFO: `/v3/users/8ee149680b3c4907af7db114b09282e7` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:08.774590 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69c45cd-e03a-44bd-82e3-83e9c286060f None admin] RBAC: Authorizing `identity:get_user(user_id=8ee149680b3c4907af7db114b09282e7)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:08.776036 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69c45cd-e03a-44bd-82e3-83e9c286060f None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:08.777674 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 572/1121] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jul 14 09:26:08 2022] GET /identity/v3/users/8ee149680b3c4907af7db114b09282e7 => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:26:08.783615 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3df6715-e363-4c25-877e-f3bfea14c38d None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:08.843848 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:26:08.892947 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3df6715-e363-4c25-877e-f3bfea14c38d None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:08.930307 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7b5b49-58ff-4144-82cc-b12eb5eaa1f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:08.931168 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7b5b49-58ff-4144-82cc-b12eb5eaa1f4 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:08.931451 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7b5b49-58ff-4144-82cc-b12eb5eaa1f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:08.931726 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7b5b49-58ff-4144-82cc-b12eb5eaa1f4 None admin] PATH_INFO: `/v3/projects/4968ea36db5e4272910e325c990ee691` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:08.932938 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7b5b49-58ff-4144-82cc-b12eb5eaa1f4 None admin] RBAC: Authorizing `identity:get_project(project_id=4968ea36db5e4272910e325c990ee691)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:08.934405 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7b5b49-58ff-4144-82cc-b12eb5eaa1f4 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:08.936119 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 550/1122] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jul 14 09:26:08 2022] GET /identity/v3/projects/4968ea36db5e4272910e325c990ee691 => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:26:08.942468 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69c45cd-e03a-44bd-82e3-83e9c286060f None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:09.009152 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:26:09.048525 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69c45cd-e03a-44bd-82e3-83e9c286060f None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:09.083334 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe770b7-cdbc-4252-a510-5737034652e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:09.084224 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe770b7-cdbc-4252-a510-5737034652e0 None admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:09.084504 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe770b7-cdbc-4252-a510-5737034652e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:09.084781 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe770b7-cdbc-4252-a510-5737034652e0 None admin] PATH_INFO: `/v3/projects/4968ea36db5e4272910e325c990ee691/users/8ee149680b3c4907af7db114b09282e7/roles/f755c764373f47bababa1e942a53c2e1` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:09.087003 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe770b7-cdbc-4252-a510-5737034652e0 None admin] RBAC: Authorizing `identity:create_grant(project_id=4968ea36db5e4272910e325c990ee691, user_id=8ee149680b3c4907af7db114b09282e7, role_id=f755c764373f47bababa1e942a53c2e1)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:09.088444 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe770b7-cdbc-4252-a510-5737034652e0 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:09.101852 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 573/1123] 10.222.0.40 () {58 vars in 1439 bytes} [Thu Jul 14 09:26:08 2022] PUT /identity/v3/projects/4968ea36db5e4272910e325c990ee691/users/8ee149680b3c4907af7db114b09282e7/roles/f755c764373f47bababa1e942a53c2e1 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:26:11.147705 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcdc309-be26-474c-a828-d1bc5c7a1d2a None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:11.148244 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcdc309-be26-474c-a828-d1bc5c7a1d2a None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:11.148450 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcdc309-be26-474c-a828-d1bc5c7a1d2a None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:11.149840 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 551/1124] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:26:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:26:11.155515 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e039ef48-0d0b-44e1-9b29-59e89ce8911f None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:11.156001 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e039ef48-0d0b-44e1-9b29-59e89ce8911f None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:11.156093 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e039ef48-0d0b-44e1-9b29-59e89ce8911f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:11.173683 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-e039ef48-0d0b-44e1-9b29-59e89ce8911f None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:26:11.174927 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-e039ef48-0d0b-44e1-9b29-59e89ce8911f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:26:11.253333 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 574/1125] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:26:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 09:26:11.277648 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcdc309-be26-474c-a828-d1bc5c7a1d2a None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:11.380858 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcdc309-be26-474c-a828-d1bc5c7a1d2a None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:11.401896 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:26:11.417268 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a728b260-1f43-4906-a33e-b3da360e64f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:11.418133 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a728b260-1f43-4906-a33e-b3da360e64f3 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:11.418448 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a728b260-1f43-4906-a33e-b3da360e64f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:11.418727 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a728b260-1f43-4906-a33e-b3da360e64f3 None admin] PATH_INFO: `/v3/roles/f755c764373f47bababa1e942a53c2e1` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:11.420223 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a728b260-1f43-4906-a33e-b3da360e64f3 None admin] RBAC: Authorizing `identity:get_role(role_id=f755c764373f47bababa1e942a53c2e1)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:11.421607 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a728b260-1f43-4906-a33e-b3da360e64f3 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:11.423053 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 552/1126] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jul 14 09:26:11 2022] GET /identity/v3/roles/f755c764373f47bababa1e942a53c2e1 => generated 223 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:26:11.429480 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e039ef48-0d0b-44e1-9b29-59e89ce8911f None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:11.486153 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:26:11.548850 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e039ef48-0d0b-44e1-9b29-59e89ce8911f None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:11.586301 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946561e5-8c9b-42c6-bfb8-370d1ab7f8c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:11.587292 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946561e5-8c9b-42c6-bfb8-370d1ab7f8c6 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:11.587582 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946561e5-8c9b-42c6-bfb8-370d1ab7f8c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:11.587864 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946561e5-8c9b-42c6-bfb8-370d1ab7f8c6 None admin] PATH_INFO: `/v3/users/8ee149680b3c4907af7db114b09282e7` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:11.589099 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946561e5-8c9b-42c6-bfb8-370d1ab7f8c6 None admin] RBAC: Authorizing `identity:get_user(user_id=8ee149680b3c4907af7db114b09282e7)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:11.590593 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946561e5-8c9b-42c6-bfb8-370d1ab7f8c6 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:11.592244 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 575/1127] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jul 14 09:26:11 2022] GET /identity/v3/users/8ee149680b3c4907af7db114b09282e7 => generated 286 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:26:11.598042 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a728b260-1f43-4906-a33e-b3da360e64f3 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:11.700561 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a728b260-1f43-4906-a33e-b3da360e64f3 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:11.734493 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af41c4b-047d-4c2a-b20a-2de45e924d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:11.735136 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af41c4b-047d-4c2a-b20a-2de45e924d18 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:11.735417 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af41c4b-047d-4c2a-b20a-2de45e924d18 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:11.735689 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af41c4b-047d-4c2a-b20a-2de45e924d18 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:11.800470 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:26:11.816762 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af41c4b-047d-4c2a-b20a-2de45e924d18 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:11.818322 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af41c4b-047d-4c2a-b20a-2de45e924d18 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:11.917387 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 553/1128] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 14 09:26:11 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 09:26:11.923573 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946561e5-8c9b-42c6-bfb8-370d1ab7f8c6 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:12.023837 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946561e5-8c9b-42c6-bfb8-370d1ab7f8c6 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:12.047785 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:26:12.067076 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84488891-5a41-432b-a530-bf1af02490bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:12.067956 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84488891-5a41-432b-a530-bf1af02490bf None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:12.068267 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84488891-5a41-432b-a530-bf1af02490bf None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:12.068547 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84488891-5a41-432b-a530-bf1af02490bf None admin] PATH_INFO: `/v3/projects/4968ea36db5e4272910e325c990ee691` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:12.069756 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84488891-5a41-432b-a530-bf1af02490bf None admin] RBAC: Authorizing `identity:get_project(project_id=4968ea36db5e4272910e325c990ee691)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:12.071240 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84488891-5a41-432b-a530-bf1af02490bf None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:12.073100 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 576/1129] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jul 14 09:26:11 2022] GET /identity/v3/projects/4968ea36db5e4272910e325c990ee691 => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:26:12.081669 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af41c4b-047d-4c2a-b20a-2de45e924d18 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:12.171938 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:26:12.184792 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af41c4b-047d-4c2a-b20a-2de45e924d18 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:12.219452 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15486eb9-f9ed-4077-9fcb-b814dbcb5cba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:12.220147 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15486eb9-f9ed-4077-9fcb-b814dbcb5cba None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:12.220434 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15486eb9-f9ed-4077-9fcb-b814dbcb5cba None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:12.220713 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15486eb9-f9ed-4077-9fcb-b814dbcb5cba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:12.222108 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15486eb9-f9ed-4077-9fcb-b814dbcb5cba None admin] RBAC: Adding query filter params (role.id=f755c764373f47bababa1e942a53c2e1, scope.project.id=4968ea36db5e4272910e325c990ee691, user.id=8ee149680b3c4907af7db114b09282e7) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:26:12.222456 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15486eb9-f9ed-4077-9fcb-b814dbcb5cba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:12.223913 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15486eb9-f9ed-4077-9fcb-b814dbcb5cba None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:12.230225 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 554/1130] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jul 14 09:26:12 2022] GET /identity/v3/role_assignments?user.id=8ee149680b3c4907af7db114b09282e7&scope.project.id=4968ea36db5e4272910e325c990ee691&role.id=f755c764373f47bababa1e942a53c2e1 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:26:14.316506 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3026af15-2b62-4285-82d7-7d6655e479f1 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:14.317131 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3026af15-2b62-4285-82d7-7d6655e479f1 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:14.317131 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3026af15-2b62-4285-82d7-7d6655e479f1 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:14.318466 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 577/1131] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:26:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:26:14.324148 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db0f3b4-3ea0-4551-813c-74d229fd0f22 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:14.324602 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db0f3b4-3ea0-4551-813c-74d229fd0f22 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:14.324708 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db0f3b4-3ea0-4551-813c-74d229fd0f22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:14.341737 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-0db0f3b4-3ea0-4551-813c-74d229fd0f22 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:26:14.343070 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-0db0f3b4-3ea0-4551-813c-74d229fd0f22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:26:14.409009 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 555/1132] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:26:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 09:26:14.437552 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3026af15-2b62-4285-82d7-7d6655e479f1 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:14.545405 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3026af15-2b62-4285-82d7-7d6655e479f1 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:14.580213 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfc8c4c-4bf8-4694-9e9f-466f52d6a5ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:14.581082 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfc8c4c-4bf8-4694-9e9f-466f52d6a5ca None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:14.581368 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfc8c4c-4bf8-4694-9e9f-466f52d6a5ca None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:14.581645 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfc8c4c-4bf8-4694-9e9f-466f52d6a5ca None admin] PATH_INFO: `/v3/domains/default` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:14.582847 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfc8c4c-4bf8-4694-9e9f-466f52d6a5ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:14.584290 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfc8c4c-4bf8-4694-9e9f-466f52d6a5ca None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:14.585913 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 578/1133] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 09:26:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:26:14.592005 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db0f3b4-3ea0-4551-813c-74d229fd0f22 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:14.676354 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:26:14.695655 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db0f3b4-3ea0-4551-813c-74d229fd0f22 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:14.730080 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb266bb-bff5-4902-95d7-02165bb26ed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:14.730781 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb266bb-bff5-4902-95d7-02165bb26ed3 None admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:14.731064 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb266bb-bff5-4902-95d7-02165bb26ed3 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:14.731339 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb266bb-bff5-4902-95d7-02165bb26ed3 None admin] PATH_INFO: `/v3/projects` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:14.732053 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb266bb-bff5-4902-95d7-02165bb26ed3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:14.733481 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb266bb-bff5-4902-95d7-02165bb26ed3 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:14.760785 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 556/1134] 10.222.0.40 () {60 vars in 1141 bytes} [Thu Jul 14 09:26:14 2022] POST /identity/v3/projects => generated 311 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:26:16.831801 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015729a2-b62c-47f5-a68e-66155f9dd7d9 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:16.832325 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015729a2-b62c-47f5-a68e-66155f9dd7d9 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:16.832325 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015729a2-b62c-47f5-a68e-66155f9dd7d9 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:16.833643 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 579/1135] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:26:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:26:16.838996 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337e244b-26d3-4ed1-8c36-7e04af78f8e4 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:16.839389 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337e244b-26d3-4ed1-8c36-7e04af78f8e4 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:16.839561 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337e244b-26d3-4ed1-8c36-7e04af78f8e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:16.855942 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-337e244b-26d3-4ed1-8c36-7e04af78f8e4 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:26:16.857135 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-337e244b-26d3-4ed1-8c36-7e04af78f8e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:26:16.924614 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 557/1136] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:26:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 09:26:16.949108 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015729a2-b62c-47f5-a68e-66155f9dd7d9 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:17.009382 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:26:17.051109 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015729a2-b62c-47f5-a68e-66155f9dd7d9 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:17.086116 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f6499b-c0c5-46cb-95ce-7bb1bfe1e2ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:17.086863 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f6499b-c0c5-46cb-95ce-7bb1bfe1e2ff None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:17.087151 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f6499b-c0c5-46cb-95ce-7bb1bfe1e2ff None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:17.087430 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f6499b-c0c5-46cb-95ce-7bb1bfe1e2ff None admin] PATH_INFO: `/v3/domains/default` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:17.088623 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f6499b-c0c5-46cb-95ce-7bb1bfe1e2ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:17.090067 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f6499b-c0c5-46cb-95ce-7bb1bfe1e2ff None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:17.091740 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 580/1137] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 09:26:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:26:17.098102 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337e244b-26d3-4ed1-8c36-7e04af78f8e4 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:17.157784 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:26:17.197881 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337e244b-26d3-4ed1-8c36-7e04af78f8e4 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:17.232185 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9d6926-e094-45c4-8b49-b1fb95b18421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:17.232859 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9d6926-e094-45c4-8b49-b1fb95b18421 None admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:17.233140 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9d6926-e094-45c4-8b49-b1fb95b18421 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:17.233413 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9d6926-e094-45c4-8b49-b1fb95b18421 None admin] PATH_INFO: `/v3/users` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:17.234137 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9d6926-e094-45c4-8b49-b1fb95b18421 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:17.235596 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9d6926-e094-45c4-8b49-b1fb95b18421 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:17.256423 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 558/1138] 10.222.0.40 () {60 vars in 1132 bytes} [Thu Jul 14 09:26:17 2022] POST /identity/v3/users => generated 286 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:26:19.329445 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b320b74-e50d-41cb-a472-f9d467a4cf32 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:19.330019 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b320b74-e50d-41cb-a472-f9d467a4cf32 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:19.330019 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b320b74-e50d-41cb-a472-f9d467a4cf32 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:19.331398 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 581/1139] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:26:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:26:19.336451 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3a81b3-27eb-44f6-8626-a5827371c6c7 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:19.336867 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3a81b3-27eb-44f6-8626-a5827371c6c7 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:19.337017 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3a81b3-27eb-44f6-8626-a5827371c6c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:19.353869 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-ed3a81b3-27eb-44f6-8626-a5827371c6c7 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:26:19.355093 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-ed3a81b3-27eb-44f6-8626-a5827371c6c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:26:19.425344 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 559/1140] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:26:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 09:26:19.448628 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b320b74-e50d-41cb-a472-f9d467a4cf32 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:19.548073 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b320b74-e50d-41cb-a472-f9d467a4cf32 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:19.573770 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:26:19.582290 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988801eb-8829-4024-b3e0-5177b2ef329f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:19.583021 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988801eb-8829-4024-b3e0-5177b2ef329f None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:19.583311 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988801eb-8829-4024-b3e0-5177b2ef329f None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:19.583594 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988801eb-8829-4024-b3e0-5177b2ef329f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:19.593620 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988801eb-8829-4024-b3e0-5177b2ef329f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:26:19.601945 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-988801eb-8829-4024-b3e0-5177b2ef329f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 09:26:19.601945 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:26:19.601945 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:26:19.601945 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:26:19.601945 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:26:19.601945 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:26:19.601945 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:26:19.601945 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:26:19.601945 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:26:19.601945 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:26:19.601945 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:26:19.601945 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:26:19.601945 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:26:19.601945 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:26:19.601945 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:26:19.601945 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:26:19.603059 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:26:19.603059 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:26:19.603059 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:26:19.603059 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:26:19.603059 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:26:19.603059 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:26:19.603059 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:26:19.603059 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:26:19.603059 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:26:19.603059 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:26:19.603059 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:26:19.603059 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( Jul 14 09:26:19.603059 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:26:19.603059 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:26:19.603059 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:26:19.603059 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:26:19.604077 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:26:19.604077 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:26:19.604077 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:26:19.604077 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:26:19.604077 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:26:19.604077 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:26:19.604077 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:26:19.604077 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:26:19.604077 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:26:19.604077 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:26:19.604077 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 09:26:19.604077 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Jul 14 09:26:19.604077 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 582/1141] 10.222.0.40 () {56 vars in 1096 bytes} [Thu Jul 14 09:26:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:26:19.609176 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3a81b3-27eb-44f6-8626-a5827371c6c7 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:19.656969 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:26:19.706351 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3a81b3-27eb-44f6-8626-a5827371c6c7 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:19.739248 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526ff9ad-6015-4853-b948-f266f143054e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:19.739928 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526ff9ad-6015-4853-b948-f266f143054e None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:19.740470 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526ff9ad-6015-4853-b948-f266f143054e None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:19.740751 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526ff9ad-6015-4853-b948-f266f143054e None admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:19.741511 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526ff9ad-6015-4853-b948-f266f143054e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:26:19.741823 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526ff9ad-6015-4853-b948-f266f143054e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:19.743232 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526ff9ad-6015-4853-b948-f266f143054e None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:19.751273 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 560/1142] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 14 09:26:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:26:19.757029 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988801eb-8829-4024-b3e0-5177b2ef329f None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:19.855347 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988801eb-8829-4024-b3e0-5177b2ef329f None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:19.887573 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18508829-b77e-4edc-a22e-58f581cb1934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:19.888432 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18508829-b77e-4edc-a22e-58f581cb1934 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:19.888717 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18508829-b77e-4edc-a22e-58f581cb1934 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:19.888992 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18508829-b77e-4edc-a22e-58f581cb1934 None admin] PATH_INFO: `/v3/users/aa03b09f25134cffa6914bc1b309b076` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:19.902175 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18508829-b77e-4edc-a22e-58f581cb1934 None admin] RBAC: Authorizing `identity:get_user(user_id=aa03b09f25134cffa6914bc1b309b076)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:19.903629 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18508829-b77e-4edc-a22e-58f581cb1934 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:19.905258 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 583/1143] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jul 14 09:26:19 2022] GET /identity/v3/users/aa03b09f25134cffa6914bc1b309b076 => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:26:19.911193 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526ff9ad-6015-4853-b948-f266f143054e None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:20.007659 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526ff9ad-6015-4853-b948-f266f143054e None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:20.020298 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:26:20.040643 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836aeb50-a3ad-40bc-a9db-7d6e0caa142f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:20.041291 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836aeb50-a3ad-40bc-a9db-7d6e0caa142f None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:20.041575 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836aeb50-a3ad-40bc-a9db-7d6e0caa142f None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:20.041854 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836aeb50-a3ad-40bc-a9db-7d6e0caa142f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:20.105936 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836aeb50-a3ad-40bc-a9db-7d6e0caa142f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:20.107345 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836aeb50-a3ad-40bc-a9db-7d6e0caa142f None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:20.205493 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 561/1144] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 14 09:26:19 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 09:26:20.211375 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18508829-b77e-4edc-a22e-58f581cb1934 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:20.256133 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:26:20.306792 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18508829-b77e-4edc-a22e-58f581cb1934 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:20.339412 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3151fa-e2cc-4673-b88e-8ee55d29d6c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:20.340381 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3151fa-e2cc-4673-b88e-8ee55d29d6c0 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:20.340665 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3151fa-e2cc-4673-b88e-8ee55d29d6c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:20.340941 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3151fa-e2cc-4673-b88e-8ee55d29d6c0 None admin] PATH_INFO: `/v3/projects/58e1db0935c841fbb44a418d2e100acd` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:20.342108 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3151fa-e2cc-4673-b88e-8ee55d29d6c0 None admin] RBAC: Authorizing `identity:get_project(project_id=58e1db0935c841fbb44a418d2e100acd)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:20.343552 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3151fa-e2cc-4673-b88e-8ee55d29d6c0 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:20.345228 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 584/1145] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jul 14 09:26:20 2022] GET /identity/v3/projects/58e1db0935c841fbb44a418d2e100acd => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:26:20.351347 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836aeb50-a3ad-40bc-a9db-7d6e0caa142f None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:20.365992 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:26:20.461056 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836aeb50-a3ad-40bc-a9db-7d6e0caa142f None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:20.494127 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35164308-95ec-4579-a904-dabe2a0d5d95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:20.494807 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35164308-95ec-4579-a904-dabe2a0d5d95 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:20.495096 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35164308-95ec-4579-a904-dabe2a0d5d95 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:20.495375 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35164308-95ec-4579-a904-dabe2a0d5d95 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:20.496215 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35164308-95ec-4579-a904-dabe2a0d5d95 None admin] RBAC: Adding query filter params (role.id=e3965bd0d5f1427a86a313c0c90bfef3, scope.project.id=58e1db0935c841fbb44a418d2e100acd, user.id=aa03b09f25134cffa6914bc1b309b076) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:26:20.496530 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35164308-95ec-4579-a904-dabe2a0d5d95 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:20.497955 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35164308-95ec-4579-a904-dabe2a0d5d95 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:20.503808 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 562/1146] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jul 14 09:26:20 2022] GET /identity/v3/role_assignments?user.id=aa03b09f25134cffa6914bc1b309b076&scope.project.id=58e1db0935c841fbb44a418d2e100acd&role.id=e3965bd0d5f1427a86a313c0c90bfef3 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:26:22.489032 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cd1fc6-4723-4d11-a20e-6b2cb6ace520 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:22.489571 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cd1fc6-4723-4d11-a20e-6b2cb6ace520 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:22.489729 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cd1fc6-4723-4d11-a20e-6b2cb6ace520 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:22.492632 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 585/1147] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:26:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:26:22.499538 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d972873b-48f7-45a7-a351-5eb73a6052c8 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:22.500004 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d972873b-48f7-45a7-a351-5eb73a6052c8 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:22.500092 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d972873b-48f7-45a7-a351-5eb73a6052c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:22.518772 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-d972873b-48f7-45a7-a351-5eb73a6052c8 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:26:22.520249 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-d972873b-48f7-45a7-a351-5eb73a6052c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:26:22.590713 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 563/1148] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:26:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 09:26:22.613737 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cd1fc6-4723-4d11-a20e-6b2cb6ace520 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:22.730306 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cd1fc6-4723-4d11-a20e-6b2cb6ace520 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:22.748350 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:26:22.775334 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e12094-665c-40bf-bfb9-247dde591348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:22.776366 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e12094-665c-40bf-bfb9-247dde591348 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:22.776659 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e12094-665c-40bf-bfb9-247dde591348 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:22.777055 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e12094-665c-40bf-bfb9-247dde591348 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:22.791554 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e12094-665c-40bf-bfb9-247dde591348 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:26:22.801927 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-b7e12094-665c-40bf-bfb9-247dde591348 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 09:26:22.801927 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:26:22.801927 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:26:22.801927 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:26:22.801927 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:26:22.801927 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:26:22.801927 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:26:22.801927 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:26:22.801927 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:26:22.801927 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:26:22.801927 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:26:22.801927 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:26:22.801927 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:26:22.801927 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:26:22.801927 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:26:22.801927 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:26:22.803040 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:26:22.803040 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:26:22.803040 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:26:22.803040 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:26:22.803040 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:26:22.803040 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:26:22.803040 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:26:22.803040 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:26:22.803040 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:26:22.803040 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:26:22.803040 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:26:22.803040 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( Jul 14 09:26:22.803040 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:26:22.803040 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:26:22.803040 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:26:22.803040 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:26:22.804089 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:26:22.804089 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:26:22.804089 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:26:22.804089 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:26:22.804089 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:26:22.804089 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:26:22.804089 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:26:22.804089 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:26:22.804089 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:26:22.804089 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:26:22.804089 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 09:26:22.804089 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Jul 14 09:26:22.804089 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 586/1149] 10.222.0.40 () {56 vars in 1096 bytes} [Thu Jul 14 09:26:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:26:22.812805 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d972873b-48f7-45a7-a351-5eb73a6052c8 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:22.821513 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:26:22.914765 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d972873b-48f7-45a7-a351-5eb73a6052c8 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:22.949716 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0781e8d-e4c3-42a5-b38f-519418fcb6ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:22.950416 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0781e8d-e4c3-42a5-b38f-519418fcb6ad None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:22.950702 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0781e8d-e4c3-42a5-b38f-519418fcb6ad None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:22.950979 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0781e8d-e4c3-42a5-b38f-519418fcb6ad None admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:22.951730 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0781e8d-e4c3-42a5-b38f-519418fcb6ad None admin] RBAC: Adding query filter params (name=admin) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:26:22.952047 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0781e8d-e4c3-42a5-b38f-519418fcb6ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:22.953420 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0781e8d-e4c3-42a5-b38f-519418fcb6ad None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:22.962747 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 564/1150] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 14 09:26:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:26:22.968583 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e12094-665c-40bf-bfb9-247dde591348 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:23.077051 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e12094-665c-40bf-bfb9-247dde591348 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:23.111302 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dd39de-5152-4b2c-bd91-698dcbbb020b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:23.112184 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dd39de-5152-4b2c-bd91-698dcbbb020b None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:23.112472 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dd39de-5152-4b2c-bd91-698dcbbb020b None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:23.112751 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dd39de-5152-4b2c-bd91-698dcbbb020b None admin] PATH_INFO: `/v3/users/aa03b09f25134cffa6914bc1b309b076` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:23.113949 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dd39de-5152-4b2c-bd91-698dcbbb020b None admin] RBAC: Authorizing `identity:get_user(user_id=aa03b09f25134cffa6914bc1b309b076)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:23.115692 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dd39de-5152-4b2c-bd91-698dcbbb020b None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:23.117356 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 587/1151] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jul 14 09:26:22 2022] GET /identity/v3/users/aa03b09f25134cffa6914bc1b309b076 => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:26:23.123743 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0781e8d-e4c3-42a5-b38f-519418fcb6ad None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:23.197804 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:26:23.233641 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0781e8d-e4c3-42a5-b38f-519418fcb6ad None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:23.273704 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8992f5ef-4e31-40ae-8e30-08c0934df0ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:23.274608 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8992f5ef-4e31-40ae-8e30-08c0934df0ea None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:23.274897 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8992f5ef-4e31-40ae-8e30-08c0934df0ea None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:23.275371 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8992f5ef-4e31-40ae-8e30-08c0934df0ea None admin] PATH_INFO: `/v3/projects/58e1db0935c841fbb44a418d2e100acd` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:23.276713 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8992f5ef-4e31-40ae-8e30-08c0934df0ea None admin] RBAC: Authorizing `identity:get_project(project_id=58e1db0935c841fbb44a418d2e100acd)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:23.278151 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8992f5ef-4e31-40ae-8e30-08c0934df0ea None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:23.279906 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 565/1152] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jul 14 09:26:23 2022] GET /identity/v3/projects/58e1db0935c841fbb44a418d2e100acd => generated 311 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:26:23.285882 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dd39de-5152-4b2c-bd91-698dcbbb020b None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:23.332044 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:26:23.393275 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dd39de-5152-4b2c-bd91-698dcbbb020b None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:23.426777 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3d9f5b-8054-4d70-b70f-2819cdf81275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:23.427665 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3d9f5b-8054-4d70-b70f-2819cdf81275 None admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:23.427948 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3d9f5b-8054-4d70-b70f-2819cdf81275 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:23.428238 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3d9f5b-8054-4d70-b70f-2819cdf81275 None admin] PATH_INFO: `/v3/projects/58e1db0935c841fbb44a418d2e100acd/users/aa03b09f25134cffa6914bc1b309b076/roles/e3965bd0d5f1427a86a313c0c90bfef3` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:23.430208 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3d9f5b-8054-4d70-b70f-2819cdf81275 None admin] RBAC: Authorizing `identity:create_grant(project_id=58e1db0935c841fbb44a418d2e100acd, user_id=aa03b09f25134cffa6914bc1b309b076, role_id=e3965bd0d5f1427a86a313c0c90bfef3)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:23.431636 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3d9f5b-8054-4d70-b70f-2819cdf81275 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:23.446558 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 588/1153] 10.222.0.40 () {58 vars in 1439 bytes} [Thu Jul 14 09:26:23 2022] PUT /identity/v3/projects/58e1db0935c841fbb44a418d2e100acd/users/aa03b09f25134cffa6914bc1b309b076/roles/e3965bd0d5f1427a86a313c0c90bfef3 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:26:25.449544 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19609aef-2afd-49c5-ba64-6c36b3150cf4 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:25.450082 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19609aef-2afd-49c5-ba64-6c36b3150cf4 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:25.450082 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19609aef-2afd-49c5-ba64-6c36b3150cf4 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:25.451472 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 566/1154] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:26:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:26:25.456587 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a8d13f-39c4-4663-9592-331bb7fcc8c1 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:25.456958 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a8d13f-39c4-4663-9592-331bb7fcc8c1 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:25.457165 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a8d13f-39c4-4663-9592-331bb7fcc8c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:25.473918 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-42a8d13f-39c4-4663-9592-331bb7fcc8c1 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:26:25.475136 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-42a8d13f-39c4-4663-9592-331bb7fcc8c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:26:25.542088 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 589/1155] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:26:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 09:26:25.565613 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19609aef-2afd-49c5-ba64-6c36b3150cf4 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:25.671316 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19609aef-2afd-49c5-ba64-6c36b3150cf4 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:25.703298 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51be4a0-87df-490c-aac5-31a51dff5f4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:25.704022 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51be4a0-87df-490c-aac5-31a51dff5f4a None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:25.704307 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51be4a0-87df-490c-aac5-31a51dff5f4a None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:25.705104 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51be4a0-87df-490c-aac5-31a51dff5f4a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:25.707716 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:26:25.716190 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51be4a0-87df-490c-aac5-31a51dff5f4a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:26:25.724472 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-d51be4a0-87df-490c-aac5-31a51dff5f4a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 09:26:25.724472 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:26:25.724472 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:26:25.724472 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:26:25.724472 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:26:25.724472 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:26:25.724472 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:26:25.724472 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:26:25.724472 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:26:25.724472 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:26:25.724472 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:26:25.724472 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:26:25.724472 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:26:25.724472 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:26:25.724472 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:26:25.724472 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:26:25.725634 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:26:25.725634 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:26:25.725634 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:26:25.725634 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:26:25.725634 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:26:25.725634 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:26:25.725634 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:26:25.725634 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:26:25.725634 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:26:25.725634 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:26:25.725634 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:26:25.725634 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( Jul 14 09:26:25.725634 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:26:25.725634 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:26:25.725634 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:26:25.725634 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:26:25.726548 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:26:25.726548 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:26:25.726548 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:26:25.726548 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:26:25.726548 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:26:25.726548 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:26:25.726548 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:26:25.726548 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:26:25.726548 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:26:25.726548 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:26:25.726548 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 09:26:25.726548 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:26:25.726548 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 567/1156] 10.222.0.40 () {56 vars in 1096 bytes} [Thu Jul 14 09:26:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:26:25.731718 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a8d13f-39c4-4663-9592-331bb7fcc8c1 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:25.761312 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:26:25.830739 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a8d13f-39c4-4663-9592-331bb7fcc8c1 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:25.866303 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f900a775-fd81-4fd8-9dc8-f9977427b40f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:25.866974 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f900a775-fd81-4fd8-9dc8-f9977427b40f None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:25.867262 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f900a775-fd81-4fd8-9dc8-f9977427b40f None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:25.867543 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f900a775-fd81-4fd8-9dc8-f9977427b40f None admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:25.868294 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f900a775-fd81-4fd8-9dc8-f9977427b40f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:26:25.868605 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f900a775-fd81-4fd8-9dc8-f9977427b40f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:25.869968 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f900a775-fd81-4fd8-9dc8-f9977427b40f None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:25.878497 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 590/1157] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 14 09:26:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:26:25.884246 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51be4a0-87df-490c-aac5-31a51dff5f4a None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:25.993524 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51be4a0-87df-490c-aac5-31a51dff5f4a None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:26.028919 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e1228d-4ba5-44a9-a589-4f11b3034d29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:26.029788 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e1228d-4ba5-44a9-a589-4f11b3034d29 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:26.030066 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e1228d-4ba5-44a9-a589-4f11b3034d29 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:26.030367 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e1228d-4ba5-44a9-a589-4f11b3034d29 None admin] PATH_INFO: `/v3/users/aa03b09f25134cffa6914bc1b309b076` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:26.031568 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e1228d-4ba5-44a9-a589-4f11b3034d29 None admin] RBAC: Authorizing `identity:get_user(user_id=aa03b09f25134cffa6914bc1b309b076)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:26.033027 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e1228d-4ba5-44a9-a589-4f11b3034d29 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:26.034689 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 568/1158] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jul 14 09:26:25 2022] GET /identity/v3/users/aa03b09f25134cffa6914bc1b309b076 => generated 286 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:26:26.040480 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f900a775-fd81-4fd8-9dc8-f9977427b40f None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:26.139091 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:26:26.146937 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f900a775-fd81-4fd8-9dc8-f9977427b40f None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:26.180781 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8465d8-a594-4877-859c-f35302cd26ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:26.181442 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8465d8-a594-4877-859c-f35302cd26ba None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:26.181731 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8465d8-a594-4877-859c-f35302cd26ba None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:26.182011 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8465d8-a594-4877-859c-f35302cd26ba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:26.251107 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8465d8-a594-4877-859c-f35302cd26ba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:26.253061 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8465d8-a594-4877-859c-f35302cd26ba None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:26.343719 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:26:26.351704 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 591/1159] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 14 09:26:26 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 09:26:26.357721 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e1228d-4ba5-44a9-a589-4f11b3034d29 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:26.422632 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:26:26.460723 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e1228d-4ba5-44a9-a589-4f11b3034d29 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:26.494567 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f07317-0551-4d89-90e4-1e630a1170eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:26.495428 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f07317-0551-4d89-90e4-1e630a1170eb None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:26.495711 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f07317-0551-4d89-90e4-1e630a1170eb None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:26.495985 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f07317-0551-4d89-90e4-1e630a1170eb None admin] PATH_INFO: `/v3/projects/58e1db0935c841fbb44a418d2e100acd` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:26.497170 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f07317-0551-4d89-90e4-1e630a1170eb None admin] RBAC: Authorizing `identity:get_project(project_id=58e1db0935c841fbb44a418d2e100acd)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:26.498632 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f07317-0551-4d89-90e4-1e630a1170eb None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:26.500334 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 569/1160] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jul 14 09:26:26 2022] GET /identity/v3/projects/58e1db0935c841fbb44a418d2e100acd => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:26:26.507457 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8465d8-a594-4877-859c-f35302cd26ba None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:26.603722 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8465d8-a594-4877-859c-f35302cd26ba None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:26.644264 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2e2972-c686-48f0-bf98-21ca7dd20511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:26.644930 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2e2972-c686-48f0-bf98-21ca7dd20511 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:26.645220 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2e2972-c686-48f0-bf98-21ca7dd20511 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:26.645503 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2e2972-c686-48f0-bf98-21ca7dd20511 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:26.646381 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2e2972-c686-48f0-bf98-21ca7dd20511 None admin] RBAC: Adding query filter params (role.id=e3965bd0d5f1427a86a313c0c90bfef3, scope.project.id=58e1db0935c841fbb44a418d2e100acd, user.id=aa03b09f25134cffa6914bc1b309b076) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:26:26.646698 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2e2972-c686-48f0-bf98-21ca7dd20511 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:26.648137 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2e2972-c686-48f0-bf98-21ca7dd20511 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:26.653893 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 592/1161] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jul 14 09:26:26 2022] GET /identity/v3/role_assignments?user.id=aa03b09f25134cffa6914bc1b309b076&scope.project.id=58e1db0935c841fbb44a418d2e100acd&role.id=e3965bd0d5f1427a86a313c0c90bfef3 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:26:28.713690 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f145f0e2-f92a-4374-b007-747e540a093d None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:28.714335 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f145f0e2-f92a-4374-b007-747e540a093d None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:28.714335 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f145f0e2-f92a-4374-b007-747e540a093d None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:28.715681 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 570/1162] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:26:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:26:28.721768 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8d61f0-3d1e-49b9-97a4-b4afff54c4c0 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:28.722350 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8d61f0-3d1e-49b9-97a4-b4afff54c4c0 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:28.722532 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8d61f0-3d1e-49b9-97a4-b4afff54c4c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:28.739202 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-8f8d61f0-3d1e-49b9-97a4-b4afff54c4c0 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:26:28.740639 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-8f8d61f0-3d1e-49b9-97a4-b4afff54c4c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:26:28.794121 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:26:28.807918 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 593/1163] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:26:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 09:26:28.830371 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f145f0e2-f92a-4374-b007-747e540a093d None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:28.931005 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f145f0e2-f92a-4374-b007-747e540a093d None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:28.960002 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:26:28.965262 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d88d770-7d58-4466-bb24-1ba0701d5123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:28.965913 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d88d770-7d58-4466-bb24-1ba0701d5123 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:28.966212 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d88d770-7d58-4466-bb24-1ba0701d5123 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:28.966499 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d88d770-7d58-4466-bb24-1ba0701d5123 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:29.030947 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d88d770-7d58-4466-bb24-1ba0701d5123 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:29.032391 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d88d770-7d58-4466-bb24-1ba0701d5123 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:29.127212 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 571/1164] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 14 09:26:28 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 09:26:29.133111 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8d61f0-3d1e-49b9-97a4-b4afff54c4c0 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:29.234893 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8d61f0-3d1e-49b9-97a4-b4afff54c4c0 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:29.268797 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19501c7-e94e-48ab-8bb7-523f438edb4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:29.269622 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19501c7-e94e-48ab-8bb7-523f438edb4c None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:29.269905 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19501c7-e94e-48ab-8bb7-523f438edb4c None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:29.270211 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19501c7-e94e-48ab-8bb7-523f438edb4c None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:29.277527 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19501c7-e94e-48ab-8bb7-523f438edb4c None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:29.279007 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19501c7-e94e-48ab-8bb7-523f438edb4c None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:29.293622 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-c19501c7-e94e-48ab-8bb7-523f438edb4c None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 14 09:26:29.293622 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:26:29.293622 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 14 09:26:29.293622 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 14 09:26:29.293622 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 09:26:29.293622 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 09:26:29.293622 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 09:26:29.293622 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 09:26:29.293622 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 14 09:26:29.293622 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Jul 14 09:26:29.293622 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 09:26:29.293622 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Jul 14 09:26:29.293622 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:26:29.293622 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:26:29.293622 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:26:29.293622 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:26:29.293622 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:26:29.294989 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:26:29.294989 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:26:29.294989 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:26:29.294989 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:26:29.294989 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:26:29.294989 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:26:29.294989 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 09:26:29.294989 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 09:26:29.294989 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 09:26:29.294989 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 09:26:29.294989 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:26:29.294989 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:26:29.294989 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:26:29.294989 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:26:29.294989 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:26:29.294989 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:26:29.295956 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:26:29.295956 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( Jul 14 09:26:29.295956 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:26:29.295956 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:26:29.295956 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:26:29.295956 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:26:29.295956 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:26:29.295956 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:26:29.295956 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:26:29.295956 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:26:29.295956 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 14 09:26:29.295956 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 09:26:29.295956 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 14 09:26:29.295956 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Jul 14 09:26:29.295956 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 594/1165] 10.222.0.40 () {56 vars in 1117 bytes} [Thu Jul 14 09:26:29 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 09:26:29.301543 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d88d770-7d58-4466-bb24-1ba0701d5123 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:29.333077 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:26:29.400995 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d88d770-7d58-4466-bb24-1ba0701d5123 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:29.433953 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5954f1-ab9f-4b66-9509-727e1acb083f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:29.434649 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5954f1-ab9f-4b66-9509-727e1acb083f None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:29.434936 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5954f1-ab9f-4b66-9509-727e1acb083f None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:29.435214 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5954f1-ab9f-4b66-9509-727e1acb083f None admin] PATH_INFO: `/v3/domains` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:29.435936 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5954f1-ab9f-4b66-9509-727e1acb083f None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:26:29.436246 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5954f1-ab9f-4b66-9509-727e1acb083f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:29.437610 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5954f1-ab9f-4b66-9509-727e1acb083f None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:29.445320 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 572/1166] 10.222.0.40 () {56 vars in 1115 bytes} [Thu Jul 14 09:26:29 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:26:31.471233 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97050f80-872e-47fb-adbf-b524f846dea8 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:31.471783 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97050f80-872e-47fb-adbf-b524f846dea8 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:31.471783 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97050f80-872e-47fb-adbf-b524f846dea8 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:31.473148 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 595/1167] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:26:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:26:31.478325 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c428bbf-6a65-4618-95f6-7b2872693360 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:31.478758 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c428bbf-6a65-4618-95f6-7b2872693360 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:31.478885 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c428bbf-6a65-4618-95f6-7b2872693360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:31.495949 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-9c428bbf-6a65-4618-95f6-7b2872693360 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:26:31.497132 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-9c428bbf-6a65-4618-95f6-7b2872693360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:26:31.562779 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 573/1168] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:26:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 09:26:31.585738 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97050f80-872e-47fb-adbf-b524f846dea8 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:31.636435 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:26:31.691865 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97050f80-872e-47fb-adbf-b524f846dea8 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:31.726740 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e963e2b4-42a6-4383-b154-053e3cbb822c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:31.727326 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e963e2b4-42a6-4383-b154-053e3cbb822c None admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:31.727615 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e963e2b4-42a6-4383-b154-053e3cbb822c None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:31.727896 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e963e2b4-42a6-4383-b154-053e3cbb822c None admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:31.728653 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e963e2b4-42a6-4383-b154-053e3cbb822c None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:31.730020 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e963e2b4-42a6-4383-b154-053e3cbb822c None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:31.744687 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 596/1169] 10.222.0.40 () {60 vars in 1138 bytes} [Thu Jul 14 09:26:31 2022] POST /identity/v3/domains => generated 267 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:26:33.816100 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8ce798-0037-44ba-a59a-7a5653a28b5d None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:33.816631 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8ce798-0037-44ba-a59a-7a5653a28b5d None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:33.816631 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8ce798-0037-44ba-a59a-7a5653a28b5d None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:33.817927 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 574/1170] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:26:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:26:33.823194 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e719177f-765d-415f-90e6-fe3c3154ba61 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:33.823645 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e719177f-765d-415f-90e6-fe3c3154ba61 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:33.823830 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e719177f-765d-415f-90e6-fe3c3154ba61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:33.841043 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-e719177f-765d-415f-90e6-fe3c3154ba61 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:26:33.842275 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-e719177f-765d-415f-90e6-fe3c3154ba61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:26:33.912782 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 597/1171] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:26:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 09:26:33.939870 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8ce798-0037-44ba-a59a-7a5653a28b5d None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:33.969740 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:26:34.045526 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8ce798-0037-44ba-a59a-7a5653a28b5d None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:34.079678 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d4b95c-fc81-4ca2-951b-86ac0fbe48ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:34.080455 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d4b95c-fc81-4ca2-951b-86ac0fbe48ae None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:34.080733 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d4b95c-fc81-4ca2-951b-86ac0fbe48ae None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:34.081005 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d4b95c-fc81-4ca2-951b-86ac0fbe48ae None admin] PATH_INFO: `/v3/domains/9dca5ac80bcb4f11967cad35b41d6167` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:34.091346 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d4b95c-fc81-4ca2-951b-86ac0fbe48ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=9dca5ac80bcb4f11967cad35b41d6167)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:34.092783 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d4b95c-fc81-4ca2-951b-86ac0fbe48ae None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:34.094614 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 575/1172] 10.222.0.40 () {56 vars in 1183 bytes} [Thu Jul 14 09:26:33 2022] GET /identity/v3/domains/9dca5ac80bcb4f11967cad35b41d6167 => generated 267 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:26:34.101170 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e719177f-765d-415f-90e6-fe3c3154ba61 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:34.141104 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:26:34.200430 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e719177f-765d-415f-90e6-fe3c3154ba61 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:34.233749 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae300926-aef8-418d-ae05-cc1f72756e4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:34.234445 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae300926-aef8-418d-ae05-cc1f72756e4d None admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:34.234732 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae300926-aef8-418d-ae05-cc1f72756e4d None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:34.235010 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae300926-aef8-418d-ae05-cc1f72756e4d None admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:34.236006 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae300926-aef8-418d-ae05-cc1f72756e4d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:34.237449 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae300926-aef8-418d-ae05-cc1f72756e4d None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:34.263210 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 598/1173] 10.222.0.40 () {60 vars in 1141 bytes} [Thu Jul 14 09:26:34 2022] POST /identity/v3/projects => generated 361 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 09:26:36.328512 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a42ae9-b198-421b-a090-329499e65131 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:36.329082 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a42ae9-b198-421b-a090-329499e65131 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:36.329082 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a42ae9-b198-421b-a090-329499e65131 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:36.330476 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 576/1174] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:26:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:26:36.335604 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f91638-ca96-4a00-af43-f46f4d884113 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:36.335994 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f91638-ca96-4a00-af43-f46f4d884113 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:36.336168 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f91638-ca96-4a00-af43-f46f4d884113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:36.352810 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-42f91638-ca96-4a00-af43-f46f4d884113 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:26:36.354239 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-42f91638-ca96-4a00-af43-f46f4d884113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:26:36.423865 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 599/1175] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:26:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 09:26:36.448383 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a42ae9-b198-421b-a090-329499e65131 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:36.534536 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:26:36.551391 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a42ae9-b198-421b-a090-329499e65131 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:36.586469 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c68fc6-b526-495d-98f2-562785cd30eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:36.587257 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c68fc6-b526-495d-98f2-562785cd30eb None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:36.587540 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c68fc6-b526-495d-98f2-562785cd30eb None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:36.587818 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c68fc6-b526-495d-98f2-562785cd30eb None admin] PATH_INFO: `/v3/domains/9dca5ac80bcb4f11967cad35b41d6167` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:36.589011 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c68fc6-b526-495d-98f2-562785cd30eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=9dca5ac80bcb4f11967cad35b41d6167)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:36.590473 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c68fc6-b526-495d-98f2-562785cd30eb None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:36.592107 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 577/1176] 10.222.0.40 () {56 vars in 1183 bytes} [Thu Jul 14 09:26:36 2022] GET /identity/v3/domains/9dca5ac80bcb4f11967cad35b41d6167 => generated 267 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:26:36.598820 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f91638-ca96-4a00-af43-f46f4d884113 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:36.620600 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:26:36.697610 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f91638-ca96-4a00-af43-f46f4d884113 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:36.731508 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd2b362-7f6e-4df4-b23b-303f05688cd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:36.732181 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd2b362-7f6e-4df4-b23b-303f05688cd3 None admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:36.732469 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd2b362-7f6e-4df4-b23b-303f05688cd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:36.732749 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd2b362-7f6e-4df4-b23b-303f05688cd3 None admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:36.733472 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd2b362-7f6e-4df4-b23b-303f05688cd3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:36.734935 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd2b362-7f6e-4df4-b23b-303f05688cd3 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:36.754841 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 600/1177] 10.222.0.40 () {60 vars in 1132 bytes} [Thu Jul 14 09:26:36 2022] POST /identity/v3/users => generated 311 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:26:38.829641 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be549de-5d66-485b-a0b3-5bb0541fc7aa None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:38.830208 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be549de-5d66-485b-a0b3-5bb0541fc7aa None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:38.830208 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be549de-5d66-485b-a0b3-5bb0541fc7aa None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:38.831557 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 578/1178] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:26:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:26:38.837448 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98921d8b-7478-4d63-818a-a454300fa648 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:38.837990 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98921d8b-7478-4d63-818a-a454300fa648 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:38.838102 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98921d8b-7478-4d63-818a-a454300fa648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:38.855015 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-98921d8b-7478-4d63-818a-a454300fa648 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:26:38.856201 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-98921d8b-7478-4d63-818a-a454300fa648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:26:38.920821 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 601/1179] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:26:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 09:26:38.944512 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be549de-5d66-485b-a0b3-5bb0541fc7aa None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:39.043519 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be549de-5d66-485b-a0b3-5bb0541fc7aa None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:39.083112 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bcf586-0f05-4ba0-acfc-49438b2389a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:39.083827 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bcf586-0f05-4ba0-acfc-49438b2389a5 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:39.084113 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bcf586-0f05-4ba0-acfc-49438b2389a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:39.084392 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bcf586-0f05-4ba0-acfc-49438b2389a5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:39.095382 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bcf586-0f05-4ba0-acfc-49438b2389a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:26:39.103040 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-21bcf586-0f05-4ba0-acfc-49438b2389a5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 09:26:39.103040 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:26:39.103040 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:26:39.103040 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:26:39.103040 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:26:39.103040 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:26:39.103040 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:26:39.103040 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:26:39.103040 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:26:39.103040 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:26:39.103040 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:26:39.103040 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:26:39.103040 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:26:39.103040 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:26:39.103040 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:26:39.103040 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:26:39.104133 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:26:39.104133 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:26:39.104133 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:26:39.104133 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:26:39.104133 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:26:39.104133 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:26:39.104133 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:26:39.104133 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:26:39.104133 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:26:39.104133 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:26:39.104133 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:26:39.104133 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( Jul 14 09:26:39.104133 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:26:39.104133 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:26:39.104133 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:26:39.104133 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:26:39.105152 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:26:39.105152 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:26:39.105152 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:26:39.105152 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:26:39.105152 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:26:39.105152 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:26:39.105152 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:26:39.105152 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:26:39.105152 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:26:39.105152 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:26:39.105152 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 09:26:39.105152 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:26:39.105152 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 579/1180] 10.222.0.40 () {56 vars in 1096 bytes} [Thu Jul 14 09:26:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:26:39.110444 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98921d8b-7478-4d63-818a-a454300fa648 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:39.118961 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:26:39.208737 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98921d8b-7478-4d63-818a-a454300fa648 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:39.241853 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bd2eec-af10-4844-9939-787bbd64070e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:39.242547 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bd2eec-af10-4844-9939-787bbd64070e None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:39.242844 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bd2eec-af10-4844-9939-787bbd64070e None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:39.243120 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bd2eec-af10-4844-9939-787bbd64070e None admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:39.243870 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bd2eec-af10-4844-9939-787bbd64070e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:26:39.244179 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bd2eec-af10-4844-9939-787bbd64070e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:39.245545 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bd2eec-af10-4844-9939-787bbd64070e None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:39.253464 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 602/1181] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 14 09:26:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:26:39.259216 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bcf586-0f05-4ba0-acfc-49438b2389a5 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:39.274988 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:26:39.357289 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bcf586-0f05-4ba0-acfc-49438b2389a5 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:39.390202 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a299fcd-e7fb-4022-9a19-5f64e8fce4d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:39.391081 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a299fcd-e7fb-4022-9a19-5f64e8fce4d6 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:39.391904 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a299fcd-e7fb-4022-9a19-5f64e8fce4d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:39.392182 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a299fcd-e7fb-4022-9a19-5f64e8fce4d6 None admin] PATH_INFO: `/v3/users/a45f7dfff8b746059c4b9e7e65ca253b` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:39.404795 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a299fcd-e7fb-4022-9a19-5f64e8fce4d6 None admin] RBAC: Authorizing `identity:get_user(user_id=a45f7dfff8b746059c4b9e7e65ca253b)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:39.406259 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a299fcd-e7fb-4022-9a19-5f64e8fce4d6 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:39.407930 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 580/1182] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jul 14 09:26:39 2022] GET /identity/v3/users/a45f7dfff8b746059c4b9e7e65ca253b => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:26:39.413702 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bd2eec-af10-4844-9939-787bbd64070e None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:39.484468 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:26:39.517943 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bd2eec-af10-4844-9939-787bbd64070e None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:39.550038 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994a7a89-cfd8-47a9-8b52-af580ac2368b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:39.550720 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994a7a89-cfd8-47a9-8b52-af580ac2368b None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:39.551009 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994a7a89-cfd8-47a9-8b52-af580ac2368b None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:39.551288 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994a7a89-cfd8-47a9-8b52-af580ac2368b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:39.618871 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994a7a89-cfd8-47a9-8b52-af580ac2368b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:39.620264 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994a7a89-cfd8-47a9-8b52-af580ac2368b None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:39.684766 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:26:39.718969 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 603/1183] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 14 09:26:39 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 09:26:39.724848 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a299fcd-e7fb-4022-9a19-5f64e8fce4d6 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:39.810598 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:26:39.840116 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a299fcd-e7fb-4022-9a19-5f64e8fce4d6 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:39.873413 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c4305c-98f2-4105-bfdc-1fbe1aa9c8df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:39.874222 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c4305c-98f2-4105-bfdc-1fbe1aa9c8df None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:39.874503 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c4305c-98f2-4105-bfdc-1fbe1aa9c8df None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:39.874772 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c4305c-98f2-4105-bfdc-1fbe1aa9c8df None admin] PATH_INFO: `/v3/projects/8fb561a86636417eba461383701352b2` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:39.876512 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c4305c-98f2-4105-bfdc-1fbe1aa9c8df None admin] RBAC: Authorizing `identity:get_project(project_id=8fb561a86636417eba461383701352b2)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:39.877935 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c4305c-98f2-4105-bfdc-1fbe1aa9c8df None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:39.879646 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 581/1184] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jul 14 09:26:39 2022] GET /identity/v3/projects/8fb561a86636417eba461383701352b2 => generated 361 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:26:39.885870 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994a7a89-cfd8-47a9-8b52-af580ac2368b None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:39.988635 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994a7a89-cfd8-47a9-8b52-af580ac2368b None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:40.024442 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a423930-247c-4f2e-b17d-e1bc3831a164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:40.025122 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a423930-247c-4f2e-b17d-e1bc3831a164 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:40.025397 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a423930-247c-4f2e-b17d-e1bc3831a164 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:40.025677 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a423930-247c-4f2e-b17d-e1bc3831a164 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:40.026550 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a423930-247c-4f2e-b17d-e1bc3831a164 None admin] RBAC: Adding query filter params (role.id=e3965bd0d5f1427a86a313c0c90bfef3, scope.project.id=8fb561a86636417eba461383701352b2, user.id=a45f7dfff8b746059c4b9e7e65ca253b) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:26:40.026867 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a423930-247c-4f2e-b17d-e1bc3831a164 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:40.028316 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a423930-247c-4f2e-b17d-e1bc3831a164 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:40.033945 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 604/1185] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jul 14 09:26:39 2022] GET /identity/v3/role_assignments?user.id=a45f7dfff8b746059c4b9e7e65ca253b&scope.project.id=8fb561a86636417eba461383701352b2&role.id=e3965bd0d5f1427a86a313c0c90bfef3 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:26:42.007965 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3457e1fe-5439-4598-88b1-797d57b4fe68 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:42.008514 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3457e1fe-5439-4598-88b1-797d57b4fe68 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:42.008514 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3457e1fe-5439-4598-88b1-797d57b4fe68 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:42.009863 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 582/1186] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:26:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:26:42.015187 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66d1ffc-3596-4604-9ba2-ced78ca92a88 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:42.015555 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66d1ffc-3596-4604-9ba2-ced78ca92a88 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:42.015748 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66d1ffc-3596-4604-9ba2-ced78ca92a88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:42.032701 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-b66d1ffc-3596-4604-9ba2-ced78ca92a88 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:26:42.033890 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-b66d1ffc-3596-4604-9ba2-ced78ca92a88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:26:42.060413 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:26:42.100061 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 605/1187] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:26:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 09:26:42.122830 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3457e1fe-5439-4598-88b1-797d57b4fe68 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:42.220034 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3457e1fe-5439-4598-88b1-797d57b4fe68 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:42.253430 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd45ddc9-173b-4709-96bf-89fb58e2df76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:42.254236 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd45ddc9-173b-4709-96bf-89fb58e2df76 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:42.254516 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd45ddc9-173b-4709-96bf-89fb58e2df76 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:42.254786 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd45ddc9-173b-4709-96bf-89fb58e2df76 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:42.262127 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:26:42.265218 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd45ddc9-173b-4709-96bf-89fb58e2df76 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:26:42.273399 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-fd45ddc9-173b-4709-96bf-89fb58e2df76 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 09:26:42.273399 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:26:42.273399 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:26:42.273399 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:26:42.273399 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:26:42.273399 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:26:42.273399 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:26:42.273399 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:26:42.273399 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:26:42.273399 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:26:42.273399 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:26:42.273399 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:26:42.273399 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:26:42.273399 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:26:42.273399 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:26:42.273399 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:26:42.274503 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:26:42.274503 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:26:42.274503 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:26:42.274503 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:26:42.274503 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:26:42.274503 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:26:42.274503 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:26:42.274503 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:26:42.274503 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:26:42.274503 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:26:42.274503 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:26:42.274503 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( Jul 14 09:26:42.274503 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:26:42.274503 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:26:42.274503 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:26:42.274503 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:26:42.275381 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:26:42.275381 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:26:42.275381 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:26:42.275381 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:26:42.275381 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:26:42.275381 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:26:42.275381 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:26:42.275381 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:26:42.275381 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:26:42.275381 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:26:42.275381 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 09:26:42.275381 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:26:42.275381 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 583/1188] 10.222.0.40 () {56 vars in 1096 bytes} [Thu Jul 14 09:26:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:26:42.280906 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66d1ffc-3596-4604-9ba2-ced78ca92a88 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:42.389194 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66d1ffc-3596-4604-9ba2-ced78ca92a88 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:42.423884 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df26de79-06b0-4bc3-8bb9-855ec6275cab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:42.424558 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df26de79-06b0-4bc3-8bb9-855ec6275cab None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:42.424846 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df26de79-06b0-4bc3-8bb9-855ec6275cab None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:42.425123 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df26de79-06b0-4bc3-8bb9-855ec6275cab None admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:42.425876 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df26de79-06b0-4bc3-8bb9-855ec6275cab None admin] RBAC: Adding query filter params (name=admin) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:26:42.426224 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df26de79-06b0-4bc3-8bb9-855ec6275cab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:42.428918 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df26de79-06b0-4bc3-8bb9-855ec6275cab None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:42.438929 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 606/1189] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 14 09:26:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:26:42.445316 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd45ddc9-173b-4709-96bf-89fb58e2df76 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:42.552509 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd45ddc9-173b-4709-96bf-89fb58e2df76 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:42.584750 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e49637-3b27-4df2-b81f-054bdfa4ac1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:42.585619 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e49637-3b27-4df2-b81f-054bdfa4ac1c None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:42.585900 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e49637-3b27-4df2-b81f-054bdfa4ac1c None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:42.586215 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e49637-3b27-4df2-b81f-054bdfa4ac1c None admin] PATH_INFO: `/v3/users/a45f7dfff8b746059c4b9e7e65ca253b` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:42.587539 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e49637-3b27-4df2-b81f-054bdfa4ac1c None admin] RBAC: Authorizing `identity:get_user(user_id=a45f7dfff8b746059c4b9e7e65ca253b)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:42.588965 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e49637-3b27-4df2-b81f-054bdfa4ac1c None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:42.590626 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 584/1190] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jul 14 09:26:42 2022] GET /identity/v3/users/a45f7dfff8b746059c4b9e7e65ca253b => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:26:42.597062 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df26de79-06b0-4bc3-8bb9-855ec6275cab None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:42.622953 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:26:42.695611 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df26de79-06b0-4bc3-8bb9-855ec6275cab None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:42.728408 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8da3f2-a976-4cac-8c72-be85efaf23b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:42.729271 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8da3f2-a976-4cac-8c72-be85efaf23b3 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:42.729562 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8da3f2-a976-4cac-8c72-be85efaf23b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:42.729844 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8da3f2-a976-4cac-8c72-be85efaf23b3 None admin] PATH_INFO: `/v3/projects/8fb561a86636417eba461383701352b2` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:42.731066 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8da3f2-a976-4cac-8c72-be85efaf23b3 None admin] RBAC: Authorizing `identity:get_project(project_id=8fb561a86636417eba461383701352b2)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:42.732498 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8da3f2-a976-4cac-8c72-be85efaf23b3 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:42.734211 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 607/1191] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jul 14 09:26:42 2022] GET /identity/v3/projects/8fb561a86636417eba461383701352b2 => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:26:42.741049 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e49637-3b27-4df2-b81f-054bdfa4ac1c None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:42.807238 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:26:42.839832 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e49637-3b27-4df2-b81f-054bdfa4ac1c None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:42.872568 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6f5d75-c995-4994-8ac3-d51b93dd3578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:42.873455 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6f5d75-c995-4994-8ac3-d51b93dd3578 None admin] REQUEST_METHOD: `PUT` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:42.873737 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6f5d75-c995-4994-8ac3-d51b93dd3578 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:42.874013 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6f5d75-c995-4994-8ac3-d51b93dd3578 None admin] PATH_INFO: `/v3/projects/8fb561a86636417eba461383701352b2/users/a45f7dfff8b746059c4b9e7e65ca253b/roles/e3965bd0d5f1427a86a313c0c90bfef3` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:42.875972 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6f5d75-c995-4994-8ac3-d51b93dd3578 None admin] RBAC: Authorizing `identity:create_grant(project_id=8fb561a86636417eba461383701352b2, user_id=a45f7dfff8b746059c4b9e7e65ca253b, role_id=e3965bd0d5f1427a86a313c0c90bfef3)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:42.877393 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6f5d75-c995-4994-8ac3-d51b93dd3578 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:42.889955 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 585/1192] 10.222.0.40 () {58 vars in 1439 bytes} [Thu Jul 14 09:26:42 2022] PUT /identity/v3/projects/8fb561a86636417eba461383701352b2/users/a45f7dfff8b746059c4b9e7e65ca253b/roles/e3965bd0d5f1427a86a313c0c90bfef3 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:26:44.897116 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec1ed3f-6db8-4815-bdd7-c9a424cd9662 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:44.897614 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec1ed3f-6db8-4815-bdd7-c9a424cd9662 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:44.897614 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec1ed3f-6db8-4815-bdd7-c9a424cd9662 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:44.898965 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 608/1193] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:26:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:26:44.904000 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea551b05-8c96-42bd-b942-5520dcc8ecb8 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:44.904400 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea551b05-8c96-42bd-b942-5520dcc8ecb8 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:44.904562 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea551b05-8c96-42bd-b942-5520dcc8ecb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:44.921453 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-ea551b05-8c96-42bd-b942-5520dcc8ecb8 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:26:44.923221 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-ea551b05-8c96-42bd-b942-5520dcc8ecb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:26:44.987253 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 586/1194] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:26:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 09:26:45.011181 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec1ed3f-6db8-4815-bdd7-c9a424cd9662 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:45.101709 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:26:45.111205 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec1ed3f-6db8-4815-bdd7-c9a424cd9662 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:45.143784 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689cd681-b129-4f1f-9f33-2d41cc6d5645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:45.144574 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689cd681-b129-4f1f-9f33-2d41cc6d5645 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:45.144856 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689cd681-b129-4f1f-9f33-2d41cc6d5645 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:45.145130 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689cd681-b129-4f1f-9f33-2d41cc6d5645 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:45.154952 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689cd681-b129-4f1f-9f33-2d41cc6d5645 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:26:45.163085 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-689cd681-b129-4f1f-9f33-2d41cc6d5645 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 09:26:45.163085 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:26:45.163085 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:26:45.163085 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:26:45.163085 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:26:45.163085 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:26:45.163085 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:26:45.163085 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:26:45.163085 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:26:45.163085 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:26:45.163085 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:26:45.163085 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:26:45.163085 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:26:45.163085 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:26:45.163085 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:26:45.163085 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:26:45.164190 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:26:45.164190 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:26:45.164190 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:26:45.164190 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:26:45.164190 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:26:45.164190 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:26:45.164190 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:26:45.164190 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:26:45.164190 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:26:45.164190 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:26:45.164190 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:26:45.164190 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( Jul 14 09:26:45.164190 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:26:45.164190 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:26:45.164190 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:26:45.164190 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:26:45.165213 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:26:45.165213 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:26:45.165213 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:26:45.165213 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:26:45.165213 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:26:45.165213 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:26:45.165213 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:26:45.165213 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:26:45.165213 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:26:45.165213 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:26:45.165213 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 09:26:45.165213 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Jul 14 09:26:45.165213 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 609/1195] 10.222.0.40 () {56 vars in 1096 bytes} [Thu Jul 14 09:26:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:26:45.170698 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea551b05-8c96-42bd-b942-5520dcc8ecb8 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:45.226356 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:26:45.266889 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea551b05-8c96-42bd-b942-5520dcc8ecb8 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:45.299320 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752180e5-abe7-48c8-a153-6a911f9f3310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:45.299978 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752180e5-abe7-48c8-a153-6a911f9f3310 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:45.300256 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752180e5-abe7-48c8-a153-6a911f9f3310 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:45.300529 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752180e5-abe7-48c8-a153-6a911f9f3310 None admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:45.301271 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752180e5-abe7-48c8-a153-6a911f9f3310 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:26:45.301574 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752180e5-abe7-48c8-a153-6a911f9f3310 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:45.302956 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752180e5-abe7-48c8-a153-6a911f9f3310 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:45.310740 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 587/1196] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 14 09:26:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:26:45.316504 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689cd681-b129-4f1f-9f33-2d41cc6d5645 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:45.418791 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689cd681-b129-4f1f-9f33-2d41cc6d5645 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:45.451610 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7669094f-7669-47de-a9bf-73f150a4d245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:45.452483 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7669094f-7669-47de-a9bf-73f150a4d245 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:45.452767 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7669094f-7669-47de-a9bf-73f150a4d245 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:45.453046 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7669094f-7669-47de-a9bf-73f150a4d245 None admin] PATH_INFO: `/v3/users/a45f7dfff8b746059c4b9e7e65ca253b` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:45.454861 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7669094f-7669-47de-a9bf-73f150a4d245 None admin] RBAC: Authorizing `identity:get_user(user_id=a45f7dfff8b746059c4b9e7e65ca253b)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:45.456325 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7669094f-7669-47de-a9bf-73f150a4d245 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:45.457985 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 610/1197] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jul 14 09:26:45 2022] GET /identity/v3/users/a45f7dfff8b746059c4b9e7e65ca253b => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:26:45.463928 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752180e5-abe7-48c8-a153-6a911f9f3310 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:45.566102 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752180e5-abe7-48c8-a153-6a911f9f3310 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:45.588282 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:26:45.605289 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e04ccc4-6f16-4aed-8dc2-58bf2dcc49ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:45.605954 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e04ccc4-6f16-4aed-8dc2-58bf2dcc49ec None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:45.606275 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e04ccc4-6f16-4aed-8dc2-58bf2dcc49ec None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:45.606559 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e04ccc4-6f16-4aed-8dc2-58bf2dcc49ec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:45.679335 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e04ccc4-6f16-4aed-8dc2-58bf2dcc49ec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:45.680811 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e04ccc4-6f16-4aed-8dc2-58bf2dcc49ec None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:45.776403 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 588/1198] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 14 09:26:45 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 09:26:45.782319 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7669094f-7669-47de-a9bf-73f150a4d245 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:45.805043 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:26:45.892455 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7669094f-7669-47de-a9bf-73f150a4d245 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:45.925217 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f782e9e-c034-4fb2-8757-747bae452191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:45.926070 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f782e9e-c034-4fb2-8757-747bae452191 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:45.926385 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f782e9e-c034-4fb2-8757-747bae452191 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:45.926667 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f782e9e-c034-4fb2-8757-747bae452191 None admin] PATH_INFO: `/v3/projects/8fb561a86636417eba461383701352b2` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:45.927849 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f782e9e-c034-4fb2-8757-747bae452191 None admin] RBAC: Authorizing `identity:get_project(project_id=8fb561a86636417eba461383701352b2)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:45.929288 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f782e9e-c034-4fb2-8757-747bae452191 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:45.931083 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 611/1199] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jul 14 09:26:45 2022] GET /identity/v3/projects/8fb561a86636417eba461383701352b2 => generated 361 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:26:45.937102 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e04ccc4-6f16-4aed-8dc2-58bf2dcc49ec None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:26:45.958354 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:26:46.037634 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e04ccc4-6f16-4aed-8dc2-58bf2dcc49ec None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:26:46.070761 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcab7d3e-c143-4507-b07f-e173ac511c42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:26:46.071397 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcab7d3e-c143-4507-b07f-e173ac511c42 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:26:46.071677 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcab7d3e-c143-4507-b07f-e173ac511c42 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:26:46.071951 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcab7d3e-c143-4507-b07f-e173ac511c42 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:26:46.072776 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcab7d3e-c143-4507-b07f-e173ac511c42 None admin] RBAC: Adding query filter params (role.id=e3965bd0d5f1427a86a313c0c90bfef3, scope.project.id=8fb561a86636417eba461383701352b2, user.id=a45f7dfff8b746059c4b9e7e65ca253b) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:26:46.073084 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcab7d3e-c143-4507-b07f-e173ac511c42 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:26:46.074531 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcab7d3e-c143-4507-b07f-e173ac511c42 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:26:46.080178 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 589/1200] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jul 14 09:26:45 2022] GET /identity/v3/role_assignments?user.id=a45f7dfff8b746059c4b9e7e65ca253b&scope.project.id=8fb561a86636417eba461383701352b2&role.id=e3965bd0d5f1427a86a313c0c90bfef3 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:26:55.920858 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=56 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:26:56.077580 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=58 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:27:42.246752 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937180bf-209c-4c9c-8899-9cda50bd84bc None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:27:42.247337 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937180bf-209c-4c9c-8899-9cda50bd84bc None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:27:42.247693 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937180bf-209c-4c9c-8899-9cda50bd84bc None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:27:42.250117 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 612/1201] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:27:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:27:42.256212 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ee5ce8-06c5-4e9f-9f12-e8f501792786 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:27:42.256689 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ee5ce8-06c5-4e9f-9f12-e8f501792786 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:27:42.256774 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ee5ce8-06c5-4e9f-9f12-e8f501792786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:27:42.276697 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-e3ee5ce8-06c5-4e9f-9f12-e8f501792786 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:27:42.278454 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-e3ee5ce8-06c5-4e9f-9f12-e8f501792786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:27:42.360981 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 590/1202] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:27:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 09:27:42.387995 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937180bf-209c-4c9c-8899-9cda50bd84bc None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:27:42.531571 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937180bf-209c-4c9c-8899-9cda50bd84bc None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:27:42.579230 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305066f5-02ac-45e4-abbc-8ab4fe4f28de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:27:42.580145 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305066f5-02ac-45e4-abbc-8ab4fe4f28de None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:27:42.580432 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305066f5-02ac-45e4-abbc-8ab4fe4f28de None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:27:42.580703 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305066f5-02ac-45e4-abbc-8ab4fe4f28de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:27:42.594246 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305066f5-02ac-45e4-abbc-8ab4fe4f28de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:27:42.595176 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305066f5-02ac-45e4-abbc-8ab4fe4f28de None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:27:42.625553 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-305066f5-02ac-45e4-abbc-8ab4fe4f28de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:27:42.625553 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:27:42.625553 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:27:42.625553 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:27:42.625553 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:27:42.625553 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:27:42.625553 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:27:42.625553 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:27:42.625553 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:27:42.625553 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:27:42.625553 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:27:42.625553 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:27:42.625553 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 09:27:42.625553 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 09:27:42.625553 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 09:27:42.626713 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 09:27:42.626713 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:27:42.626713 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:27:42.626713 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:27:42.626713 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:27:42.626713 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:27:42.626713 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:27:42.626713 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:27:42.626713 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( Jul 14 09:27:42.626713 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:27:42.626713 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:27:42.626713 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:27:42.626713 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:27:42.626713 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:27:42.626713 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:27:42.626713 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:27:42.626713 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:27:42.627773 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 09:27:42.627773 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 09:27:42.627773 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:27:42.627773 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Jul 14 09:27:42.627773 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 613/1203] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 09:27:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:27:42.630336 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ee5ce8-06c5-4e9f-9f12-e8f501792786 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:27:42.751646 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ee5ce8-06c5-4e9f-9f12-e8f501792786 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:27:42.785181 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:27:42.793147 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f342ced0-7974-4ae7-94d5-7b34b5202bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:27:42.794524 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f342ced0-7974-4ae7-94d5-7b34b5202bcd None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:27:42.794788 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f342ced0-7974-4ae7-94d5-7b34b5202bcd None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:27:42.795061 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f342ced0-7974-4ae7-94d5-7b34b5202bcd None admin] PATH_INFO: `/v3/domains` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:27:42.796339 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f342ced0-7974-4ae7-94d5-7b34b5202bcd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:27:42.796656 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f342ced0-7974-4ae7-94d5-7b34b5202bcd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:27:42.798124 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f342ced0-7974-4ae7-94d5-7b34b5202bcd None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:27:42.822245 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 591/1204] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 14 09:27:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:27:42.822462 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305066f5-02ac-45e4-abbc-8ab4fe4f28de None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:27:42.897846 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:27:42.964406 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305066f5-02ac-45e4-abbc-8ab4fe4f28de None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:27:43.007719 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0086c1f9-3446-40bc-8bef-47fed78df79e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:27:43.008465 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0086c1f9-3446-40bc-8bef-47fed78df79e None admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:27:43.008751 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0086c1f9-3446-40bc-8bef-47fed78df79e None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:27:43.009060 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0086c1f9-3446-40bc-8bef-47fed78df79e None admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:27:43.009743 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0086c1f9-3446-40bc-8bef-47fed78df79e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:27:43.011278 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0086c1f9-3446-40bc-8bef-47fed78df79e None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:27:43.035065 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 614/1205] 10.222.0.40 () {60 vars in 1132 bytes} [Thu Jul 14 09:27:42 2022] POST /identity/v3/users => generated 251 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 09:27:45.320289 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ce70cc-2fc0-4fee-991a-5401b6ba52ad None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:27:45.320841 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ce70cc-2fc0-4fee-991a-5401b6ba52ad None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:27:45.320841 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ce70cc-2fc0-4fee-991a-5401b6ba52ad None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:27:45.322513 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 592/1206] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:27:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:27:45.328399 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91bc68a-554a-4a5d-84a4-502cf18c43ee None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:27:45.329002 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91bc68a-554a-4a5d-84a4-502cf18c43ee None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:27:45.329002 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91bc68a-554a-4a5d-84a4-502cf18c43ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:27:45.347554 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-d91bc68a-554a-4a5d-84a4-502cf18c43ee None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:27:45.348766 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-d91bc68a-554a-4a5d-84a4-502cf18c43ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:27:45.427855 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 615/1207] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:27:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 09:27:45.455187 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ce70cc-2fc0-4fee-991a-5401b6ba52ad None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:27:45.577507 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ce70cc-2fc0-4fee-991a-5401b6ba52ad None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:27:45.623790 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98c5e68-1dd1-478f-9587-a5db0730465a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:27:45.624596 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98c5e68-1dd1-478f-9587-a5db0730465a None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:27:45.624880 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98c5e68-1dd1-478f-9587-a5db0730465a None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:27:45.625154 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98c5e68-1dd1-478f-9587-a5db0730465a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:27:45.638673 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98c5e68-1dd1-478f-9587-a5db0730465a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:27:45.646682 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-f98c5e68-1dd1-478f-9587-a5db0730465a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 09:27:45.646682 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:27:45.646682 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:27:45.646682 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:27:45.646682 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:27:45.646682 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:27:45.646682 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:27:45.646682 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:27:45.646682 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:27:45.646682 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:27:45.646682 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:27:45.646682 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:27:45.646682 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:27:45.646682 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:27:45.646682 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:27:45.646682 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:27:45.647691 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:27:45.647691 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:27:45.647691 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:27:45.647691 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:27:45.647691 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:27:45.647691 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:27:45.647691 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:27:45.647691 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:27:45.647691 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:27:45.647691 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:27:45.647691 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:27:45.647691 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( Jul 14 09:27:45.647691 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:27:45.647691 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:27:45.647691 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:27:45.647691 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:27:45.648924 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:27:45.648924 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:27:45.648924 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:27:45.648924 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:27:45.648924 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:27:45.648924 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:27:45.648924 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:27:45.648924 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:27:45.648924 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:27:45.648924 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:27:45.648924 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 09:27:45.648924 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:27:45.648924 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 593/1208] 10.222.0.40 () {56 vars in 1102 bytes} [Thu Jul 14 09:27:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:27:45.654445 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91bc68a-554a-4a5d-84a4-502cf18c43ee None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:27:45.697412 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:27:45.788899 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91bc68a-554a-4a5d-84a4-502cf18c43ee None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:27:45.845370 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e5f328-2d88-4c83-92ee-28390ab746b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:27:45.846049 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e5f328-2d88-4c83-92ee-28390ab746b6 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:27:45.846372 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e5f328-2d88-4c83-92ee-28390ab746b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:27:45.846639 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e5f328-2d88-4c83-92ee-28390ab746b6 None admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:27:45.847382 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e5f328-2d88-4c83-92ee-28390ab746b6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:27:45.847705 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e5f328-2d88-4c83-92ee-28390ab746b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:27:45.849300 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e5f328-2d88-4c83-92ee-28390ab746b6 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:27:45.858892 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 616/1209] 10.222.0.40 () {56 vars in 1103 bytes} [Thu Jul 14 09:27:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:27:45.864800 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98c5e68-1dd1-478f-9587-a5db0730465a None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:27:45.950383 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:27:46.035717 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98c5e68-1dd1-478f-9587-a5db0730465a None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:27:46.087236 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcc0f4c-208b-48bc-a4a4-28ce73323eeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:27:46.088044 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcc0f4c-208b-48bc-a4a4-28ce73323eeb None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:27:46.088333 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcc0f4c-208b-48bc-a4a4-28ce73323eeb None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:27:46.088602 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcc0f4c-208b-48bc-a4a4-28ce73323eeb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:27:46.105063 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcc0f4c-208b-48bc-a4a4-28ce73323eeb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:27:46.105493 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcc0f4c-208b-48bc-a4a4-28ce73323eeb None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:27:46.135073 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-afcc0f4c-208b-48bc-a4a4-28ce73323eeb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:27:46.135073 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:27:46.135073 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:27:46.135073 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:27:46.135073 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:27:46.135073 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:27:46.135073 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:27:46.135073 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:27:46.135073 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:27:46.135073 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:27:46.135073 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:27:46.135073 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:27:46.135073 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 09:27:46.135073 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 09:27:46.135073 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 09:27:46.136143 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 09:27:46.136143 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:27:46.136143 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:27:46.136143 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:27:46.136143 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:27:46.136143 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:27:46.136143 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:27:46.136143 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:27:46.136143 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( Jul 14 09:27:46.136143 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:27:46.136143 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:27:46.136143 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:27:46.136143 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:27:46.136143 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:27:46.136143 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:27:46.136143 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:27:46.136143 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:27:46.137332 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 09:27:46.137332 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 09:27:46.137332 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:27:46.137332 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:27:46.137332 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 594/1210] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 09:27:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 09:27:46.143078 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e5f328-2d88-4c83-92ee-28390ab746b6 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:27:46.289729 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:27:46.294774 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e5f328-2d88-4c83-92ee-28390ab746b6 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:27:46.344171 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78905642-aad3-4a2e-9961-63cbafb087fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:27:46.344847 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78905642-aad3-4a2e-9961-63cbafb087fa None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:27:46.345145 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78905642-aad3-4a2e-9961-63cbafb087fa None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:27:46.345441 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78905642-aad3-4a2e-9961-63cbafb087fa None admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:27:46.346112 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78905642-aad3-4a2e-9961-63cbafb087fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:27:46.346453 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78905642-aad3-4a2e-9961-63cbafb087fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:27:46.347839 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78905642-aad3-4a2e-9961-63cbafb087fa None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:27:46.362895 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 617/1211] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 14 09:27:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:27:46.368925 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcc0f4c-208b-48bc-a4a4-28ce73323eeb None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:27:46.497729 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcc0f4c-208b-48bc-a4a4-28ce73323eeb None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:27:46.499613 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:27:46.548177 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4ec641-4067-49ab-9c93-04f21d7d97bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:27:46.548965 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4ec641-4067-49ab-9c93-04f21d7d97bd None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:27:46.549258 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4ec641-4067-49ab-9c93-04f21d7d97bd None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:27:46.549536 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4ec641-4067-49ab-9c93-04f21d7d97bd None admin] PATH_INFO: `/v3/users/placement` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:27:46.559578 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4ec641-4067-49ab-9c93-04f21d7d97bd None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:27:46.560846 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4ec641-4067-49ab-9c93-04f21d7d97bd None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:27:46.580972 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-0f4ec641-4067-49ab-9c93-04f21d7d97bd None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 14 09:27:46.580972 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:27:46.580972 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:27:46.580972 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:27:46.580972 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:27:46.580972 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:27:46.580972 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:27:46.580972 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:27:46.580972 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:27:46.580972 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:27:46.580972 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:27:46.580972 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:27:46.580972 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 09:27:46.580972 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 09:27:46.580972 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 09:27:46.580972 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 09:27:46.582714 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:27:46.582714 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:27:46.582714 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 09:27:46.582714 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 09:27:46.582714 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 09:27:46.582714 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 09:27:46.582714 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:27:46.582714 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:27:46.582714 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:27:46.582714 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:27:46.582714 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:27:46.582714 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( Jul 14 09:27:46.582714 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:27:46.582714 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:27:46.582714 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:27:46.582714 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:27:46.582714 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:27:46.582714 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:27:46.585256 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:27:46.585256 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:27:46.585256 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 09:27:46.585256 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 09:27:46.585256 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 09:27:46.585256 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 09:27:46.585256 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 09:27:46.585256 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 09:27:46.585256 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 14 09:27:46.585256 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:27:46.585256 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 595/1212] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 09:27:46 2022] GET /identity/v3/users/placement => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 09:27:46.589024 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78905642-aad3-4a2e-9961-63cbafb087fa None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:27:46.711761 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78905642-aad3-4a2e-9961-63cbafb087fa None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:27:46.753770 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc66710-2702-4dc2-b3f2-6a0fb70387a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:27:46.754483 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc66710-2702-4dc2-b3f2-6a0fb70387a5 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:27:46.754772 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc66710-2702-4dc2-b3f2-6a0fb70387a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:27:46.755048 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc66710-2702-4dc2-b3f2-6a0fb70387a5 None admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:27:46.755886 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc66710-2702-4dc2-b3f2-6a0fb70387a5 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:27:46.756196 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc66710-2702-4dc2-b3f2-6a0fb70387a5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:27:46.757621 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc66710-2702-4dc2-b3f2-6a0fb70387a5 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:27:46.781946 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 618/1213] 10.222.0.40 () {56 vars in 1143 bytes} [Thu Jul 14 09:27:46 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:27:46.787963 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4ec641-4067-49ab-9c93-04f21d7d97bd None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:27:46.932770 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4ec641-4067-49ab-9c93-04f21d7d97bd None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:27:46.983022 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf72c98e-5a28-4d47-87c1-bb1974a776ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:27:46.984097 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf72c98e-5a28-4d47-87c1-bb1974a776ea None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:27:46.984472 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf72c98e-5a28-4d47-87c1-bb1974a776ea None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:27:46.984754 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf72c98e-5a28-4d47-87c1-bb1974a776ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:27:47.017508 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:27:47.059136 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf72c98e-5a28-4d47-87c1-bb1974a776ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:27:47.060870 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf72c98e-5a28-4d47-87c1-bb1974a776ea None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:27:47.190806 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 596/1214] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 14 09:27:46 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 09:27:47.196728 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc66710-2702-4dc2-b3f2-6a0fb70387a5 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:27:47.224846 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:27:47.332753 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc66710-2702-4dc2-b3f2-6a0fb70387a5 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:27:47.371773 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94a242f-90d0-4411-9151-f45a9de54060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:27:47.372763 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94a242f-90d0-4411-9151-f45a9de54060 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:27:47.373056 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94a242f-90d0-4411-9151-f45a9de54060 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:27:47.373332 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94a242f-90d0-4411-9151-f45a9de54060 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:27:47.384366 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94a242f-90d0-4411-9151-f45a9de54060 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:27:47.385843 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94a242f-90d0-4411-9151-f45a9de54060 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:27:47.406120 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-d94a242f-90d0-4411-9151-f45a9de54060 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:27:47.406120 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:27:47.406120 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:27:47.406120 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:27:47.406120 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:27:47.406120 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:27:47.406120 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:27:47.406120 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:27:47.406120 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:27:47.406120 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:27:47.406120 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:27:47.406120 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:27:47.406120 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 09:27:47.406120 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 09:27:47.406120 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 09:27:47.407386 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 09:27:47.407386 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:27:47.407386 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:27:47.407386 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:27:47.407386 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:27:47.407386 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:27:47.407386 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:27:47.407386 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:27:47.407386 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( Jul 14 09:27:47.407386 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:27:47.407386 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:27:47.407386 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:27:47.407386 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:27:47.407386 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:27:47.407386 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:27:47.407386 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:27:47.407386 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:27:47.408280 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 09:27:47.408280 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 09:27:47.408280 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:27:47.408280 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Jul 14 09:27:47.408280 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 619/1215] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 09:27:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:27:47.414226 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf72c98e-5a28-4d47-87c1-bb1974a776ea None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:27:47.487964 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:27:47.541799 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf72c98e-5a28-4d47-87c1-bb1974a776ea None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:27:47.585992 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42586a0-9402-4098-8f5f-bafc44651279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:27:47.587169 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42586a0-9402-4098-8f5f-bafc44651279 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:27:47.587479 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42586a0-9402-4098-8f5f-bafc44651279 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:27:47.587934 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42586a0-9402-4098-8f5f-bafc44651279 None admin] PATH_INFO: `/v3/domains` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:27:47.589086 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42586a0-9402-4098-8f5f-bafc44651279 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:27:47.589367 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42586a0-9402-4098-8f5f-bafc44651279 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:27:47.592035 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42586a0-9402-4098-8f5f-bafc44651279 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:27:47.607154 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 597/1216] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 14 09:27:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:27:47.613131 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94a242f-90d0-4411-9151-f45a9de54060 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:27:47.696487 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:27:47.735851 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94a242f-90d0-4411-9151-f45a9de54060 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:27:47.792964 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc6951c-ae25-4e00-a592-2baa24a81c7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:27:47.793896 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc6951c-ae25-4e00-a592-2baa24a81c7b None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:27:47.794233 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc6951c-ae25-4e00-a592-2baa24a81c7b None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:27:47.794515 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc6951c-ae25-4e00-a592-2baa24a81c7b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:27:47.803581 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc6951c-ae25-4e00-a592-2baa24a81c7b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:27:47.805615 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc6951c-ae25-4e00-a592-2baa24a81c7b None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:27:47.826122 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-9dc6951c-ae25-4e00-a592-2baa24a81c7b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 09:27:47.826122 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:27:47.826122 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:27:47.826122 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:27:47.826122 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:27:47.826122 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:27:47.826122 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:27:47.826122 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:27:47.826122 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:27:47.826122 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:27:47.826122 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:27:47.826122 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:27:47.826122 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 09:27:47.826122 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 09:27:47.826122 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 09:27:47.827736 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 09:27:47.827736 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:27:47.827736 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:27:47.827736 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:27:47.827736 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:27:47.827736 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:27:47.827736 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:27:47.827736 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:27:47.827736 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( Jul 14 09:27:47.827736 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:27:47.827736 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:27:47.827736 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:27:47.827736 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:27:47.827736 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:27:47.827736 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:27:47.827736 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:27:47.827736 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:27:47.828691 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 09:27:47.828691 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 09:27:47.828691 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 09:27:47.828691 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 09:27:47.828691 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 09:27:47.828691 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 09:27:47.828691 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 09:27:47.828691 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Jul 14 09:27:47.828691 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 620/1217] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jul 14 09:27:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:27:47.835266 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42586a0-9402-4098-8f5f-bafc44651279 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:27:47.963821 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42586a0-9402-4098-8f5f-bafc44651279 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:27:47.991137 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:27:48.005455 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557cf2b7-f869-4a24-b249-7c55e819f671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:27:48.006151 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557cf2b7-f869-4a24-b249-7c55e819f671 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:27:48.006961 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557cf2b7-f869-4a24-b249-7c55e819f671 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:27:48.007192 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557cf2b7-f869-4a24-b249-7c55e819f671 None admin] PATH_INFO: `/v3/projects` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:27:48.007985 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557cf2b7-f869-4a24-b249-7c55e819f671 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:27:48.008299 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557cf2b7-f869-4a24-b249-7c55e819f671 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:27:48.009947 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557cf2b7-f869-4a24-b249-7c55e819f671 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:27:48.024080 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 598/1218] 10.222.0.40 () {56 vars in 1148 bytes} [Thu Jul 14 09:27:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:27:48.030808 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc6951c-ae25-4e00-a592-2baa24a81c7b None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:27:48.146853 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc6951c-ae25-4e00-a592-2baa24a81c7b None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:27:48.186064 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:27:48.195053 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9940bab-929e-426b-82f7-b0cbf32ea850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:27:48.196550 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9940bab-929e-426b-82f7-b0cbf32ea850 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:27:48.196550 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9940bab-929e-426b-82f7-b0cbf32ea850 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:27:48.196753 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9940bab-929e-426b-82f7-b0cbf32ea850 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:27:48.197760 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9940bab-929e-426b-82f7-b0cbf32ea850 None admin] RBAC: Adding query filter params (role.id=c12236aebd8048ba991da4671b44935f, scope.project.id=a478e76f04dd413f89ddfba7b0cdc9cc, user.id=6fc5a80144b84c609944a51a84fd5e6e) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:27:48.198408 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9940bab-929e-426b-82f7-b0cbf32ea850 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:27:48.200619 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9940bab-929e-426b-82f7-b0cbf32ea850 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:27:48.210600 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 621/1219] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jul 14 09:27:48 2022] GET /identity/v3/role_assignments?user.id=6fc5a80144b84c609944a51a84fd5e6e&scope.project.id=a478e76f04dd413f89ddfba7b0cdc9cc&role.id=c12236aebd8048ba991da4671b44935f => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:27:50.364502 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da31395-00fe-46e6-8c7f-80f03de5314a None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:27:50.365170 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da31395-00fe-46e6-8c7f-80f03de5314a None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:27:50.365170 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da31395-00fe-46e6-8c7f-80f03de5314a None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:27:50.366663 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 599/1220] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:27:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 09:27:50.373441 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a2073b-9693-484b-94aa-da8afb6d7f17 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:27:50.374009 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a2073b-9693-484b-94aa-da8afb6d7f17 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:27:50.374009 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a2073b-9693-484b-94aa-da8afb6d7f17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:27:50.394559 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-39a2073b-9693-484b-94aa-da8afb6d7f17 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:27:50.396030 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-39a2073b-9693-484b-94aa-da8afb6d7f17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:27:50.475642 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 622/1221] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:27:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 09:27:50.501844 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da31395-00fe-46e6-8c7f-80f03de5314a None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:27:50.636101 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da31395-00fe-46e6-8c7f-80f03de5314a None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:27:50.678344 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43adc20-6390-4717-9b90-ab6fa9a551e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:27:50.679176 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43adc20-6390-4717-9b90-ab6fa9a551e9 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:27:50.679464 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43adc20-6390-4717-9b90-ab6fa9a551e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:27:50.679745 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43adc20-6390-4717-9b90-ab6fa9a551e9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:27:50.691315 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43adc20-6390-4717-9b90-ab6fa9a551e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:27:50.700431 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-c43adc20-6390-4717-9b90-ab6fa9a551e9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 09:27:50.700431 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:27:50.700431 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:27:50.700431 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:27:50.700431 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:27:50.700431 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:27:50.700431 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:27:50.700431 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:27:50.700431 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:27:50.700431 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:27:50.700431 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:27:50.700431 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:27:50.700431 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:27:50.700431 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:27:50.700431 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:27:50.700431 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:27:50.701472 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:27:50.701472 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:27:50.701472 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:27:50.701472 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:27:50.701472 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:27:50.701472 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:27:50.701472 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:27:50.701472 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:27:50.701472 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:27:50.701472 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:27:50.701472 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:27:50.701472 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( Jul 14 09:27:50.701472 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:27:50.701472 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:27:50.701472 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:27:50.701472 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:27:50.702521 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:27:50.702521 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:27:50.702521 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:27:50.702521 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:27:50.702521 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:27:50.702521 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:27:50.702521 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:27:50.702521 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:27:50.702521 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:27:50.702521 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:27:50.702521 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 09:27:50.702521 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:27:50.702521 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 600/1222] 10.222.0.40 () {56 vars in 1102 bytes} [Thu Jul 14 09:27:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:27:50.707890 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a2073b-9693-484b-94aa-da8afb6d7f17 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:27:50.820450 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a2073b-9693-484b-94aa-da8afb6d7f17 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:27:50.849596 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:27:50.863042 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b1b0fa-beec-4fd1-882a-0fb8d1e0cd75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:27:50.863840 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b1b0fa-beec-4fd1-882a-0fb8d1e0cd75 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:27:50.864147 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b1b0fa-beec-4fd1-882a-0fb8d1e0cd75 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:27:50.864466 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b1b0fa-beec-4fd1-882a-0fb8d1e0cd75 None admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:27:50.865231 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b1b0fa-beec-4fd1-882a-0fb8d1e0cd75 None admin] RBAC: Adding query filter params (name=service) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:27:50.865535 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b1b0fa-beec-4fd1-882a-0fb8d1e0cd75 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:27:50.866943 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b1b0fa-beec-4fd1-882a-0fb8d1e0cd75 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:27:50.876089 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 623/1223] 10.222.0.40 () {56 vars in 1103 bytes} [Thu Jul 14 09:27:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:27:50.882723 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43adc20-6390-4717-9b90-ab6fa9a551e9 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:27:50.941500 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:27:51.016576 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43adc20-6390-4717-9b90-ab6fa9a551e9 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:27:51.063321 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fca823-42b4-4cfc-b624-470062a2fa7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:27:51.064347 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fca823-42b4-4cfc-b624-470062a2fa7e None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:27:51.064695 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fca823-42b4-4cfc-b624-470062a2fa7e None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:27:51.065019 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fca823-42b4-4cfc-b624-470062a2fa7e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:27:51.082881 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fca823-42b4-4cfc-b624-470062a2fa7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:27:51.084612 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fca823-42b4-4cfc-b624-470062a2fa7e None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:27:51.107274 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-03fca823-42b4-4cfc-b624-470062a2fa7e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:27:51.107274 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:27:51.107274 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:27:51.107274 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:27:51.107274 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:27:51.107274 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:27:51.107274 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:27:51.107274 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:27:51.107274 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:27:51.107274 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:27:51.107274 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:27:51.107274 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:27:51.107274 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 09:27:51.107274 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 09:27:51.107274 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 09:27:51.110211 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 09:27:51.110211 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:27:51.110211 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:27:51.110211 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:27:51.110211 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:27:51.110211 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:27:51.110211 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:27:51.110211 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:27:51.110211 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( Jul 14 09:27:51.110211 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:27:51.110211 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:27:51.110211 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:27:51.110211 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:27:51.110211 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:27:51.110211 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:27:51.110211 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:27:51.110211 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:27:51.111301 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 09:27:51.111301 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 09:27:51.111301 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:27:51.111301 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:27:51.111301 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 601/1224] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 09:27:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:27:51.115409 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b1b0fa-beec-4fd1-882a-0fb8d1e0cd75 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:27:51.243204 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b1b0fa-beec-4fd1-882a-0fb8d1e0cd75 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:27:51.281642 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3082e8d8-d820-401e-af5d-5ebf2fc66f6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:27:51.282375 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3082e8d8-d820-401e-af5d-5ebf2fc66f6b None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:27:51.282665 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3082e8d8-d820-401e-af5d-5ebf2fc66f6b None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:27:51.282944 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3082e8d8-d820-401e-af5d-5ebf2fc66f6b None admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:27:51.283691 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3082e8d8-d820-401e-af5d-5ebf2fc66f6b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:27:51.284003 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3082e8d8-d820-401e-af5d-5ebf2fc66f6b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:27:51.285495 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3082e8d8-d820-401e-af5d-5ebf2fc66f6b None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:27:51.300534 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 624/1225] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 14 09:27:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:27:51.307496 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fca823-42b4-4cfc-b624-470062a2fa7e None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:27:51.412089 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:27:51.420588 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fca823-42b4-4cfc-b624-470062a2fa7e None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:27:51.461339 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cdf972-04ef-45ab-8d5b-440ac3881f21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:27:51.462175 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cdf972-04ef-45ab-8d5b-440ac3881f21 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:27:51.462494 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cdf972-04ef-45ab-8d5b-440ac3881f21 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:27:51.462775 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cdf972-04ef-45ab-8d5b-440ac3881f21 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:27:51.470903 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cdf972-04ef-45ab-8d5b-440ac3881f21 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:27:51.472372 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cdf972-04ef-45ab-8d5b-440ac3881f21 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:27:51.488539 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-96cdf972-04ef-45ab-8d5b-440ac3881f21 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 14 09:27:51.488539 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:27:51.488539 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:27:51.488539 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:27:51.488539 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:27:51.488539 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:27:51.488539 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:27:51.488539 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:27:51.488539 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:27:51.488539 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:27:51.488539 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:27:51.488539 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:27:51.488539 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 09:27:51.488539 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 09:27:51.488539 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 09:27:51.488539 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 09:27:51.489861 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:27:51.489861 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:27:51.489861 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 09:27:51.489861 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 09:27:51.489861 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 09:27:51.489861 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 09:27:51.489861 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:27:51.489861 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:27:51.489861 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:27:51.489861 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:27:51.489861 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:27:51.489861 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( Jul 14 09:27:51.489861 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:27:51.489861 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:27:51.489861 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:27:51.489861 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:27:51.489861 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:27:51.489861 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:27:51.491320 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:27:51.491320 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:27:51.491320 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 09:27:51.491320 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 09:27:51.491320 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 09:27:51.491320 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 09:27:51.491320 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 09:27:51.491320 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 09:27:51.491320 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 14 09:27:51.491320 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:27:51.491320 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 602/1226] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 09:27:51 2022] GET /identity/v3/users/placement => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:27:51.496813 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3082e8d8-d820-401e-af5d-5ebf2fc66f6b None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:27:51.550875 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:27:51.609832 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3082e8d8-d820-401e-af5d-5ebf2fc66f6b None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:27:51.646951 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aa61fe-40a6-4979-a4f0-70fbc6d293d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:27:51.647630 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aa61fe-40a6-4979-a4f0-70fbc6d293d7 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:27:51.647913 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aa61fe-40a6-4979-a4f0-70fbc6d293d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:27:51.648190 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aa61fe-40a6-4979-a4f0-70fbc6d293d7 None admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:27:51.649030 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41aa61fe-40a6-4979-a4f0-70fbc6d293d7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:27:51.649342 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41aa61fe-40a6-4979-a4f0-70fbc6d293d7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:27:51.650814 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41aa61fe-40a6-4979-a4f0-70fbc6d293d7 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:27:51.669302 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 625/1227] 10.222.0.40 () {56 vars in 1143 bytes} [Thu Jul 14 09:27:51 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:27:51.675058 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cdf972-04ef-45ab-8d5b-440ac3881f21 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:27:51.789383 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cdf972-04ef-45ab-8d5b-440ac3881f21 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:27:51.828847 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd050942-061a-491e-ac96-eff075a1d431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:27:51.829640 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd050942-061a-491e-ac96-eff075a1d431 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:27:51.829923 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd050942-061a-491e-ac96-eff075a1d431 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:27:51.830221 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd050942-061a-491e-ac96-eff075a1d431 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:27:51.841671 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd050942-061a-491e-ac96-eff075a1d431 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:27:51.843181 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd050942-061a-491e-ac96-eff075a1d431 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:27:51.862365 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-cd050942-061a-491e-ac96-eff075a1d431 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:27:51.862365 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:27:51.862365 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:27:51.862365 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:27:51.862365 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:27:51.862365 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:27:51.862365 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:27:51.862365 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:27:51.862365 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:27:51.862365 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:27:51.862365 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:27:51.862365 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:27:51.862365 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 09:27:51.862365 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 09:27:51.862365 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 09:27:51.863551 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 09:27:51.863551 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:27:51.863551 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:27:51.863551 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:27:51.863551 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:27:51.863551 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:27:51.863551 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:27:51.863551 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:27:51.863551 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( Jul 14 09:27:51.863551 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:27:51.863551 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:27:51.863551 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:27:51.863551 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:27:51.863551 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:27:51.863551 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:27:51.863551 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:27:51.863551 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:27:51.864862 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 09:27:51.864862 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 09:27:51.864862 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:27:51.864862 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:27:51.864862 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 603/1228] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 09:27:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:27:51.870079 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aa61fe-40a6-4979-a4f0-70fbc6d293d7 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:27:51.987640 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aa61fe-40a6-4979-a4f0-70fbc6d293d7 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:27:51.990118 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:27:52.027520 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c95e139-2bdd-471f-bc7d-3642f9332838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:27:52.028258 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c95e139-2bdd-471f-bc7d-3642f9332838 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:27:52.028544 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c95e139-2bdd-471f-bc7d-3642f9332838 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:27:52.028825 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c95e139-2bdd-471f-bc7d-3642f9332838 None admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:27:52.029583 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c95e139-2bdd-471f-bc7d-3642f9332838 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:27:52.029899 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c95e139-2bdd-471f-bc7d-3642f9332838 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:27:52.031364 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c95e139-2bdd-471f-bc7d-3642f9332838 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:27:52.050103 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 626/1229] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 14 09:27:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:27:52.051620 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd050942-061a-491e-ac96-eff075a1d431 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:27:52.062895 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:27:52.172325 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd050942-061a-491e-ac96-eff075a1d431 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:27:52.218026 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a22af0-72c3-428f-80b7-7e1d12266970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:27:52.219164 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a22af0-72c3-428f-80b7-7e1d12266970 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:27:52.219454 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a22af0-72c3-428f-80b7-7e1d12266970 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:27:52.219880 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a22af0-72c3-428f-80b7-7e1d12266970 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:27:52.229170 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a22af0-72c3-428f-80b7-7e1d12266970 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:27:52.231620 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a22af0-72c3-428f-80b7-7e1d12266970 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:27:52.246918 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-40a22af0-72c3-428f-80b7-7e1d12266970 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 09:27:52.246918 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:27:52.246918 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:27:52.246918 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:27:52.246918 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:27:52.246918 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:27:52.246918 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:27:52.246918 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:27:52.246918 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:27:52.246918 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:27:52.246918 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:27:52.246918 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:27:52.246918 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 09:27:52.246918 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 09:27:52.246918 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 09:27:52.248257 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 09:27:52.248257 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:27:52.248257 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:27:52.248257 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:27:52.248257 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:27:52.248257 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:27:52.248257 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:27:52.248257 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:27:52.248257 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( Jul 14 09:27:52.248257 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:27:52.248257 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:27:52.248257 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:27:52.248257 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:27:52.248257 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:27:52.248257 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:27:52.248257 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:27:52.248257 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:27:52.249313 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 09:27:52.249313 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 09:27:52.249313 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 09:27:52.249313 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 09:27:52.249313 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 09:27:52.249313 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 09:27:52.249313 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 09:27:52.249313 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:27:52.249313 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 604/1230] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jul 14 09:27:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:27:52.254597 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c95e139-2bdd-471f-bc7d-3642f9332838 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:27:52.374400 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c95e139-2bdd-471f-bc7d-3642f9332838 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:27:52.415999 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0d30a7-0506-421a-a240-ea01be5aa28f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:27:52.416972 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0d30a7-0506-421a-a240-ea01be5aa28f None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:27:52.417352 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0d30a7-0506-421a-a240-ea01be5aa28f None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:27:52.417667 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0d30a7-0506-421a-a240-ea01be5aa28f None admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:27:52.419206 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0d30a7-0506-421a-a240-ea01be5aa28f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:27:52.419540 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0d30a7-0506-421a-a240-ea01be5aa28f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:27:52.421612 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0d30a7-0506-421a-a240-ea01be5aa28f None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:27:52.436064 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 627/1231] 10.222.0.40 () {56 vars in 1148 bytes} [Thu Jul 14 09:27:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:27:52.442149 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a22af0-72c3-428f-80b7-7e1d12266970 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:27:52.513828 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:27:52.558224 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a22af0-72c3-428f-80b7-7e1d12266970 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:27:52.598076 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035cc5a2-5ea4-4d0e-b5d0-ebfc52563914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:27:52.599018 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035cc5a2-5ea4-4d0e-b5d0-ebfc52563914 None admin] REQUEST_METHOD: `PUT` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:27:52.599303 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035cc5a2-5ea4-4d0e-b5d0-ebfc52563914 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:27:52.599581 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035cc5a2-5ea4-4d0e-b5d0-ebfc52563914 None admin] PATH_INFO: `/v3/projects/a478e76f04dd413f89ddfba7b0cdc9cc/users/6fc5a80144b84c609944a51a84fd5e6e/roles/c12236aebd8048ba991da4671b44935f` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:27:52.616008 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035cc5a2-5ea4-4d0e-b5d0-ebfc52563914 None admin] RBAC: Authorizing `identity:create_grant(project_id=a478e76f04dd413f89ddfba7b0cdc9cc, user_id=6fc5a80144b84c609944a51a84fd5e6e, role_id=c12236aebd8048ba991da4671b44935f)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:27:52.617558 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035cc5a2-5ea4-4d0e-b5d0-ebfc52563914 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:27:52.630376 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 605/1232] 10.222.0.40 () {58 vars in 1439 bytes} [Thu Jul 14 09:27:52 2022] PUT /identity/v3/projects/a478e76f04dd413f89ddfba7b0cdc9cc/users/6fc5a80144b84c609944a51a84fd5e6e/roles/c12236aebd8048ba991da4671b44935f => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:27:54.827556 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad6251f-77d7-408f-8f8f-d4b5eade2cc2 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:27:54.828084 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad6251f-77d7-408f-8f8f-d4b5eade2cc2 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:27:54.828251 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad6251f-77d7-408f-8f8f-d4b5eade2cc2 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:27:54.830166 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 628/1233] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:27:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:27:54.836059 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fb4387-032b-4b00-a7e4-dceafbe84155 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:27:54.836515 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fb4387-032b-4b00-a7e4-dceafbe84155 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:27:54.836624 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fb4387-032b-4b00-a7e4-dceafbe84155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:27:54.861107 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-05fb4387-032b-4b00-a7e4-dceafbe84155 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:27:54.862821 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-05fb4387-032b-4b00-a7e4-dceafbe84155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:27:54.941657 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 606/1234] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:27:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 09:27:54.967249 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad6251f-77d7-408f-8f8f-d4b5eade2cc2 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:27:54.997810 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:27:55.091348 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad6251f-77d7-408f-8f8f-d4b5eade2cc2 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:27:55.127180 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dbdbe9-bbe0-4aee-bf43-6aea833b8cbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:27:55.128085 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dbdbe9-bbe0-4aee-bf43-6aea833b8cbd None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:27:55.128424 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dbdbe9-bbe0-4aee-bf43-6aea833b8cbd None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:27:55.128788 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dbdbe9-bbe0-4aee-bf43-6aea833b8cbd None admin] PATH_INFO: `/v3/roles/service` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:27:55.140835 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dbdbe9-bbe0-4aee-bf43-6aea833b8cbd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:27:55.149730 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-64dbdbe9-bbe0-4aee-bf43-6aea833b8cbd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 09:27:55.149730 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:27:55.149730 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:27:55.149730 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:27:55.149730 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:27:55.149730 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:27:55.149730 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:27:55.149730 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:27:55.149730 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:27:55.149730 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:27:55.149730 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:27:55.149730 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:27:55.149730 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:27:55.149730 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:27:55.149730 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:27:55.149730 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:27:55.151100 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:27:55.151100 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:27:55.151100 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:27:55.151100 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:27:55.151100 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:27:55.151100 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:27:55.151100 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:27:55.151100 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:27:55.151100 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:27:55.151100 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:27:55.151100 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:27:55.151100 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( Jul 14 09:27:55.151100 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:27:55.151100 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:27:55.151100 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:27:55.151100 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:27:55.151995 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:27:55.151995 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:27:55.151995 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:27:55.151995 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:27:55.151995 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:27:55.151995 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:27:55.151995 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:27:55.151995 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:27:55.151995 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:27:55.151995 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:27:55.151995 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 09:27:55.151995 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Jul 14 09:27:55.151995 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 629/1235] 10.222.0.40 () {56 vars in 1102 bytes} [Thu Jul 14 09:27:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 09:27:55.157664 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fb4387-032b-4b00-a7e4-dceafbe84155 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:27:55.216551 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:27:55.279992 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fb4387-032b-4b00-a7e4-dceafbe84155 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:27:55.313592 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2811bfd1-680c-42ad-9905-259403aced14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:27:55.314303 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2811bfd1-680c-42ad-9905-259403aced14 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:27:55.314588 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2811bfd1-680c-42ad-9905-259403aced14 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:27:55.314860 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2811bfd1-680c-42ad-9905-259403aced14 None admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:27:55.315620 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2811bfd1-680c-42ad-9905-259403aced14 None admin] RBAC: Adding query filter params (name=service) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:27:55.315928 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2811bfd1-680c-42ad-9905-259403aced14 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:27:55.317293 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2811bfd1-680c-42ad-9905-259403aced14 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:27:55.326983 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 607/1236] 10.222.0.40 () {56 vars in 1103 bytes} [Thu Jul 14 09:27:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:27:55.332930 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dbdbe9-bbe0-4aee-bf43-6aea833b8cbd None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:27:55.418516 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:27:55.437379 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dbdbe9-bbe0-4aee-bf43-6aea833b8cbd None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:27:55.473148 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cf9664-4897-4237-8048-be7af6d92847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:27:55.474022 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cf9664-4897-4237-8048-be7af6d92847 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:27:55.474338 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cf9664-4897-4237-8048-be7af6d92847 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:27:55.474628 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cf9664-4897-4237-8048-be7af6d92847 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:27:55.486297 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cf9664-4897-4237-8048-be7af6d92847 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:27:55.488248 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cf9664-4897-4237-8048-be7af6d92847 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:27:55.506133 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-47cf9664-4897-4237-8048-be7af6d92847 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:27:55.506133 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:27:55.506133 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:27:55.506133 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:27:55.506133 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:27:55.506133 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:27:55.506133 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:27:55.506133 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:27:55.506133 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:27:55.506133 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:27:55.506133 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:27:55.506133 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:27:55.506133 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 09:27:55.506133 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 09:27:55.506133 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 09:27:55.507269 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 09:27:55.507269 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:27:55.507269 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:27:55.507269 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:27:55.507269 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:27:55.507269 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:27:55.507269 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:27:55.507269 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:27:55.507269 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( Jul 14 09:27:55.507269 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:27:55.507269 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:27:55.507269 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:27:55.507269 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:27:55.507269 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:27:55.507269 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:27:55.507269 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:27:55.507269 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:27:55.508280 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 09:27:55.508280 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 09:27:55.508280 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:27:55.508280 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Jul 14 09:27:55.508280 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 630/1237] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 09:27:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:27:55.513681 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2811bfd1-680c-42ad-9905-259403aced14 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:27:55.620059 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2811bfd1-680c-42ad-9905-259403aced14 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:27:55.631356 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:27:55.658263 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2493abc1-2bed-4ca6-80ef-9049a7d5d6e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:27:55.658939 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2493abc1-2bed-4ca6-80ef-9049a7d5d6e7 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:27:55.659225 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2493abc1-2bed-4ca6-80ef-9049a7d5d6e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:27:55.659503 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2493abc1-2bed-4ca6-80ef-9049a7d5d6e7 None admin] PATH_INFO: `/v3/domains` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:27:55.660237 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2493abc1-2bed-4ca6-80ef-9049a7d5d6e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:27:55.660574 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2493abc1-2bed-4ca6-80ef-9049a7d5d6e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:27:55.661948 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2493abc1-2bed-4ca6-80ef-9049a7d5d6e7 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:27:55.673946 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 608/1238] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 14 09:27:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:27:55.679763 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cf9664-4897-4237-8048-be7af6d92847 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:27:55.788371 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cf9664-4897-4237-8048-be7af6d92847 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:27:55.826428 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff63a99-a0c8-41e4-ad53-bf65805c5da9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:27:55.827245 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff63a99-a0c8-41e4-ad53-bf65805c5da9 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:27:55.827538 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff63a99-a0c8-41e4-ad53-bf65805c5da9 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:27:55.827821 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff63a99-a0c8-41e4-ad53-bf65805c5da9 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:27:55.830690 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:27:55.837729 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff63a99-a0c8-41e4-ad53-bf65805c5da9 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:27:55.839573 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff63a99-a0c8-41e4-ad53-bf65805c5da9 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:27:55.855844 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-7ff63a99-a0c8-41e4-ad53-bf65805c5da9 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 14 09:27:55.855844 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:27:55.855844 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:27:55.855844 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:27:55.855844 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:27:55.855844 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:27:55.855844 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:27:55.855844 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:27:55.855844 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:27:55.855844 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:27:55.855844 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:27:55.855844 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:27:55.855844 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 09:27:55.855844 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 09:27:55.855844 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 09:27:55.855844 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 09:27:55.856975 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:27:55.856975 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:27:55.856975 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 09:27:55.856975 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 09:27:55.856975 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 09:27:55.856975 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 09:27:55.856975 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:27:55.856975 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:27:55.856975 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:27:55.856975 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:27:55.856975 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:27:55.856975 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( Jul 14 09:27:55.856975 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:27:55.856975 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:27:55.856975 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:27:55.856975 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:27:55.856975 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:27:55.856975 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:27:55.858148 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:27:55.858148 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:27:55.858148 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 09:27:55.858148 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 09:27:55.858148 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 09:27:55.858148 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 09:27:55.858148 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 09:27:55.858148 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 09:27:55.858148 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 14 09:27:55.858148 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Jul 14 09:27:55.858148 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 631/1239] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 09:27:55 2022] GET /identity/v3/users/placement => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:27:55.863936 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2493abc1-2bed-4ca6-80ef-9049a7d5d6e7 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:27:55.975073 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2493abc1-2bed-4ca6-80ef-9049a7d5d6e7 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:27:56.014152 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bb31e3-bbc3-4ab7-9e23-2acbfc1d45b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:27:56.014862 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bb31e3-bbc3-4ab7-9e23-2acbfc1d45b4 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:27:56.015150 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bb31e3-bbc3-4ab7-9e23-2acbfc1d45b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:27:56.015428 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bb31e3-bbc3-4ab7-9e23-2acbfc1d45b4 None admin] PATH_INFO: `/v3/users` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:27:56.016279 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bb31e3-bbc3-4ab7-9e23-2acbfc1d45b4 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:27:56.016594 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bb31e3-bbc3-4ab7-9e23-2acbfc1d45b4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:27:56.018036 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bb31e3-bbc3-4ab7-9e23-2acbfc1d45b4 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:27:56.042231 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 609/1240] 10.222.0.40 () {56 vars in 1143 bytes} [Thu Jul 14 09:27:55 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:27:56.044091 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff63a99-a0c8-41e4-ad53-bf65805c5da9 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:27:56.147328 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff63a99-a0c8-41e4-ad53-bf65805c5da9 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:27:56.183522 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8509f3eb-5d38-48ec-8552-bb392b34238b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:27:56.184249 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8509f3eb-5d38-48ec-8552-bb392b34238b None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:27:56.184550 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8509f3eb-5d38-48ec-8552-bb392b34238b None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:27:56.184832 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8509f3eb-5d38-48ec-8552-bb392b34238b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:27:56.250868 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:27:56.257973 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8509f3eb-5d38-48ec-8552-bb392b34238b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:27:56.259468 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8509f3eb-5d38-48ec-8552-bb392b34238b None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:27:56.367642 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 632/1241] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 14 09:27:56 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 09:27:56.373498 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bb31e3-bbc3-4ab7-9e23-2acbfc1d45b4 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:27:56.402782 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:27:56.485544 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bb31e3-bbc3-4ab7-9e23-2acbfc1d45b4 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:27:56.528070 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9596f6f7-2c29-4827-8a37-91c9ce5bc700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:27:56.529794 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9596f6f7-2c29-4827-8a37-91c9ce5bc700 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:27:56.529794 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9596f6f7-2c29-4827-8a37-91c9ce5bc700 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:27:56.529794 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9596f6f7-2c29-4827-8a37-91c9ce5bc700 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:27:56.540692 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9596f6f7-2c29-4827-8a37-91c9ce5bc700 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:27:56.542382 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9596f6f7-2c29-4827-8a37-91c9ce5bc700 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:27:56.561235 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-9596f6f7-2c29-4827-8a37-91c9ce5bc700 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:27:56.561235 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:27:56.561235 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:27:56.561235 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:27:56.561235 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:27:56.561235 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:27:56.561235 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:27:56.561235 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:27:56.561235 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:27:56.561235 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:27:56.561235 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:27:56.561235 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:27:56.561235 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 09:27:56.561235 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 09:27:56.561235 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 09:27:56.562261 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 09:27:56.562261 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:27:56.562261 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:27:56.562261 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:27:56.562261 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:27:56.562261 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:27:56.562261 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:27:56.562261 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:27:56.562261 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( Jul 14 09:27:56.562261 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:27:56.562261 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:27:56.562261 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:27:56.562261 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:27:56.562261 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:27:56.562261 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:27:56.562261 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:27:56.562261 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:27:56.563208 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 09:27:56.563208 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 09:27:56.563208 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:27:56.563208 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:27:56.563208 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 610/1242] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 09:27:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:27:56.568434 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8509f3eb-5d38-48ec-8552-bb392b34238b None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:27:56.674653 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:27:56.681265 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8509f3eb-5d38-48ec-8552-bb392b34238b None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:27:56.717811 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5f1d7d-18c5-46b0-a928-9123a7b35719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:27:56.718509 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5f1d7d-18c5-46b0-a928-9123a7b35719 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:27:56.718802 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5f1d7d-18c5-46b0-a928-9123a7b35719 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:27:56.719073 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5f1d7d-18c5-46b0-a928-9123a7b35719 None admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:27:56.719846 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5f1d7d-18c5-46b0-a928-9123a7b35719 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:27:56.720093 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5f1d7d-18c5-46b0-a928-9123a7b35719 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:27:56.721452 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5f1d7d-18c5-46b0-a928-9123a7b35719 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:27:56.733918 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 633/1243] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 14 09:27:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:27:56.740230 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9596f6f7-2c29-4827-8a37-91c9ce5bc700 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:27:56.829694 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:27:56.854643 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9596f6f7-2c29-4827-8a37-91c9ce5bc700 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:27:56.898538 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a791cc-6c32-4ae1-a1e3-ae78b1e41103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:27:56.899488 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a791cc-6c32-4ae1-a1e3-ae78b1e41103 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:27:56.899821 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a791cc-6c32-4ae1-a1e3-ae78b1e41103 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:27:56.900227 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a791cc-6c32-4ae1-a1e3-ae78b1e41103 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:27:56.908793 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a791cc-6c32-4ae1-a1e3-ae78b1e41103 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:27:56.910300 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a791cc-6c32-4ae1-a1e3-ae78b1e41103 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:27:56.924706 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-b7a791cc-6c32-4ae1-a1e3-ae78b1e41103 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 09:27:56.924706 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:27:56.924706 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:27:56.924706 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:27:56.924706 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:27:56.924706 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:27:56.924706 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:27:56.924706 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:27:56.924706 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:27:56.924706 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:27:56.924706 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:27:56.924706 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:27:56.924706 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 09:27:56.924706 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 09:27:56.924706 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 09:27:56.925910 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 09:27:56.925910 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:27:56.925910 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:27:56.925910 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:27:56.925910 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:27:56.925910 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:27:56.925910 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:27:56.925910 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:27:56.925910 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( Jul 14 09:27:56.925910 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:27:56.925910 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:27:56.925910 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:27:56.925910 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:27:56.925910 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:27:56.925910 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:27:56.925910 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:27:56.925910 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:27:56.927639 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 09:27:56.927639 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 09:27:56.927639 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 09:27:56.927639 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 09:27:56.927639 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 09:27:56.927639 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 09:27:56.927639 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 09:27:56.927639 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:27:56.927639 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 611/1244] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jul 14 09:27:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:27:56.932362 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5f1d7d-18c5-46b0-a928-9123a7b35719 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:27:57.039801 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5f1d7d-18c5-46b0-a928-9123a7b35719 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:27:57.082445 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94ed05b-d982-4841-8609-6f87f07529c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:27:57.083048 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94ed05b-d982-4841-8609-6f87f07529c4 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:27:57.083427 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94ed05b-d982-4841-8609-6f87f07529c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:27:57.083789 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94ed05b-d982-4841-8609-6f87f07529c4 None admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:27:57.084625 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94ed05b-d982-4841-8609-6f87f07529c4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:27:57.084943 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94ed05b-d982-4841-8609-6f87f07529c4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:27:57.086624 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94ed05b-d982-4841-8609-6f87f07529c4 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:27:57.101484 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 634/1245] 10.222.0.40 () {56 vars in 1148 bytes} [Thu Jul 14 09:27:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:27:57.108335 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a791cc-6c32-4ae1-a1e3-ae78b1e41103 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:27:57.222103 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a791cc-6c32-4ae1-a1e3-ae78b1e41103 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:27:57.260332 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fa5ed2-3a5c-4634-9275-c5e6b5dddd5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:27:57.261090 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fa5ed2-3a5c-4634-9275-c5e6b5dddd5f None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:27:57.261935 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fa5ed2-3a5c-4634-9275-c5e6b5dddd5f None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:27:57.262278 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fa5ed2-3a5c-4634-9275-c5e6b5dddd5f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:27:57.263387 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fa5ed2-3a5c-4634-9275-c5e6b5dddd5f None admin] RBAC: Adding query filter params (role.id=c12236aebd8048ba991da4671b44935f, scope.project.id=a478e76f04dd413f89ddfba7b0cdc9cc, user.id=6fc5a80144b84c609944a51a84fd5e6e) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:27:57.263658 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fa5ed2-3a5c-4634-9275-c5e6b5dddd5f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:27:57.265256 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fa5ed2-3a5c-4634-9275-c5e6b5dddd5f None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:27:57.272479 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 612/1246] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jul 14 09:27:57 2022] GET /identity/v3/role_assignments?user.id=6fc5a80144b84c609944a51a84fd5e6e&scope.project.id=a478e76f04dd413f89ddfba7b0cdc9cc&role.id=c12236aebd8048ba991da4671b44935f => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:27:59.450750 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39124b30-35f6-4d3d-b786-6df193d42a2f None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:27:59.451359 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39124b30-35f6-4d3d-b786-6df193d42a2f None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:27:59.451359 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39124b30-35f6-4d3d-b786-6df193d42a2f None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:27:59.452653 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 635/1247] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:27:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:27:59.458510 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e90bb09-cbb7-404e-a62a-6aeacfea9e9f None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:27:59.458951 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e90bb09-cbb7-404e-a62a-6aeacfea9e9f None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:27:59.459131 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e90bb09-cbb7-404e-a62a-6aeacfea9e9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:27:59.465355 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:27:59.478362 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-4e90bb09-cbb7-404e-a62a-6aeacfea9e9f None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:27:59.479542 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-4e90bb09-cbb7-404e-a62a-6aeacfea9e9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:27:59.561383 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 613/1248] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:27:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 09:27:59.590067 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39124b30-35f6-4d3d-b786-6df193d42a2f None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:27:59.608693 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:27:59.699958 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39124b30-35f6-4d3d-b786-6df193d42a2f None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:27:59.737684 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7d500d-4939-46ca-b905-45838659c37e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:27:59.738615 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7d500d-4939-46ca-b905-45838659c37e None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:27:59.738978 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7d500d-4939-46ca-b905-45838659c37e None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:27:59.739269 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7d500d-4939-46ca-b905-45838659c37e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:27:59.751886 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7d500d-4939-46ca-b905-45838659c37e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:27:59.760558 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-4d7d500d-4939-46ca-b905-45838659c37e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 09:27:59.760558 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:27:59.760558 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:27:59.760558 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:27:59.760558 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:27:59.760558 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:27:59.760558 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:27:59.760558 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:27:59.760558 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:27:59.760558 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:27:59.760558 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:27:59.760558 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:27:59.760558 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:27:59.760558 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:27:59.760558 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:27:59.760558 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:27:59.763812 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:27:59.763812 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:27:59.763812 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:27:59.763812 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:27:59.763812 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:27:59.763812 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:27:59.763812 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:27:59.763812 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:27:59.763812 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:27:59.763812 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:27:59.763812 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:27:59.763812 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( Jul 14 09:27:59.763812 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:27:59.763812 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:27:59.763812 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:27:59.763812 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:27:59.764724 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:27:59.764724 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:27:59.764724 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:27:59.764724 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:27:59.764724 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:27:59.764724 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:27:59.764724 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:27:59.764724 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:27:59.764724 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:27:59.764724 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:27:59.764724 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 09:27:59.764724 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Jul 14 09:27:59.764724 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 636/1249] 10.222.0.40 () {56 vars in 1096 bytes} [Thu Jul 14 09:27:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:27:59.768847 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e90bb09-cbb7-404e-a62a-6aeacfea9e9f None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:27:59.886694 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e90bb09-cbb7-404e-a62a-6aeacfea9e9f None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:27:59.920125 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:27:59.926435 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3d349d-9bbb-4b5d-b67e-278589bf4efb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:27:59.927239 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3d349d-9bbb-4b5d-b67e-278589bf4efb None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:27:59.927644 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3d349d-9bbb-4b5d-b67e-278589bf4efb None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:27:59.927931 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3d349d-9bbb-4b5d-b67e-278589bf4efb None admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:27:59.928895 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3d349d-9bbb-4b5d-b67e-278589bf4efb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:27:59.929160 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3d349d-9bbb-4b5d-b67e-278589bf4efb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:27:59.930989 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3d349d-9bbb-4b5d-b67e-278589bf4efb None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:27:59.941009 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 614/1250] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 14 09:27:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:27:59.947917 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7d500d-4939-46ca-b905-45838659c37e None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:28:00.038868 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:28:00.064007 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7d500d-4939-46ca-b905-45838659c37e None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:28:00.105311 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b72890-a1f9-4dc6-8239-f6609b373e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:28:00.106284 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b72890-a1f9-4dc6-8239-f6609b373e70 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:28:00.106600 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b72890-a1f9-4dc6-8239-f6609b373e70 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:28:00.107004 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b72890-a1f9-4dc6-8239-f6609b373e70 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:28:00.121049 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b72890-a1f9-4dc6-8239-f6609b373e70 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:28:00.122964 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b72890-a1f9-4dc6-8239-f6609b373e70 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:28:00.143512 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-f4b72890-a1f9-4dc6-8239-f6609b373e70 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:28:00.143512 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:28:00.143512 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:28:00.143512 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:28:00.143512 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:28:00.143512 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:28:00.143512 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:28:00.143512 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:28:00.143512 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:28:00.143512 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:28:00.143512 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:28:00.143512 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:28:00.143512 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 09:28:00.143512 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 09:28:00.143512 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 09:28:00.144715 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 09:28:00.144715 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:28:00.144715 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:28:00.144715 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:28:00.144715 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:28:00.144715 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:28:00.144715 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:28:00.144715 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:28:00.144715 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( Jul 14 09:28:00.144715 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:28:00.144715 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:28:00.144715 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:28:00.144715 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:28:00.144715 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:28:00.144715 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:28:00.144715 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:28:00.144715 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:28:00.145622 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 09:28:00.145622 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 09:28:00.145622 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:28:00.145622 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Jul 14 09:28:00.145622 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 637/1251] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 09:27:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:28:00.150663 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3d349d-9bbb-4b5d-b67e-278589bf4efb None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:28:00.275993 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3d349d-9bbb-4b5d-b67e-278589bf4efb None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:28:00.315647 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df01ceb-2780-458c-993d-98d02567f1d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:28:00.316250 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df01ceb-2780-458c-993d-98d02567f1d4 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:28:00.316570 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df01ceb-2780-458c-993d-98d02567f1d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:28:00.316887 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df01ceb-2780-458c-993d-98d02567f1d4 None admin] PATH_INFO: `/v3/domains` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:28:00.317725 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df01ceb-2780-458c-993d-98d02567f1d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:28:00.318018 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df01ceb-2780-458c-993d-98d02567f1d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:28:00.319663 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df01ceb-2780-458c-993d-98d02567f1d4 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:28:00.334588 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 615/1252] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 14 09:28:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:28:00.340848 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b72890-a1f9-4dc6-8239-f6609b373e70 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:28:00.448824 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b72890-a1f9-4dc6-8239-f6609b373e70 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:28:00.480758 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:28:00.489397 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f772ecc0-cd2c-4a1b-919e-77cac1d50799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:28:00.490267 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f772ecc0-cd2c-4a1b-919e-77cac1d50799 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:28:00.490552 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f772ecc0-cd2c-4a1b-919e-77cac1d50799 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:28:00.490825 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f772ecc0-cd2c-4a1b-919e-77cac1d50799 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:28:00.498604 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f772ecc0-cd2c-4a1b-919e-77cac1d50799 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:28:00.500050 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f772ecc0-cd2c-4a1b-919e-77cac1d50799 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:28:00.515394 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-f772ecc0-cd2c-4a1b-919e-77cac1d50799 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 14 09:28:00.515394 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:28:00.515394 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:28:00.515394 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:28:00.515394 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:28:00.515394 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:28:00.515394 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:28:00.515394 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:28:00.515394 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:28:00.515394 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:28:00.515394 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:28:00.515394 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:28:00.515394 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 09:28:00.515394 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 09:28:00.515394 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 09:28:00.515394 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 09:28:00.516629 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:28:00.516629 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:28:00.516629 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 09:28:00.516629 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 09:28:00.516629 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 09:28:00.516629 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 09:28:00.516629 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:28:00.516629 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:28:00.516629 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:28:00.516629 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:28:00.516629 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:28:00.516629 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( Jul 14 09:28:00.516629 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:28:00.516629 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:28:00.516629 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:28:00.516629 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:28:00.516629 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:28:00.516629 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:28:00.518012 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:28:00.518012 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:28:00.518012 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 09:28:00.518012 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 09:28:00.518012 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 09:28:00.518012 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 09:28:00.518012 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 09:28:00.518012 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 09:28:00.518012 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 14 09:28:00.518012 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Jul 14 09:28:00.518012 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 638/1253] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 09:28:00 2022] GET /identity/v3/users/placement => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:28:00.522960 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df01ceb-2780-458c-993d-98d02567f1d4 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:28:00.588297 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:28:00.640905 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df01ceb-2780-458c-993d-98d02567f1d4 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:28:00.681064 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e03e53f-929e-4a09-a464-6479876c271e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:28:00.681816 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e03e53f-929e-4a09-a464-6479876c271e None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:28:00.682106 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e03e53f-929e-4a09-a464-6479876c271e None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:28:00.682458 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e03e53f-929e-4a09-a464-6479876c271e None admin] PATH_INFO: `/v3/users` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:28:00.683443 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e03e53f-929e-4a09-a464-6479876c271e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:28:00.683797 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e03e53f-929e-4a09-a464-6479876c271e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:28:00.685255 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e03e53f-929e-4a09-a464-6479876c271e None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:28:00.704775 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 616/1254] 10.222.0.40 () {56 vars in 1143 bytes} [Thu Jul 14 09:28:00 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:28:00.710781 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f772ecc0-cd2c-4a1b-919e-77cac1d50799 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:28:00.835303 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f772ecc0-cd2c-4a1b-919e-77cac1d50799 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:28:00.878836 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c2cbf5-e2da-44d0-9e2a-d7c5577377aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:28:00.879522 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c2cbf5-e2da-44d0-9e2a-d7c5577377aa None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:28:00.879880 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c2cbf5-e2da-44d0-9e2a-d7c5577377aa None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:28:00.880231 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c2cbf5-e2da-44d0-9e2a-d7c5577377aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:28:00.941858 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:28:00.956983 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c2cbf5-e2da-44d0-9e2a-d7c5577377aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:28:00.958652 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c2cbf5-e2da-44d0-9e2a-d7c5577377aa None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:28:01.070674 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 639/1255] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 14 09:28:00 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 09:28:01.077835 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e03e53f-929e-4a09-a464-6479876c271e None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:28:01.203883 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e03e53f-929e-4a09-a464-6479876c271e None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:28:01.218840 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:28:01.248133 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99617a9e-c89d-4da7-b0bc-4788852e590d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:28:01.249248 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99617a9e-c89d-4da7-b0bc-4788852e590d None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:28:01.249658 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99617a9e-c89d-4da7-b0bc-4788852e590d None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:28:01.249970 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99617a9e-c89d-4da7-b0bc-4788852e590d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:28:01.262291 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99617a9e-c89d-4da7-b0bc-4788852e590d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:28:01.263736 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99617a9e-c89d-4da7-b0bc-4788852e590d None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:28:01.281967 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-99617a9e-c89d-4da7-b0bc-4788852e590d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:28:01.281967 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:28:01.281967 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:28:01.281967 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:28:01.281967 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:28:01.281967 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:28:01.281967 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:28:01.281967 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:28:01.281967 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:28:01.281967 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:28:01.281967 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:28:01.281967 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:28:01.281967 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 09:28:01.281967 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 09:28:01.281967 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 09:28:01.283139 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 09:28:01.283139 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:28:01.283139 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:28:01.283139 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:28:01.283139 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:28:01.283139 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:28:01.283139 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:28:01.283139 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:28:01.283139 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( Jul 14 09:28:01.283139 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:28:01.283139 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:28:01.283139 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:28:01.283139 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:28:01.283139 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:28:01.283139 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:28:01.283139 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:28:01.283139 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:28:01.288792 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 09:28:01.288792 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 09:28:01.288792 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:28:01.288792 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:28:01.288792 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 617/1256] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 09:28:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:28:01.289152 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c2cbf5-e2da-44d0-9e2a-d7c5577377aa None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:28:01.388285 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:28:01.401410 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c2cbf5-e2da-44d0-9e2a-d7c5577377aa None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:28:01.438776 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e43f38-e853-48d9-b402-4a3cda6e864d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:28:01.439457 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e43f38-e853-48d9-b402-4a3cda6e864d None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:28:01.439744 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e43f38-e853-48d9-b402-4a3cda6e864d None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:28:01.440423 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e43f38-e853-48d9-b402-4a3cda6e864d None admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:28:01.441158 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e43f38-e853-48d9-b402-4a3cda6e864d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:28:01.441473 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e43f38-e853-48d9-b402-4a3cda6e864d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:28:01.442951 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e43f38-e853-48d9-b402-4a3cda6e864d None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:28:01.458738 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 640/1257] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 14 09:28:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:28:01.459963 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99617a9e-c89d-4da7-b0bc-4788852e590d None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:28:01.572341 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99617a9e-c89d-4da7-b0bc-4788852e590d None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:28:01.612906 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca596f7-2887-4782-8a12-b171fb63109c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:28:01.613789 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca596f7-2887-4782-8a12-b171fb63109c None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:28:01.614106 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca596f7-2887-4782-8a12-b171fb63109c None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:28:01.614449 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca596f7-2887-4782-8a12-b171fb63109c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:28:01.623247 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca596f7-2887-4782-8a12-b171fb63109c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:28:01.624802 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca596f7-2887-4782-8a12-b171fb63109c None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:28:01.639399 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-2ca596f7-2887-4782-8a12-b171fb63109c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 09:28:01.639399 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:28:01.639399 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:28:01.639399 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:28:01.639399 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:28:01.639399 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:28:01.639399 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:28:01.639399 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:28:01.639399 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:28:01.639399 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:28:01.639399 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:28:01.639399 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:28:01.639399 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 09:28:01.639399 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 09:28:01.639399 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 09:28:01.640512 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 09:28:01.640512 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:28:01.640512 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:28:01.640512 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:28:01.640512 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:28:01.640512 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:28:01.640512 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:28:01.640512 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:28:01.640512 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( Jul 14 09:28:01.640512 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:28:01.640512 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:28:01.640512 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:28:01.640512 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:28:01.640512 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:28:01.640512 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:28:01.640512 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:28:01.640512 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:28:01.646167 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 09:28:01.646167 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 09:28:01.646167 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 09:28:01.646167 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 09:28:01.646167 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 09:28:01.646167 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 09:28:01.646167 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 09:28:01.646167 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:28:01.646167 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 618/1258] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jul 14 09:28:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 09:28:01.646741 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e43f38-e853-48d9-b402-4a3cda6e864d None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:28:01.756056 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e43f38-e853-48d9-b402-4a3cda6e864d None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:28:01.792875 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebeb0fb-94e9-48a8-8cf4-4af6f6b32dca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:28:01.793609 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebeb0fb-94e9-48a8-8cf4-4af6f6b32dca None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:28:01.793919 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebeb0fb-94e9-48a8-8cf4-4af6f6b32dca None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:28:01.794293 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebeb0fb-94e9-48a8-8cf4-4af6f6b32dca None admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:28:01.795266 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebeb0fb-94e9-48a8-8cf4-4af6f6b32dca None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:28:01.795616 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebeb0fb-94e9-48a8-8cf4-4af6f6b32dca None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:28:01.797202 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebeb0fb-94e9-48a8-8cf4-4af6f6b32dca None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:28:01.815297 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 641/1259] 10.222.0.40 () {56 vars in 1148 bytes} [Thu Jul 14 09:28:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:28:01.816560 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca596f7-2887-4782-8a12-b171fb63109c None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:28:01.845276 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:28:01.921303 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca596f7-2887-4782-8a12-b171fb63109c None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:28:01.958470 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f10d4b-f31c-42fd-ab22-ab8320af289e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:28:01.959144 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f10d4b-f31c-42fd-ab22-ab8320af289e None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:28:01.959476 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f10d4b-f31c-42fd-ab22-ab8320af289e None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:28:01.959808 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f10d4b-f31c-42fd-ab22-ab8320af289e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:28:01.960720 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f10d4b-f31c-42fd-ab22-ab8320af289e None admin] RBAC: Adding query filter params (role.id=e3965bd0d5f1427a86a313c0c90bfef3, scope.project.id=a478e76f04dd413f89ddfba7b0cdc9cc, user.id=6fc5a80144b84c609944a51a84fd5e6e) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:28:01.961040 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f10d4b-f31c-42fd-ab22-ab8320af289e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:28:01.962575 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f10d4b-f31c-42fd-ab22-ab8320af289e None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:28:01.968589 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 619/1260] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jul 14 09:28:01 2022] GET /identity/v3/role_assignments?user.id=6fc5a80144b84c609944a51a84fd5e6e&scope.project.id=a478e76f04dd413f89ddfba7b0cdc9cc&role.id=e3965bd0d5f1427a86a313c0c90bfef3 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:28:03.970798 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de615e0e-863a-4e60-b5d7-e28027740b12 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:28:03.971327 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de615e0e-863a-4e60-b5d7-e28027740b12 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:28:03.971427 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de615e0e-863a-4e60-b5d7-e28027740b12 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:28:03.972720 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 642/1261] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:28:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:28:03.977744 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2b13de-e21e-4c05-b593-aa1ecc1f4c0e None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:28:03.978135 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2b13de-e21e-4c05-b593-aa1ecc1f4c0e None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:28:03.978331 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2b13de-e21e-4c05-b593-aa1ecc1f4c0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:28:03.995946 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-2c2b13de-e21e-4c05-b593-aa1ecc1f4c0e None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:28:03.997122 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-2c2b13de-e21e-4c05-b593-aa1ecc1f4c0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:28:04.061062 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 620/1262] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:28:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 09:28:04.083143 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de615e0e-863a-4e60-b5d7-e28027740b12 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:28:04.093765 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:28:04.187257 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de615e0e-863a-4e60-b5d7-e28027740b12 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:28:04.224588 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921cca9b-f215-4dfb-8085-e9f4e5089a5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:28:04.225180 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921cca9b-f215-4dfb-8085-e9f4e5089a5d None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:28:04.225467 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921cca9b-f215-4dfb-8085-e9f4e5089a5d None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:28:04.225741 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921cca9b-f215-4dfb-8085-e9f4e5089a5d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:28:04.236351 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921cca9b-f215-4dfb-8085-e9f4e5089a5d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:28:04.244463 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-921cca9b-f215-4dfb-8085-e9f4e5089a5d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 09:28:04.244463 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:28:04.244463 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:28:04.244463 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:28:04.244463 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:28:04.244463 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:28:04.244463 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:28:04.244463 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:28:04.244463 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:28:04.244463 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:28:04.244463 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:28:04.244463 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:28:04.244463 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:28:04.244463 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:28:04.244463 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:28:04.244463 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:28:04.245572 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:28:04.245572 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:28:04.245572 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:28:04.245572 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:28:04.245572 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:28:04.245572 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:28:04.245572 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:28:04.245572 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:28:04.245572 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:28:04.245572 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:28:04.245572 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:28:04.245572 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( Jul 14 09:28:04.245572 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:28:04.245572 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:28:04.245572 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:28:04.245572 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:28:04.246623 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:28:04.246623 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:28:04.246623 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:28:04.246623 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:28:04.246623 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:28:04.246623 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:28:04.246623 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:28:04.246623 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:28:04.246623 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:28:04.246623 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:28:04.246623 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 09:28:04.246623 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Jul 14 09:28:04.246623 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 643/1263] 10.222.0.40 () {56 vars in 1096 bytes} [Thu Jul 14 09:28:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:28:04.251762 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2b13de-e21e-4c05-b593-aa1ecc1f4c0e None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:28:04.269418 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:28:04.346445 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2b13de-e21e-4c05-b593-aa1ecc1f4c0e None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:28:04.379183 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fc949f-c87b-4ed7-abd2-2dd764b41895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:28:04.379834 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fc949f-c87b-4ed7-abd2-2dd764b41895 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:28:04.380114 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fc949f-c87b-4ed7-abd2-2dd764b41895 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:28:04.380385 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fc949f-c87b-4ed7-abd2-2dd764b41895 None admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:28:04.381123 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fc949f-c87b-4ed7-abd2-2dd764b41895 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:28:04.381426 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fc949f-c87b-4ed7-abd2-2dd764b41895 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:28:04.382830 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fc949f-c87b-4ed7-abd2-2dd764b41895 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:28:04.390557 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 621/1264] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 14 09:28:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:28:04.396295 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921cca9b-f215-4dfb-8085-e9f4e5089a5d None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:28:04.460409 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:28:04.494165 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921cca9b-f215-4dfb-8085-e9f4e5089a5d None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:28:04.527165 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428ceb32-62ea-4fcb-a75e-e5898c33b1a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:28:04.527953 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428ceb32-62ea-4fcb-a75e-e5898c33b1a2 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:28:04.528234 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428ceb32-62ea-4fcb-a75e-e5898c33b1a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:28:04.528504 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428ceb32-62ea-4fcb-a75e-e5898c33b1a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:28:04.538856 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428ceb32-62ea-4fcb-a75e-e5898c33b1a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:28:04.540284 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428ceb32-62ea-4fcb-a75e-e5898c33b1a2 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:28:04.556830 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-428ceb32-62ea-4fcb-a75e-e5898c33b1a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:28:04.556830 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:28:04.556830 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:28:04.556830 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:28:04.556830 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:28:04.556830 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:28:04.556830 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:28:04.556830 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:28:04.556830 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:28:04.556830 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:28:04.556830 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:28:04.556830 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:28:04.556830 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 09:28:04.556830 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 09:28:04.556830 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 09:28:04.557876 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 09:28:04.557876 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:28:04.557876 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:28:04.557876 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:28:04.557876 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:28:04.557876 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:28:04.557876 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:28:04.557876 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:28:04.557876 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( Jul 14 09:28:04.557876 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:28:04.557876 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:28:04.557876 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:28:04.557876 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:28:04.557876 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:28:04.557876 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:28:04.557876 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:28:04.557876 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:28:04.559580 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 09:28:04.559580 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 09:28:04.559580 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:28:04.559580 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Jul 14 09:28:04.559580 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 644/1265] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 09:28:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 09:28:04.563710 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fc949f-c87b-4ed7-abd2-2dd764b41895 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:28:04.642066 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:28:04.661253 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fc949f-c87b-4ed7-abd2-2dd764b41895 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:28:04.693466 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f75f5e-8fc7-42d0-9eb5-be7363b0c950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:28:04.694123 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f75f5e-8fc7-42d0-9eb5-be7363b0c950 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:28:04.694438 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f75f5e-8fc7-42d0-9eb5-be7363b0c950 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:28:04.694716 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f75f5e-8fc7-42d0-9eb5-be7363b0c950 None admin] PATH_INFO: `/v3/domains` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:28:04.695439 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f75f5e-8fc7-42d0-9eb5-be7363b0c950 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:28:04.695749 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f75f5e-8fc7-42d0-9eb5-be7363b0c950 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:28:04.697669 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f75f5e-8fc7-42d0-9eb5-be7363b0c950 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:28:04.709829 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 622/1266] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 14 09:28:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:28:04.716403 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428ceb32-62ea-4fcb-a75e-e5898c33b1a2 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:28:04.812987 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428ceb32-62ea-4fcb-a75e-e5898c33b1a2 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:28:04.831832 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:28:04.846294 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9f168e-eb73-4d63-bb2c-6fd37847b5d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:28:04.847157 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9f168e-eb73-4d63-bb2c-6fd37847b5d4 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:28:04.847440 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9f168e-eb73-4d63-bb2c-6fd37847b5d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:28:04.847716 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9f168e-eb73-4d63-bb2c-6fd37847b5d4 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:28:04.855649 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9f168e-eb73-4d63-bb2c-6fd37847b5d4 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:28:04.857082 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9f168e-eb73-4d63-bb2c-6fd37847b5d4 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:28:04.871669 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-7e9f168e-eb73-4d63-bb2c-6fd37847b5d4 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 14 09:28:04.871669 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:28:04.871669 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:28:04.871669 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:28:04.871669 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:28:04.871669 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:28:04.871669 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:28:04.871669 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:28:04.871669 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:28:04.871669 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:28:04.871669 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:28:04.871669 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:28:04.871669 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 09:28:04.871669 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 09:28:04.871669 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 09:28:04.871669 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 09:28:04.872737 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:28:04.872737 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:28:04.872737 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 09:28:04.872737 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 09:28:04.872737 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 09:28:04.872737 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 09:28:04.872737 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:28:04.872737 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:28:04.872737 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:28:04.872737 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:28:04.872737 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:28:04.872737 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( Jul 14 09:28:04.872737 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:28:04.872737 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:28:04.872737 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:28:04.872737 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:28:04.872737 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:28:04.872737 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:28:04.873876 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:28:04.873876 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:28:04.873876 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 09:28:04.873876 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 09:28:04.873876 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 09:28:04.873876 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 09:28:04.873876 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 09:28:04.873876 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 09:28:04.873876 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 14 09:28:04.873876 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Jul 14 09:28:04.873876 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 645/1267] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 09:28:04 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:28:04.878950 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f75f5e-8fc7-42d0-9eb5-be7363b0c950 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:28:04.974775 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f75f5e-8fc7-42d0-9eb5-be7363b0c950 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:28:05.007445 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e801e7c8-3c60-47e1-abd1-7f1b4ff94faf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:28:05.008103 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e801e7c8-3c60-47e1-abd1-7f1b4ff94faf None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:28:05.008385 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e801e7c8-3c60-47e1-abd1-7f1b4ff94faf None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:28:05.008660 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e801e7c8-3c60-47e1-abd1-7f1b4ff94faf None admin] PATH_INFO: `/v3/users` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:28:05.009494 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e801e7c8-3c60-47e1-abd1-7f1b4ff94faf None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:28:05.009806 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e801e7c8-3c60-47e1-abd1-7f1b4ff94faf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:28:05.011848 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e801e7c8-3c60-47e1-abd1-7f1b4ff94faf None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:28:05.020166 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:28:05.028500 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 623/1268] 10.222.0.40 () {56 vars in 1143 bytes} [Thu Jul 14 09:28:04 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:28:05.034061 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9f168e-eb73-4d63-bb2c-6fd37847b5d4 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:28:05.129633 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9f168e-eb73-4d63-bb2c-6fd37847b5d4 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:28:05.161296 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46142d2f-3819-4799-96e8-6c5d108e9a35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:28:05.162069 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46142d2f-3819-4799-96e8-6c5d108e9a35 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:28:05.162377 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46142d2f-3819-4799-96e8-6c5d108e9a35 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:28:05.162653 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46142d2f-3819-4799-96e8-6c5d108e9a35 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:28:05.172636 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46142d2f-3819-4799-96e8-6c5d108e9a35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:28:05.174056 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46142d2f-3819-4799-96e8-6c5d108e9a35 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:28:05.191639 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-46142d2f-3819-4799-96e8-6c5d108e9a35 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:28:05.191639 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:28:05.191639 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:28:05.191639 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:28:05.191639 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:28:05.191639 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:28:05.191639 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:28:05.191639 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:28:05.191639 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:28:05.191639 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:28:05.191639 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:28:05.191639 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:28:05.191639 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 09:28:05.191639 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 09:28:05.191639 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 09:28:05.192884 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 09:28:05.192884 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:28:05.192884 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:28:05.192884 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:28:05.192884 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:28:05.192884 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:28:05.192884 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:28:05.192884 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:28:05.192884 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( Jul 14 09:28:05.192884 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:28:05.192884 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:28:05.192884 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:28:05.192884 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:28:05.192884 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:28:05.192884 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:28:05.192884 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:28:05.192884 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:28:05.193931 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 09:28:05.193931 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 09:28:05.193931 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:28:05.193931 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Jul 14 09:28:05.193931 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 646/1269] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 09:28:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:28:05.198884 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e801e7c8-3c60-47e1-abd1-7f1b4ff94faf None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:28:05.296895 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e801e7c8-3c60-47e1-abd1-7f1b4ff94faf None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:28:05.329425 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769e6290-3ea9-4559-854b-62dbc240fe17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:28:05.330083 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769e6290-3ea9-4559-854b-62dbc240fe17 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:28:05.330401 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769e6290-3ea9-4559-854b-62dbc240fe17 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:28:05.330685 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769e6290-3ea9-4559-854b-62dbc240fe17 None admin] PATH_INFO: `/v3/domains` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:28:05.331406 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769e6290-3ea9-4559-854b-62dbc240fe17 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:28:05.331713 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769e6290-3ea9-4559-854b-62dbc240fe17 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:28:05.333070 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769e6290-3ea9-4559-854b-62dbc240fe17 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:28:05.343920 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 624/1270] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 14 09:28:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:28:05.349506 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46142d2f-3819-4799-96e8-6c5d108e9a35 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:28:05.381167 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:28:05.447312 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46142d2f-3819-4799-96e8-6c5d108e9a35 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:28:05.478854 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273bcf64-90bd-4220-aad1-18fe32cebc7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:28:05.480175 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273bcf64-90bd-4220-aad1-18fe32cebc7f None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:28:05.480458 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273bcf64-90bd-4220-aad1-18fe32cebc7f None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:28:05.480734 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273bcf64-90bd-4220-aad1-18fe32cebc7f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:28:05.487341 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273bcf64-90bd-4220-aad1-18fe32cebc7f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:28:05.488766 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273bcf64-90bd-4220-aad1-18fe32cebc7f None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:28:05.503186 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-273bcf64-90bd-4220-aad1-18fe32cebc7f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 09:28:05.503186 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:28:05.503186 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:28:05.503186 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:28:05.503186 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:28:05.503186 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:28:05.503186 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:28:05.503186 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:28:05.503186 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:28:05.503186 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:28:05.503186 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:28:05.503186 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:28:05.503186 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 09:28:05.503186 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 09:28:05.503186 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 09:28:05.504212 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 09:28:05.504212 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:28:05.504212 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:28:05.504212 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:28:05.504212 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:28:05.504212 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:28:05.504212 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:28:05.504212 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:28:05.504212 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( Jul 14 09:28:05.504212 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:28:05.504212 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:28:05.504212 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:28:05.504212 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:28:05.504212 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:28:05.504212 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:28:05.504212 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:28:05.504212 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:28:05.505242 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 09:28:05.505242 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 09:28:05.505242 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 09:28:05.505242 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 09:28:05.505242 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 09:28:05.505242 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 09:28:05.505242 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 09:28:05.505242 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Jul 14 09:28:05.505242 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 647/1271] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jul 14 09:28:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:28:05.510008 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769e6290-3ea9-4559-854b-62dbc240fe17 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:28:05.568810 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:28:05.610447 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769e6290-3ea9-4559-854b-62dbc240fe17 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:28:05.642519 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e01d79-e673-43e9-bb75-f99f411c4bd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:28:05.643104 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e01d79-e673-43e9-bb75-f99f411c4bd9 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:28:05.643383 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e01d79-e673-43e9-bb75-f99f411c4bd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:28:05.643657 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e01d79-e673-43e9-bb75-f99f411c4bd9 None admin] PATH_INFO: `/v3/projects` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:28:05.644438 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e01d79-e673-43e9-bb75-f99f411c4bd9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:28:05.644744 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e01d79-e673-43e9-bb75-f99f411c4bd9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:28:05.646163 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e01d79-e673-43e9-bb75-f99f411c4bd9 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:28:05.658089 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 625/1272] 10.222.0.40 () {56 vars in 1148 bytes} [Thu Jul 14 09:28:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:28:05.664023 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273bcf64-90bd-4220-aad1-18fe32cebc7f None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:28:05.752755 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:28:05.761449 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273bcf64-90bd-4220-aad1-18fe32cebc7f None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:28:05.794875 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0f7b23-c830-43c2-a47b-af3dee56a2fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:28:05.795757 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0f7b23-c830-43c2-a47b-af3dee56a2fa None admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:28:05.796041 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0f7b23-c830-43c2-a47b-af3dee56a2fa None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:28:05.796320 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0f7b23-c830-43c2-a47b-af3dee56a2fa None admin] PATH_INFO: `/v3/projects/a478e76f04dd413f89ddfba7b0cdc9cc/users/6fc5a80144b84c609944a51a84fd5e6e/roles/e3965bd0d5f1427a86a313c0c90bfef3` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:28:05.798289 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0f7b23-c830-43c2-a47b-af3dee56a2fa None admin] RBAC: Authorizing `identity:create_grant(project_id=a478e76f04dd413f89ddfba7b0cdc9cc, user_id=6fc5a80144b84c609944a51a84fd5e6e, role_id=e3965bd0d5f1427a86a313c0c90bfef3)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:28:05.799723 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0f7b23-c830-43c2-a47b-af3dee56a2fa None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:28:05.811663 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 648/1273] 10.222.0.40 () {58 vars in 1439 bytes} [Thu Jul 14 09:28:05 2022] PUT /identity/v3/projects/a478e76f04dd413f89ddfba7b0cdc9cc/users/6fc5a80144b84c609944a51a84fd5e6e/roles/e3965bd0d5f1427a86a313c0c90bfef3 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:28:07.819961 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4fd524-8fd5-4cb9-8215-3af8820f301b None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:28:07.820458 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4fd524-8fd5-4cb9-8215-3af8820f301b None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:28:07.820458 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4fd524-8fd5-4cb9-8215-3af8820f301b None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:28:07.821798 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 626/1274] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:28:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:28:07.827517 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf38343-2428-4d03-adb1-2d572f785cc2 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:28:07.827946 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf38343-2428-4d03-adb1-2d572f785cc2 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:28:07.828078 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf38343-2428-4d03-adb1-2d572f785cc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:28:07.844961 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-cdf38343-2428-4d03-adb1-2d572f785cc2 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:28:07.846156 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-cdf38343-2428-4d03-adb1-2d572f785cc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:28:07.910703 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 649/1275] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:28:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 09:28:07.934103 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4fd524-8fd5-4cb9-8215-3af8820f301b None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:28:08.031994 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4fd524-8fd5-4cb9-8215-3af8820f301b None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:28:08.048341 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:28:08.065162 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3589521-d1d0-4452-835d-b643eaaff290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:28:08.065946 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3589521-d1d0-4452-835d-b643eaaff290 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:28:08.066266 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3589521-d1d0-4452-835d-b643eaaff290 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:28:08.066548 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3589521-d1d0-4452-835d-b643eaaff290 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:28:08.076915 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3589521-d1d0-4452-835d-b643eaaff290 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 09:28:08.084529 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-d3589521-d1d0-4452-835d-b643eaaff290 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 09:28:08.084529 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:28:08.084529 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:28:08.084529 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:28:08.084529 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:28:08.084529 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:28:08.084529 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:28:08.084529 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:28:08.084529 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:28:08.084529 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:28:08.084529 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:28:08.084529 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:28:08.084529 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 09:28:08.084529 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 09:28:08.084529 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 09:28:08.084529 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 09:28:08.085618 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 09:28:08.085618 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 09:28:08.085618 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 09:28:08.085618 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 09:28:08.085618 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:28:08.085618 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:28:08.085618 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:28:08.085618 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:28:08.085618 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:28:08.085618 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:28:08.085618 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:28:08.085618 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( Jul 14 09:28:08.085618 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:28:08.085618 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:28:08.085618 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:28:08.085618 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:28:08.086959 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:28:08.086959 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:28:08.086959 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:28:08.086959 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:28:08.086959 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 09:28:08.086959 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 09:28:08.086959 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 09:28:08.086959 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 09:28:08.086959 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 09:28:08.086959 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 09:28:08.086959 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 09:28:08.086959 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:28:08.086959 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 627/1276] 10.222.0.40 () {56 vars in 1096 bytes} [Thu Jul 14 09:28:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:28:08.091497 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf38343-2428-4d03-adb1-2d572f785cc2 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:28:08.168935 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:28:08.189978 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf38343-2428-4d03-adb1-2d572f785cc2 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:28:08.230247 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2758da-2ea7-47e5-8d92-4d945c290b9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:28:08.230973 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2758da-2ea7-47e5-8d92-4d945c290b9e None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:28:08.231291 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2758da-2ea7-47e5-8d92-4d945c290b9e None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:28:08.231627 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2758da-2ea7-47e5-8d92-4d945c290b9e None admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:28:08.232476 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2758da-2ea7-47e5-8d92-4d945c290b9e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:28:08.232809 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2758da-2ea7-47e5-8d92-4d945c290b9e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:28:08.234473 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2758da-2ea7-47e5-8d92-4d945c290b9e None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:28:08.243978 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 650/1277] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 14 09:28:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:28:08.250477 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3589521-d1d0-4452-835d-b643eaaff290 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:28:08.348919 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3589521-d1d0-4452-835d-b643eaaff290 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:28:08.381761 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5e464a-8a07-4e07-9386-24313791bf7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:28:08.382579 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5e464a-8a07-4e07-9386-24313791bf7a None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:28:08.382867 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5e464a-8a07-4e07-9386-24313791bf7a None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:28:08.383147 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5e464a-8a07-4e07-9386-24313791bf7a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:28:08.393304 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5e464a-8a07-4e07-9386-24313791bf7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:28:08.394782 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5e464a-8a07-4e07-9386-24313791bf7a None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:28:08.411360 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-6d5e464a-8a07-4e07-9386-24313791bf7a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:28:08.411360 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:28:08.411360 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:28:08.411360 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:28:08.411360 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:28:08.411360 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:28:08.411360 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:28:08.411360 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:28:08.411360 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:28:08.411360 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:28:08.411360 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:28:08.411360 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:28:08.411360 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 09:28:08.411360 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 09:28:08.411360 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 09:28:08.412372 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 09:28:08.412372 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:28:08.412372 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:28:08.412372 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:28:08.412372 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:28:08.412372 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:28:08.412372 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:28:08.412372 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:28:08.412372 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( Jul 14 09:28:08.412372 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:28:08.412372 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:28:08.412372 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:28:08.412372 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:28:08.412372 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:28:08.412372 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:28:08.412372 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:28:08.412372 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:28:08.413471 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 09:28:08.413471 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 09:28:08.413471 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:28:08.413471 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:28:08.413471 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 628/1278] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 09:28:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:28:08.418858 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2758da-2ea7-47e5-8d92-4d945c290b9e None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:28:08.515380 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2758da-2ea7-47e5-8d92-4d945c290b9e None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:28:08.547653 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945f161c-7f0f-448e-be64-e5c308fdd914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:28:08.548315 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945f161c-7f0f-448e-be64-e5c308fdd914 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:28:08.548602 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945f161c-7f0f-448e-be64-e5c308fdd914 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:28:08.548881 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945f161c-7f0f-448e-be64-e5c308fdd914 None admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:28:08.549603 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945f161c-7f0f-448e-be64-e5c308fdd914 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:28:08.549908 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945f161c-7f0f-448e-be64-e5c308fdd914 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:28:08.551310 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945f161c-7f0f-448e-be64-e5c308fdd914 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:28:08.563173 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 651/1279] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 14 09:28:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:28:08.568730 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5e464a-8a07-4e07-9386-24313791bf7a None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:28:08.598508 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:28:08.667959 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5e464a-8a07-4e07-9386-24313791bf7a None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:28:08.700436 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf8286d-aaaf-4bf8-bb95-ad6bf5ff1959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:28:08.701542 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf8286d-aaaf-4bf8-bb95-ad6bf5ff1959 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:28:08.701832 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf8286d-aaaf-4bf8-bb95-ad6bf5ff1959 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:28:08.702117 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf8286d-aaaf-4bf8-bb95-ad6bf5ff1959 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:28:08.710593 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf8286d-aaaf-4bf8-bb95-ad6bf5ff1959 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:28:08.712041 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf8286d-aaaf-4bf8-bb95-ad6bf5ff1959 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:28:08.726827 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-5bf8286d-aaaf-4bf8-bb95-ad6bf5ff1959 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 14 09:28:08.726827 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:28:08.726827 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:28:08.726827 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:28:08.726827 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:28:08.726827 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:28:08.726827 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:28:08.726827 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:28:08.726827 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:28:08.726827 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:28:08.726827 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:28:08.726827 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:28:08.726827 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 09:28:08.726827 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 09:28:08.726827 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 09:28:08.726827 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 09:28:08.727947 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:28:08.727947 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:28:08.727947 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 09:28:08.727947 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 09:28:08.727947 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 09:28:08.727947 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 09:28:08.727947 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:28:08.727947 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:28:08.727947 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:28:08.727947 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:28:08.727947 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:28:08.727947 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( Jul 14 09:28:08.727947 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:28:08.727947 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:28:08.727947 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:28:08.727947 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:28:08.727947 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:28:08.727947 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:28:08.729891 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:28:08.729891 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:28:08.729891 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 09:28:08.729891 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 09:28:08.729891 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 09:28:08.729891 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 09:28:08.729891 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 09:28:08.729891 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 09:28:08.729891 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 14 09:28:08.729891 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:28:08.729891 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 629/1280] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 09:28:08 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:28:08.734343 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945f161c-7f0f-448e-be64-e5c308fdd914 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:28:08.738367 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:28:08.830468 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945f161c-7f0f-448e-be64-e5c308fdd914 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:28:08.863801 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdb29c4-3bf6-4545-bb9a-18ea18f1d25d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:28:08.864464 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdb29c4-3bf6-4545-bb9a-18ea18f1d25d None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:28:08.864751 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdb29c4-3bf6-4545-bb9a-18ea18f1d25d None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:28:08.865030 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdb29c4-3bf6-4545-bb9a-18ea18f1d25d None admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:28:08.865858 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdb29c4-3bf6-4545-bb9a-18ea18f1d25d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:28:08.866167 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdb29c4-3bf6-4545-bb9a-18ea18f1d25d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:28:08.867604 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdb29c4-3bf6-4545-bb9a-18ea18f1d25d None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:28:08.883780 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 652/1281] 10.222.0.40 () {56 vars in 1143 bytes} [Thu Jul 14 09:28:08 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:28:08.889541 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf8286d-aaaf-4bf8-bb95-ad6bf5ff1959 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:28:08.977197 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:28:08.987693 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf8286d-aaaf-4bf8-bb95-ad6bf5ff1959 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:28:09.019501 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d07f03-6b1f-4eb1-9dee-3dc81d26c7db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:28:09.020140 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d07f03-6b1f-4eb1-9dee-3dc81d26c7db None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:28:09.020421 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d07f03-6b1f-4eb1-9dee-3dc81d26c7db None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:28:09.020697 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d07f03-6b1f-4eb1-9dee-3dc81d26c7db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:28:09.086724 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d07f03-6b1f-4eb1-9dee-3dc81d26c7db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:28:09.088166 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d07f03-6b1f-4eb1-9dee-3dc81d26c7db None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:28:09.171755 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:28:09.183040 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 630/1282] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 14 09:28:08 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 09:28:09.188824 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdb29c4-3bf6-4545-bb9a-18ea18f1d25d None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:28:09.252988 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:28:09.290823 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdb29c4-3bf6-4545-bb9a-18ea18f1d25d None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:28:09.323402 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693037db-bb72-4cc8-9827-11e2a16324d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:28:09.324191 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693037db-bb72-4cc8-9827-11e2a16324d1 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:28:09.324481 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693037db-bb72-4cc8-9827-11e2a16324d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:28:09.324767 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693037db-bb72-4cc8-9827-11e2a16324d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:28:09.334494 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693037db-bb72-4cc8-9827-11e2a16324d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:28:09.335934 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693037db-bb72-4cc8-9827-11e2a16324d1 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:28:09.353496 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-693037db-bb72-4cc8-9827-11e2a16324d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:28:09.353496 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:28:09.353496 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:28:09.353496 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:28:09.353496 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:28:09.353496 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:28:09.353496 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:28:09.353496 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:28:09.353496 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:28:09.353496 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:28:09.353496 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:28:09.353496 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:28:09.353496 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 09:28:09.353496 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 09:28:09.353496 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 09:28:09.354704 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 09:28:09.354704 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:28:09.354704 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:28:09.354704 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:28:09.354704 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:28:09.354704 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:28:09.354704 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:28:09.354704 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:28:09.354704 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( Jul 14 09:28:09.354704 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:28:09.354704 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:28:09.354704 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:28:09.354704 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:28:09.354704 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:28:09.354704 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:28:09.354704 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:28:09.354704 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:28:09.355981 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 09:28:09.355981 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 09:28:09.355981 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 09:28:09.355981 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Jul 14 09:28:09.355981 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 653/1283] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 09:28:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:28:09.360459 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d07f03-6b1f-4eb1-9dee-3dc81d26c7db None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:28:09.456814 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d07f03-6b1f-4eb1-9dee-3dc81d26c7db None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:28:09.489153 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7178ccc0-576d-4980-832b-f4170c5b5794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:28:09.489804 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7178ccc0-576d-4980-832b-f4170c5b5794 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:28:09.490087 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7178ccc0-576d-4980-832b-f4170c5b5794 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:28:09.490396 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7178ccc0-576d-4980-832b-f4170c5b5794 None admin] PATH_INFO: `/v3/domains` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:28:09.491116 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7178ccc0-576d-4980-832b-f4170c5b5794 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:28:09.491423 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7178ccc0-576d-4980-832b-f4170c5b5794 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:28:09.492771 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7178ccc0-576d-4980-832b-f4170c5b5794 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:28:09.504162 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 631/1284] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 14 09:28:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:28:09.509564 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693037db-bb72-4cc8-9827-11e2a16324d1 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:28:09.605875 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693037db-bb72-4cc8-9827-11e2a16324d1 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:28:09.619432 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:28:09.640240 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4b12b5-bfad-43ae-beb1-b29a1f8278e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:28:09.641026 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4b12b5-bfad-43ae-beb1-b29a1f8278e7 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:28:09.641310 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4b12b5-bfad-43ae-beb1-b29a1f8278e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:28:09.641586 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4b12b5-bfad-43ae-beb1-b29a1f8278e7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:28:09.647973 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4b12b5-bfad-43ae-beb1-b29a1f8278e7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:28:09.649446 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4b12b5-bfad-43ae-beb1-b29a1f8278e7 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:28:09.662810 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-0c4b12b5-bfad-43ae-beb1-b29a1f8278e7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 09:28:09.662810 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:28:09.662810 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:28:09.662810 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:28:09.662810 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:28:09.662810 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:28:09.662810 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:28:09.662810 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:28:09.662810 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:28:09.662810 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:28:09.662810 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:28:09.662810 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:28:09.662810 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 09:28:09.662810 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 09:28:09.662810 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 09:28:09.663919 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 09:28:09.663919 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:28:09.663919 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:28:09.663919 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:28:09.663919 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:28:09.663919 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:28:09.663919 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:28:09.663919 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:28:09.663919 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( Jul 14 09:28:09.663919 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:28:09.663919 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:28:09.663919 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:28:09.663919 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:28:09.663919 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:28:09.663919 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:28:09.663919 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:28:09.663919 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:28:09.665057 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 09:28:09.665057 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 09:28:09.665057 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 09:28:09.665057 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 09:28:09.665057 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 09:28:09.665057 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 09:28:09.665057 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 09:28:09.665057 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Jul 14 09:28:09.665057 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 654/1285] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jul 14 09:28:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:28:09.669714 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7178ccc0-576d-4980-832b-f4170c5b5794 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:28:09.718100 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:28:09.769156 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7178ccc0-576d-4980-832b-f4170c5b5794 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:28:09.801046 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e122b451-2d95-499e-bf26-60611bd720b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:28:09.801693 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e122b451-2d95-499e-bf26-60611bd720b1 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:28:09.801979 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e122b451-2d95-499e-bf26-60611bd720b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:28:09.802285 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e122b451-2d95-499e-bf26-60611bd720b1 None admin] PATH_INFO: `/v3/projects` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:28:09.803070 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e122b451-2d95-499e-bf26-60611bd720b1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:28:09.803380 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e122b451-2d95-499e-bf26-60611bd720b1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:28:09.804785 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e122b451-2d95-499e-bf26-60611bd720b1 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:28:09.817572 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 632/1286] 10.222.0.40 () {56 vars in 1148 bytes} [Thu Jul 14 09:28:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:28:09.823598 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4b12b5-bfad-43ae-beb1-b29a1f8278e7 None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:28:09.920430 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4b12b5-bfad-43ae-beb1-b29a1f8278e7 None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:28:09.952653 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1977fb8-996f-4bc0-828a-b8cc813fe697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:28:09.953291 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1977fb8-996f-4bc0-828a-b8cc813fe697 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:28:09.953573 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1977fb8-996f-4bc0-828a-b8cc813fe697 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:28:09.953846 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1977fb8-996f-4bc0-828a-b8cc813fe697 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:28:09.954693 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1977fb8-996f-4bc0-828a-b8cc813fe697 None admin] RBAC: Adding query filter params (role.id=e3965bd0d5f1427a86a313c0c90bfef3, scope.project.id=a478e76f04dd413f89ddfba7b0cdc9cc, user.id=6fc5a80144b84c609944a51a84fd5e6e) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:28:09.955001 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1977fb8-996f-4bc0-828a-b8cc813fe697 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:28:09.956489 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1977fb8-996f-4bc0-828a-b8cc813fe697 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:28:09.962098 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 655/1287] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jul 14 09:28:09 2022] GET /identity/v3/role_assignments?user.id=6fc5a80144b84c609944a51a84fd5e6e&scope.project.id=a478e76f04dd413f89ddfba7b0cdc9cc&role.id=e3965bd0d5f1427a86a313c0c90bfef3 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:28:11.992687 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbb6b62-525c-4dc1-8848-2595e082b73a None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:28:11.993246 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbb6b62-525c-4dc1-8848-2595e082b73a None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:28:11.993246 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbb6b62-525c-4dc1-8848-2595e082b73a None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:28:11.995120 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 633/1288] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:28:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:28:12.000228 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1fe3f8-a9f6-4d7e-b910-a0501a14d492 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:28:12.000631 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1fe3f8-a9f6-4d7e-b910-a0501a14d492 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:28:12.000779 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1fe3f8-a9f6-4d7e-b910-a0501a14d492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:28:12.017608 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-5f1fe3f8-a9f6-4d7e-b910-a0501a14d492 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:28:12.018814 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-5f1fe3f8-a9f6-4d7e-b910-a0501a14d492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:28:12.047390 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:28:12.083380 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 656/1289] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:28:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 09:28:12.105481 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbb6b62-525c-4dc1-8848-2595e082b73a None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:28:12.206009 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbb6b62-525c-4dc1-8848-2595e082b73a None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:28:12.217338 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:28:12.243392 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a8a1f9-2735-4cd9-a4ce-67baf06d8fec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:28:12.244199 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a8a1f9-2735-4cd9-a4ce-67baf06d8fec None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:28:12.244498 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a8a1f9-2735-4cd9-a4ce-67baf06d8fec None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:28:12.245421 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a8a1f9-2735-4cd9-a4ce-67baf06d8fec None admin] PATH_INFO: `/v3/services/placement` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:28:12.246086 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a8a1f9-2735-4cd9-a4ce-67baf06d8fec None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:28:12.247621 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a8a1f9-2735-4cd9-a4ce-67baf06d8fec None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:28:12.260123 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-13a8a1f9-2735-4cd9-a4ce-67baf06d8fec None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 14 09:28:12.260123 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:28:12.260123 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 09:28:12.260123 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 09:28:12.260123 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 09:28:12.260123 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 09:28:12.260123 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 09:28:12.260123 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 09:28:12.260123 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 14 09:28:12.260123 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:28:12.260123 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 09:28:12.260123 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:28:12.260123 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:28:12.260123 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:28:12.260123 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:28:12.260123 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:28:12.260123 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:28:12.261393 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:28:12.261393 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:28:12.261393 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:28:12.261393 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:28:12.261393 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:28:12.261393 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:28:12.261393 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 09:28:12.261393 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 09:28:12.261393 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 09:28:12.261393 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 09:28:12.261393 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:28:12.261393 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:28:12.261393 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:28:12.261393 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:28:12.261393 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:28:12.261393 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:28:12.262475 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:28:12.262475 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( Jul 14 09:28:12.262475 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:28:12.262475 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:28:12.262475 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:28:12.262475 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:28:12.262475 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:28:12.262475 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:28:12.262475 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:28:12.262475 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:28:12.262475 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 09:28:12.262475 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 09:28:12.262475 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 14 09:28:12.262475 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:28:12.262475 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 634/1290] 10.222.0.40 () {56 vars in 1117 bytes} [Thu Jul 14 09:28:12 2022] GET /identity/v3/services/placement => generated 90 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 09:28:12.267535 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1fe3f8-a9f6-4d7e-b910-a0501a14d492 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:28:12.363529 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1fe3f8-a9f6-4d7e-b910-a0501a14d492 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:28:12.395864 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf1ee94-33e7-4962-8a03-7bef8a2dad65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:28:12.396520 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf1ee94-33e7-4962-8a03-7bef8a2dad65 None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:28:12.396803 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf1ee94-33e7-4962-8a03-7bef8a2dad65 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:28:12.397079 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf1ee94-33e7-4962-8a03-7bef8a2dad65 None admin] PATH_INFO: `/v3/services` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:28:12.397784 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf1ee94-33e7-4962-8a03-7bef8a2dad65 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:28:12.398088 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf1ee94-33e7-4962-8a03-7bef8a2dad65 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:28:12.399475 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf1ee94-33e7-4962-8a03-7bef8a2dad65 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:28:12.404722 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 657/1291] 10.222.0.40 () {56 vars in 1116 bytes} [Thu Jul 14 09:28:12 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:28:12.410525 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a8a1f9-2735-4cd9-a4ce-67baf06d8fec None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:28:12.506110 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a8a1f9-2735-4cd9-a4ce-67baf06d8fec None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:28:12.538500 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05d02b2-22f3-48df-894d-4d6c1750e48a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:28:12.539149 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05d02b2-22f3-48df-894d-4d6c1750e48a None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:28:12.539427 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05d02b2-22f3-48df-894d-4d6c1750e48a None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:28:12.539700 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05d02b2-22f3-48df-894d-4d6c1750e48a None admin] PATH_INFO: `/v3/services` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:28:12.540399 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05d02b2-22f3-48df-894d-4d6c1750e48a None admin] RBAC: Adding query filter params (type=placement) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:28:12.540700 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05d02b2-22f3-48df-894d-4d6c1750e48a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:28:12.542710 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05d02b2-22f3-48df-894d-4d6c1750e48a None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:28:12.547103 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 635/1292] 10.222.0.40 () {56 vars in 1116 bytes} [Thu Jul 14 09:28:12 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:28:14.528985 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ccd569-62fe-4934-8ede-fa60c1dcc828 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:28:14.529538 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ccd569-62fe-4934-8ede-fa60c1dcc828 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:28:14.529538 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ccd569-62fe-4934-8ede-fa60c1dcc828 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:28:14.530924 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 658/1293] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:28:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:28:14.535952 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8c9d9c-734a-42d5-97d3-4edb5bcee8fd None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:28:14.536318 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8c9d9c-734a-42d5-97d3-4edb5bcee8fd None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:28:14.536517 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8c9d9c-734a-42d5-97d3-4edb5bcee8fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:28:14.553602 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-0c8c9d9c-734a-42d5-97d3-4edb5bcee8fd None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:28:14.554831 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-0c8c9d9c-734a-42d5-97d3-4edb5bcee8fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:28:14.583357 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:28:14.620807 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 636/1294] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:28:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 09:28:14.643120 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ccd569-62fe-4934-8ede-fa60c1dcc828 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:28:14.673927 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:28:14.742427 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ccd569-62fe-4934-8ede-fa60c1dcc828 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:28:14.777402 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fbd3d8-c44d-4bee-a8b9-034989a85274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:28:14.778117 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fbd3d8-c44d-4bee-a8b9-034989a85274 None admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:28:14.778425 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fbd3d8-c44d-4bee-a8b9-034989a85274 None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:28:14.778704 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fbd3d8-c44d-4bee-a8b9-034989a85274 None admin] PATH_INFO: `/v3/services` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:28:14.779477 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fbd3d8-c44d-4bee-a8b9-034989a85274 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:28:14.780788 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fbd3d8-c44d-4bee-a8b9-034989a85274 None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:28:14.794114 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 659/1295] 10.222.0.40 () {60 vars in 1141 bytes} [Thu Jul 14 09:28:14 2022] POST /identity/v3/services => generated 246 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:28:16.779336 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474a8e75-8fb5-4a0e-a5cb-179d1ba3c4fd None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:28:16.779857 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474a8e75-8fb5-4a0e-a5cb-179d1ba3c4fd None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:28:16.779975 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474a8e75-8fb5-4a0e-a5cb-179d1ba3c4fd None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:28:16.781252 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 637/1296] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:28:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:28:16.786298 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec12537-8f61-4c57-839d-a5777a4c9526 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:28:16.786716 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec12537-8f61-4c57-839d-a5777a4c9526 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:28:16.786859 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec12537-8f61-4c57-839d-a5777a4c9526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:28:16.803935 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-6ec12537-8f61-4c57-839d-a5777a4c9526 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:28:16.805134 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-6ec12537-8f61-4c57-839d-a5777a4c9526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:28:16.876343 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 660/1297] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:28:16 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 09:28:16.898748 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474a8e75-8fb5-4a0e-a5cb-179d1ba3c4fd None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:28:17.001848 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474a8e75-8fb5-4a0e-a5cb-179d1ba3c4fd None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:28:17.034873 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3818d1-d6a3-4242-b8a2-c58841cb6d88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:28:17.035662 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3818d1-d6a3-4242-b8a2-c58841cb6d88 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:28:17.035946 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3818d1-d6a3-4242-b8a2-c58841cb6d88 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:28:17.036223 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3818d1-d6a3-4242-b8a2-c58841cb6d88 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:28:17.036877 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3818d1-d6a3-4242-b8a2-c58841cb6d88 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:28:17.038283 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3818d1-d6a3-4242-b8a2-c58841cb6d88 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:28:17.050590 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-ae3818d1-d6a3-4242-b8a2-c58841cb6d88 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 14 09:28:17.050590 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:28:17.050590 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 09:28:17.050590 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 09:28:17.050590 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 09:28:17.050590 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 09:28:17.050590 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 09:28:17.050590 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 09:28:17.050590 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 14 09:28:17.050590 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:28:17.050590 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 09:28:17.050590 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:28:17.050590 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:28:17.050590 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:28:17.050590 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:28:17.050590 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:28:17.050590 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:28:17.051551 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:28:17.051551 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:28:17.051551 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:28:17.051551 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:28:17.051551 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:28:17.051551 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:28:17.051551 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 09:28:17.051551 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 09:28:17.051551 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 09:28:17.051551 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 09:28:17.051551 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:28:17.051551 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:28:17.051551 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:28:17.051551 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:28:17.051551 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:28:17.051551 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:28:17.052493 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:28:17.052493 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( Jul 14 09:28:17.052493 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:28:17.052493 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:28:17.052493 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:28:17.052493 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:28:17.052493 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:28:17.052493 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:28:17.052493 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:28:17.052493 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:28:17.052493 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 09:28:17.052493 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 09:28:17.052493 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 14 09:28:17.052493 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:28:17.052493 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 638/1298] 10.222.0.40 () {56 vars in 1117 bytes} [Thu Jul 14 09:28:16 2022] GET /identity/v3/services/placement => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:28:17.057948 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec12537-8f61-4c57-839d-a5777a4c9526 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:28:17.076285 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:28:17.154229 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec12537-8f61-4c57-839d-a5777a4c9526 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:28:17.187817 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68768d1e-cc7e-4d1a-a642-69a3c62a90ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:28:17.188527 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68768d1e-cc7e-4d1a-a642-69a3c62a90ba None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:28:17.188881 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68768d1e-cc7e-4d1a-a642-69a3c62a90ba None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:28:17.189190 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68768d1e-cc7e-4d1a-a642-69a3c62a90ba None admin] PATH_INFO: `/v3/services` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:28:17.189963 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68768d1e-cc7e-4d1a-a642-69a3c62a90ba None admin] RBAC: Adding query filter params (name=placement) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:28:17.190315 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68768d1e-cc7e-4d1a-a642-69a3c62a90ba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:28:17.191779 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68768d1e-cc7e-4d1a-a642-69a3c62a90ba None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:28:17.197435 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 661/1299] 10.222.0.40 () {56 vars in 1116 bytes} [Thu Jul 14 09:28:17 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:28:17.203610 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3818d1-d6a3-4242-b8a2-c58841cb6d88 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:28:17.239818 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:28:17.308886 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3818d1-d6a3-4242-b8a2-c58841cb6d88 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:28:17.341695 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d25b7f8-6bdd-4ad8-a39f-47b1c2f5ea8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:28:17.342376 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d25b7f8-6bdd-4ad8-a39f-47b1c2f5ea8a None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:28:17.342663 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d25b7f8-6bdd-4ad8-a39f-47b1c2f5ea8a None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:28:17.342941 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d25b7f8-6bdd-4ad8-a39f-47b1c2f5ea8a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:28:17.343730 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d25b7f8-6bdd-4ad8-a39f-47b1c2f5ea8a None admin] RBAC: Adding query filter params (interface=public, service_id=d452377266214a7192f042d255a0d2f1, region_id=RegionOne) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:28:17.344046 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d25b7f8-6bdd-4ad8-a39f-47b1c2f5ea8a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:28:17.345407 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d25b7f8-6bdd-4ad8-a39f-47b1c2f5ea8a None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:28:17.350321 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 639/1300] 10.222.0.40 () {56 vars in 1251 bytes} [Thu Jul 14 09:28:17 2022] GET /identity/v3/endpoints?service_id=d452377266214a7192f042d255a0d2f1&interface=public®ion_id=RegionOne => generated 194 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:28:17.355917 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68768d1e-cc7e-4d1a-a642-69a3c62a90ba None admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:28:17.434857 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:28:17.452816 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68768d1e-cc7e-4d1a-a642-69a3c62a90ba None admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:28:17.485298 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fa0d49-ed63-46d8-ad5f-a64d7dc0cc5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:28:17.485952 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fa0d49-ed63-46d8-ad5f-a64d7dc0cc5a None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:28:17.486516 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fa0d49-ed63-46d8-ad5f-a64d7dc0cc5a None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:28:17.486797 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fa0d49-ed63-46d8-ad5f-a64d7dc0cc5a None admin] PATH_INFO: `/v3/services` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:28:17.487479 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fa0d49-ed63-46d8-ad5f-a64d7dc0cc5a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:28:17.488831 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fa0d49-ed63-46d8-ad5f-a64d7dc0cc5a None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:28:17.495446 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 662/1301] 10.222.0.40 () {56 vars in 1087 bytes} [Thu Jul 14 09:28:17 2022] GET /identity/v3/services => generated 2191 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:28:19.525061 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b195f16-7bee-4897-afaa-762a56a85b7a None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:28:19.525594 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b195f16-7bee-4897-afaa-762a56a85b7a None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:28:19.525686 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b195f16-7bee-4897-afaa-762a56a85b7a None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:28:19.527751 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 640/1302] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:28:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:28:19.532885 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3d5eef-3159-4793-b42c-5f6bf2936449 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:28:19.533384 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3d5eef-3159-4793-b42c-5f6bf2936449 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:28:19.533475 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3d5eef-3159-4793-b42c-5f6bf2936449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:28:19.549591 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-ca3d5eef-3159-4793-b42c-5f6bf2936449 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:28:19.550781 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-ca3d5eef-3159-4793-b42c-5f6bf2936449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:28:19.614347 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 663/1303] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:28:19 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 09:28:19.637819 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b195f16-7bee-4897-afaa-762a56a85b7a None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:28:19.732240 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:28:19.739242 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b195f16-7bee-4897-afaa-762a56a85b7a None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:28:19.771342 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ea02d6-f5b6-4e74-9fff-5c822d4c4388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:28:19.772133 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ea02d6-f5b6-4e74-9fff-5c822d4c4388 None admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:28:19.772416 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ea02d6-f5b6-4e74-9fff-5c822d4c4388 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:28:19.772688 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ea02d6-f5b6-4e74-9fff-5c822d4c4388 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:28:19.773335 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ea02d6-f5b6-4e74-9fff-5c822d4c4388 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:28:19.774729 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ea02d6-f5b6-4e74-9fff-5c822d4c4388 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:28:19.786443 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application [None req-d5ea02d6-f5b6-4e74-9fff-5c822d4c4388 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 14 09:28:19.786443 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:28:19.786443 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 09:28:19.786443 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 09:28:19.786443 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 09:28:19.786443 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 09:28:19.786443 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 09:28:19.786443 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 09:28:19.786443 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 14 09:28:19.786443 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:28:19.786443 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 09:28:19.786443 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:28:19.786443 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 09:28:19.786443 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 09:28:19.786443 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 09:28:19.786443 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 09:28:19.786443 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 09:28:19.787600 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 09:28:19.787600 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 09:28:19.787600 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 09:28:19.787600 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 09:28:19.787600 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 09:28:19.787600 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 09:28:19.787600 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 09:28:19.787600 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 09:28:19.787600 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 09:28:19.787600 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 09:28:19.787600 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 09:28:19.787600 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 09:28:19.787600 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 09:28:19.787600 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 09:28:19.787600 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 09:28:19.787600 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 09:28:19.788584 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 09:28:19.788584 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application with Lock( Jul 14 09:28:19.788584 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 09:28:19.788584 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self._enter() Jul 14 09:28:19.788584 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 09:28:19.788584 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 09:28:19.788584 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 09:28:19.788584 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application return self.creator() Jul 14 09:28:19.788584 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 09:28:19.788584 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application created_value = creator( Jul 14 09:28:19.788584 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 09:28:19.788584 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 09:28:19.788584 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 14 09:28:19.788584 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: ERROR keystone.server.flask.application Jul 14 09:28:19.788584 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 641/1304] 10.222.0.40 () {56 vars in 1117 bytes} [Thu Jul 14 09:28:19 2022] GET /identity/v3/services/placement => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 09:28:19.794086 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3d5eef-3159-4793-b42c-5f6bf2936449 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:28:19.866913 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:28:19.889910 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3d5eef-3159-4793-b42c-5f6bf2936449 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:28:19.922836 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a828d3-98e1-4505-8e13-fd5ca7c2710d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:28:19.923493 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a828d3-98e1-4505-8e13-fd5ca7c2710d None admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:28:19.923777 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a828d3-98e1-4505-8e13-fd5ca7c2710d None admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:28:19.924055 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a828d3-98e1-4505-8e13-fd5ca7c2710d None admin] PATH_INFO: `/v3/services` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:28:19.924760 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a828d3-98e1-4505-8e13-fd5ca7c2710d None admin] RBAC: Adding query filter params (name=placement) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:28:19.925066 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a828d3-98e1-4505-8e13-fd5ca7c2710d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:28:19.926451 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a828d3-98e1-4505-8e13-fd5ca7c2710d None admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:28:19.931420 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 664/1305] 10.222.0.40 () {56 vars in 1116 bytes} [Thu Jul 14 09:28:19 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:28:19.936986 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ea02d6-f5b6-4e74-9fff-5c822d4c4388 None admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:28:20.033949 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ea02d6-f5b6-4e74-9fff-5c822d4c4388 None admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:28:20.066230 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930b85fd-85c7-433b-b63e-8d9ab4adcc29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:28:20.066820 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930b85fd-85c7-433b-b63e-8d9ab4adcc29 None admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:28:20.067107 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930b85fd-85c7-433b-b63e-8d9ab4adcc29 None admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:28:20.067385 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930b85fd-85c7-433b-b63e-8d9ab4adcc29 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:28:20.068132 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930b85fd-85c7-433b-b63e-8d9ab4adcc29 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:28:20.069487 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930b85fd-85c7-433b-b63e-8d9ab4adcc29 None admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:28:20.086603 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 642/1306] 10.222.0.40 () {60 vars in 1144 bytes} [Thu Jul 14 09:28:19 2022] POST /identity/v3/endpoints => generated 331 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 09:28:29.928449 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=30 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:28:30.082458 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:29:22.787445 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f92a2f-bf0a-4ffa-9d6f-b306cee17dd7 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:29:22.787985 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f92a2f-bf0a-4ffa-9d6f-b306cee17dd7 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:29:22.787985 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f92a2f-bf0a-4ffa-9d6f-b306cee17dd7 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:29:22.789271 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 665/1307] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:29:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:29:22.794556 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4867d4-7262-4fc5-bbba-051cd16dc034 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:29:22.795077 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4867d4-7262-4fc5-bbba-051cd16dc034 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:29:22.795199 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4867d4-7262-4fc5-bbba-051cd16dc034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:29:22.957094 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-7d4867d4-7262-4fc5-bbba-051cd16dc034 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:29:22.958411 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-7d4867d4-7262-4fc5-bbba-051cd16dc034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:29:23.126769 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 643/1308] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:29:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:29:23.178470 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d41a49-728e-45b4-9a4d-96a627ccaaa4 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:29:23.178768 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d41a49-728e-45b4-9a4d-96a627ccaaa4 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:29:23.179055 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d41a49-728e-45b4-9a4d-96a627ccaaa4 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:29:23.180695 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 666/1309] 10.222.0.40 () {54 vars in 964 bytes} [Thu Jul 14 09:29:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:29:23.188580 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40d6841-b9e6-4ea6-b57b-d0b0585002f1 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:29:23.188883 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40d6841-b9e6-4ea6-b57b-d0b0585002f1 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:29:23.189171 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40d6841-b9e6-4ea6-b57b-d0b0585002f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:29:23.329341 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-e40d6841-b9e6-4ea6-b57b-d0b0585002f1 None None] MFA Rules not processed for user `65e4a5a8965e4802a9055d332179b7a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:29:23.330588 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-e40d6841-b9e6-4ea6-b57b-d0b0585002f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:29:23.352148 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:29:23.443627 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 644/1310] 10.222.0.40 () {58 vars in 1061 bytes} [Thu Jul 14 09:29:23 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:29:23.452976 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d41a49-728e-45b4-9a4d-96a627ccaaa4 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:29:23.455091 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-17d41a49-728e-45b4-9a4d-96a627ccaaa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:29:23.600581 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d41a49-728e-45b4-9a4d-96a627ccaaa4 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:29:23.699362 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2868bce5-c015-4926-95a4-362bf5440da9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e4a5a8965e4802a9055d332179b7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:29:23.700039 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2868bce5-c015-4926-95a4-362bf5440da9 service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:29:23.700324 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2868bce5-c015-4926-95a4-362bf5440da9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:29:23.700602 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2868bce5-c015-4926-95a4-362bf5440da9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:29:23.702872 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-2868bce5-c015-4926-95a4-362bf5440da9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:29:23.765988 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:29:23.842799 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2868bce5-c015-4926-95a4-362bf5440da9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:29:23.845238 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2868bce5-c015-4926-95a4-362bf5440da9 service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:29:23.875744 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 667/1311] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:29:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:29:26.413931 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05978f9c-f067-4579-85ea-3eef6ef85d8b None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:29:26.414432 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05978f9c-f067-4579-85ea-3eef6ef85d8b None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:29:26.414527 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05978f9c-f067-4579-85ea-3eef6ef85d8b None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:29:26.415879 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 645/1312] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:29:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:29:26.421139 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefa8c16-796d-42e6-9cdb-8f5d837373b5 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:29:26.421527 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefa8c16-796d-42e6-9cdb-8f5d837373b5 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:29:26.421699 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefa8c16-796d-42e6-9cdb-8f5d837373b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:29:26.500059 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-fefa8c16-796d-42e6-9cdb-8f5d837373b5 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:29:26.501269 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-fefa8c16-796d-42e6-9cdb-8f5d837373b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:29:26.598438 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 668/1313] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:29:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:29:26.636936 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05978f9c-f067-4579-85ea-3eef6ef85d8b None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:29:26.638534 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-05978f9c-f067-4579-85ea-3eef6ef85d8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:29:26.750428 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05978f9c-f067-4579-85ea-3eef6ef85d8b None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:29:26.820281 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:29:26.822989 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5171499-577e-4477-8e7b-ec1fae774dcc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e4a5a8965e4802a9055d332179b7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:29:26.823863 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5171499-577e-4477-8e7b-ec1fae774dcc service neutron] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:29:26.824174 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5171499-577e-4477-8e7b-ec1fae774dcc service neutron] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:29:26.824638 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5171499-577e-4477-8e7b-ec1fae774dcc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:29:26.826962 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-b5171499-577e-4477-8e7b-ec1fae774dcc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:29:26.937232 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5171499-577e-4477-8e7b-ec1fae774dcc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:29:26.938733 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5171499-577e-4477-8e7b-ec1fae774dcc service neutron] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:29:26.957014 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 646/1314] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:29:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:29:29.282908 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a5b370-6d7e-4766-bb22-fe4de12e03ae None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:29:29.283448 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a5b370-6d7e-4766-bb22-fe4de12e03ae None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:29:29.283448 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a5b370-6d7e-4766-bb22-fe4de12e03ae None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:29:29.284818 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 669/1315] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:29:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:29:29.290523 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03c7581-eb73-4b78-9986-33d6912b267c None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:29:29.290934 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03c7581-eb73-4b78-9986-33d6912b267c None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:29:29.291082 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03c7581-eb73-4b78-9986-33d6912b267c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:29:29.355268 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-b03c7581-eb73-4b78-9986-33d6912b267c None None] MFA Rules not processed for user `9c6423457ccf46e1b9988735408785f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:29:29.357357 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-b03c7581-eb73-4b78-9986-33d6912b267c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:29:29.410022 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:29:29.453822 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 647/1316] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:29:29 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:29:29.493820 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a5b370-6d7e-4766-bb22-fe4de12e03ae None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:29:29.495422 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-b9a5b370-6d7e-4766-bb22-fe4de12e03ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:29:29.504992 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:29:29.606055 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a5b370-6d7e-4766-bb22-fe4de12e03ae None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:29:29.679697 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdcd834-4331-4268-bc43-976969aabd4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e4a5a8965e4802a9055d332179b7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:29:29.680348 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdcd834-4331-4268-bc43-976969aabd4a service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:29:29.680635 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdcd834-4331-4268-bc43-976969aabd4a service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:29:29.680911 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdcd834-4331-4268-bc43-976969aabd4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:29:29.682570 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-dfdcd834-4331-4268-bc43-976969aabd4a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:29:29.743575 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:29:29.789412 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdcd834-4331-4268-bc43-976969aabd4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:29:29.790872 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdcd834-4331-4268-bc43-976969aabd4a service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:29:29.808660 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 670/1317] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:29:29 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:29:32.352093 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57368e2-d688-411f-844b-9efaacfe55da None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:29:32.352698 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57368e2-d688-411f-844b-9efaacfe55da None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:29:32.352698 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57368e2-d688-411f-844b-9efaacfe55da None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:29:32.354010 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 648/1318] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:29:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:29:32.359433 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcf8448-7a73-4a88-b9ee-0c42e8158dc7 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:29:32.359837 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcf8448-7a73-4a88-b9ee-0c42e8158dc7 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:29:32.359988 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcf8448-7a73-4a88-b9ee-0c42e8158dc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:29:32.422139 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-dfcf8448-7a73-4a88-b9ee-0c42e8158dc7 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:29:32.423350 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-dfcf8448-7a73-4a88-b9ee-0c42e8158dc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:29:32.516683 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 671/1319] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:29:32 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:29:32.555120 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57368e2-d688-411f-844b-9efaacfe55da None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:29:32.556658 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-b57368e2-d688-411f-844b-9efaacfe55da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:29:32.658270 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57368e2-d688-411f-844b-9efaacfe55da None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:29:32.737119 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e59f9c-825f-4c9f-ae48-46800df92ec2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e4a5a8965e4802a9055d332179b7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:29:32.737798 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e59f9c-825f-4c9f-ae48-46800df92ec2 service neutron] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:29:32.738086 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e59f9c-825f-4c9f-ae48-46800df92ec2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:29:32.738396 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e59f9c-825f-4c9f-ae48-46800df92ec2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:29:32.740103 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-a8e59f9c-825f-4c9f-ae48-46800df92ec2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:29:32.747528 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:29:32.845581 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e59f9c-825f-4c9f-ae48-46800df92ec2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:29:32.847033 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e59f9c-825f-4c9f-ae48-46800df92ec2 service neutron] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:29:32.865227 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 649/1320] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:29:32 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:29:35.534636 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cbcb06-3d59-4147-899c-b75de526e005 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:29:35.535188 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cbcb06-3d59-4147-899c-b75de526e005 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:29:35.535188 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cbcb06-3d59-4147-899c-b75de526e005 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:29:35.537219 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 672/1321] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:29:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:29:35.542359 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8778be-49b7-46a5-bf1a-8944c7c509da None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:29:35.542774 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8778be-49b7-46a5-bf1a-8944c7c509da None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:29:35.542913 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8778be-49b7-46a5-bf1a-8944c7c509da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:29:35.609048 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-5d8778be-49b7-46a5-bf1a-8944c7c509da None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:29:35.610295 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-5d8778be-49b7-46a5-bf1a-8944c7c509da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:29:35.668856 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:29:35.714062 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 650/1322] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:29:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:29:35.751082 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cbcb06-3d59-4147-899c-b75de526e005 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:29:35.752633 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-98cbcb06-3d59-4147-899c-b75de526e005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:29:35.772817 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:29:35.864172 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cbcb06-3d59-4147-899c-b75de526e005 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:29:35.937767 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7427c3-f21d-477c-aed5-516e6b14dfe3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e4a5a8965e4802a9055d332179b7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:29:35.938481 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7427c3-f21d-477c-aed5-516e6b14dfe3 service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:29:35.938772 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7427c3-f21d-477c-aed5-516e6b14dfe3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:29:35.939054 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7427c3-f21d-477c-aed5-516e6b14dfe3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:29:35.940713 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-1e7427c3-f21d-477c-aed5-516e6b14dfe3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:29:36.016883 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:29:36.055384 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7427c3-f21d-477c-aed5-516e6b14dfe3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:29:36.056839 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7427c3-f21d-477c-aed5-516e6b14dfe3 service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:29:36.076621 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 673/1323] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:29:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:29:38.177052 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127baa5d-89dd-46e7-8ca6-cd2126dc7d08 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:29:38.177579 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127baa5d-89dd-46e7-8ca6-cd2126dc7d08 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:29:38.177686 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127baa5d-89dd-46e7-8ca6-cd2126dc7d08 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:29:38.179203 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 651/1324] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:29:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:29:38.184153 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7eabc3-aea2-4a69-a343-11c70d3ee91c None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:29:38.184561 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7eabc3-aea2-4a69-a343-11c70d3ee91c None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:29:38.184701 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7eabc3-aea2-4a69-a343-11c70d3ee91c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:29:38.248839 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-7a7eabc3-aea2-4a69-a343-11c70d3ee91c None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:29:38.250048 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-7a7eabc3-aea2-4a69-a343-11c70d3ee91c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:29:38.350223 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 674/1325] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:29:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:29:38.382823 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127baa5d-89dd-46e7-8ca6-cd2126dc7d08 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:29:38.384428 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-127baa5d-89dd-46e7-8ca6-cd2126dc7d08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:29:38.488021 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127baa5d-89dd-46e7-8ca6-cd2126dc7d08 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:29:38.564677 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cadddb-880c-42c0-98a1-c739dfd27fad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e4a5a8965e4802a9055d332179b7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:29:38.565345 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cadddb-880c-42c0-98a1-c739dfd27fad service neutron] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:29:38.565628 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cadddb-880c-42c0-98a1-c739dfd27fad service neutron] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:29:38.565903 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cadddb-880c-42c0-98a1-c739dfd27fad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:29:38.568180 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-f7cadddb-880c-42c0-98a1-c739dfd27fad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:29:38.585895 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:29:38.680479 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cadddb-880c-42c0-98a1-c739dfd27fad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:29:38.681917 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cadddb-880c-42c0-98a1-c739dfd27fad service neutron] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:29:38.700659 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 652/1326] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:29:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:29:40.777263 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b0b09e-f37d-46a5-b2b0-3b3cacb59870 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:29:40.777828 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b0b09e-f37d-46a5-b2b0-3b3cacb59870 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:29:40.777828 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b0b09e-f37d-46a5-b2b0-3b3cacb59870 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:29:40.779362 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 675/1327] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:29:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:29:40.784259 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a9053a-ac51-48fb-a2c2-cbaf093ba978 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:29:40.784710 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a9053a-ac51-48fb-a2c2-cbaf093ba978 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:29:40.784821 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a9053a-ac51-48fb-a2c2-cbaf093ba978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:29:40.851965 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-f3a9053a-ac51-48fb-a2c2-cbaf093ba978 None None] MFA Rules not processed for user `9c6423457ccf46e1b9988735408785f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:29:40.853257 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-f3a9053a-ac51-48fb-a2c2-cbaf093ba978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:29:40.920037 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:29:40.957174 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 653/1328] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:29:40 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:29:41.007907 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c35234-6c37-4e6d-a3b5-9cc22bec9f5b None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:29:41.008290 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c35234-6c37-4e6d-a3b5-9cc22bec9f5b None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:29:41.008642 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c35234-6c37-4e6d-a3b5-9cc22bec9f5b None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:29:41.010089 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 676/1329] 10.222.0.40 () {54 vars in 964 bytes} [Thu Jul 14 09:29:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 09:29:41.016023 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a72cc7-0121-47dd-aa04-a4e510697358 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:29:41.016382 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a72cc7-0121-47dd-aa04-a4e510697358 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:29:41.016729 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a72cc7-0121-47dd-aa04-a4e510697358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:29:41.091135 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-35a72cc7-0121-47dd-aa04-a4e510697358 None None] MFA Rules not processed for user `65e4a5a8965e4802a9055d332179b7a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:29:41.092340 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-35a72cc7-0121-47dd-aa04-a4e510697358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:29:41.169289 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 654/1330] 10.222.0.40 () {58 vars in 1061 bytes} [Thu Jul 14 09:29:41 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 09:29:41.178704 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c35234-6c37-4e6d-a3b5-9cc22bec9f5b None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:29:41.180204 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-49c35234-6c37-4e6d-a3b5-9cc22bec9f5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:29:41.211705 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:29:41.283266 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c35234-6c37-4e6d-a3b5-9cc22bec9f5b None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:29:41.368650 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd89f115-15d2-4aaf-9a81-cb704005603a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e4a5a8965e4802a9055d332179b7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:29:41.369313 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd89f115-15d2-4aaf-9a81-cb704005603a service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:29:41.369596 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd89f115-15d2-4aaf-9a81-cb704005603a service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:29:41.369872 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd89f115-15d2-4aaf-9a81-cb704005603a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:29:41.371705 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-bd89f115-15d2-4aaf-9a81-cb704005603a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:29:41.455767 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:29:41.490388 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd89f115-15d2-4aaf-9a81-cb704005603a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:29:41.491841 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd89f115-15d2-4aaf-9a81-cb704005603a service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:29:41.510883 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 677/1331] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:29:41 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:29:44.174300 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592d4ad8-9749-4411-8416-f3e0d8123c29 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:29:44.174891 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592d4ad8-9749-4411-8416-f3e0d8123c29 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:29:44.174891 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592d4ad8-9749-4411-8416-f3e0d8123c29 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:29:44.176743 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 655/1332] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:29:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 09:29:44.181828 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e9437c-b904-4245-8739-a070bb948e4a None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:29:44.182281 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e9437c-b904-4245-8739-a070bb948e4a None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:29:44.182417 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e9437c-b904-4245-8739-a070bb948e4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:29:44.246873 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-83e9437c-b904-4245-8739-a070bb948e4a None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:29:44.248091 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-83e9437c-b904-4245-8739-a070bb948e4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:29:44.342298 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 678/1333] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:29:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 09:29:44.378789 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592d4ad8-9749-4411-8416-f3e0d8123c29 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:29:44.380363 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-592d4ad8-9749-4411-8416-f3e0d8123c29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:29:44.448713 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:29:44.482757 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592d4ad8-9749-4411-8416-f3e0d8123c29 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:29:44.555753 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5862482-163b-461a-a47c-13e6c3f345cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e4a5a8965e4802a9055d332179b7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:29:44.556407 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5862482-163b-461a-a47c-13e6c3f345cc service neutron] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:29:44.556721 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5862482-163b-461a-a47c-13e6c3f345cc service neutron] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:29:44.557003 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5862482-163b-461a-a47c-13e6c3f345cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:29:44.558902 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-b5862482-163b-461a-a47c-13e6c3f345cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:29:44.665621 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5862482-163b-461a-a47c-13e6c3f345cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:29:44.667093 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5862482-163b-461a-a47c-13e6c3f345cc service neutron] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:29:44.678101 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:29:44.687539 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 656/1334] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:29:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:29:46.767596 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c5c94d-3038-4a56-ab56-fee8abd6cfe4 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:29:46.768145 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c5c94d-3038-4a56-ab56-fee8abd6cfe4 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:29:46.768145 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c5c94d-3038-4a56-ab56-fee8abd6cfe4 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:29:46.769520 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 679/1335] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:29:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:29:46.774757 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86963c0c-00be-4878-84a6-f151673cac1b None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:29:46.775175 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86963c0c-00be-4878-84a6-f151673cac1b None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:29:46.775318 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86963c0c-00be-4878-84a6-f151673cac1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:29:46.840683 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-86963c0c-00be-4878-84a6-f151673cac1b None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:29:46.841800 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-86963c0c-00be-4878-84a6-f151673cac1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:29:46.935962 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 657/1336] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:29:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:29:46.975697 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c5c94d-3038-4a56-ab56-fee8abd6cfe4 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:29:46.977224 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-b3c5c94d-3038-4a56-ab56-fee8abd6cfe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:29:47.016846 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:29:47.079457 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c5c94d-3038-4a56-ab56-fee8abd6cfe4 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:29:47.152077 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97734a46-3c69-4441-b113-47eccca1ed1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e4a5a8965e4802a9055d332179b7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:29:47.152650 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97734a46-3c69-4441-b113-47eccca1ed1f service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:29:47.152934 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97734a46-3c69-4441-b113-47eccca1ed1f service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:29:47.153212 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97734a46-3c69-4441-b113-47eccca1ed1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:29:47.154880 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-97734a46-3c69-4441-b113-47eccca1ed1f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:29:47.237088 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:29:47.262633 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97734a46-3c69-4441-b113-47eccca1ed1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:29:47.264072 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97734a46-3c69-4441-b113-47eccca1ed1f service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:29:47.283438 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 680/1337] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:29:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:29:49.656019 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ab6cbc-f9a6-4b73-bcd1-997d43f771d6 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:29:49.656547 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ab6cbc-f9a6-4b73-bcd1-997d43f771d6 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:29:49.656673 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ab6cbc-f9a6-4b73-bcd1-997d43f771d6 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:29:49.657943 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 658/1338] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:29:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:29:49.663755 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb78864-c5f0-412a-8895-3de05109fbd9 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:29:49.664192 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb78864-c5f0-412a-8895-3de05109fbd9 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:29:49.664391 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb78864-c5f0-412a-8895-3de05109fbd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:29:49.727545 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-7bb78864-c5f0-412a-8895-3de05109fbd9 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:29:49.728757 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-7bb78864-c5f0-412a-8895-3de05109fbd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:29:49.829334 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 681/1339] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:29:49 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:29:49.866493 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ab6cbc-f9a6-4b73-bcd1-997d43f771d6 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:29:49.868014 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-b7ab6cbc-f9a6-4b73-bcd1-997d43f771d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:29:49.941198 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:29:49.968965 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ab6cbc-f9a6-4b73-bcd1-997d43f771d6 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:29:50.039978 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791a8636-9226-4f6c-98cc-c8301cea75a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e4a5a8965e4802a9055d332179b7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:29:50.040621 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791a8636-9226-4f6c-98cc-c8301cea75a1 service neutron] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:29:50.040901 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791a8636-9226-4f6c-98cc-c8301cea75a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:29:50.041175 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791a8636-9226-4f6c-98cc-c8301cea75a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:29:50.042819 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-791a8636-9226-4f6c-98cc-c8301cea75a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:29:50.148319 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791a8636-9226-4f6c-98cc-c8301cea75a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:29:50.149669 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791a8636-9226-4f6c-98cc-c8301cea75a1 service neutron] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:29:50.167810 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 659/1340] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:29:49 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:29:54.283881 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59d5dc3-e2a2-4f1c-9ca0-059b5a743211 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:29:54.284402 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59d5dc3-e2a2-4f1c-9ca0-059b5a743211 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:29:54.284496 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59d5dc3-e2a2-4f1c-9ca0-059b5a743211 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:29:54.286468 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 682/1341] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:29:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:29:54.291907 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d3c034-e463-4c83-a6ef-5ac1377ce34a None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:29:54.292376 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d3c034-e463-4c83-a6ef-5ac1377ce34a None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:29:54.292471 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d3c034-e463-4c83-a6ef-5ac1377ce34a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:29:54.298182 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:29:54.381219 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-11d3c034-e463-4c83-a6ef-5ac1377ce34a None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:29:54.382499 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-11d3c034-e463-4c83-a6ef-5ac1377ce34a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:29:54.495116 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 660/1342] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:29:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:29:54.533222 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59d5dc3-e2a2-4f1c-9ca0-059b5a743211 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:29:54.534911 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-a59d5dc3-e2a2-4f1c-9ca0-059b5a743211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:29:54.589073 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:29:54.647151 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59d5dc3-e2a2-4f1c-9ca0-059b5a743211 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:29:54.720818 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f181e694-790e-42d0-a26d-ff1abfe2fbad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e4a5a8965e4802a9055d332179b7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:29:54.721585 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f181e694-790e-42d0-a26d-ff1abfe2fbad service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:29:54.721869 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f181e694-790e-42d0-a26d-ff1abfe2fbad service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:29:54.722164 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f181e694-790e-42d0-a26d-ff1abfe2fbad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:29:54.724462 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-f181e694-790e-42d0-a26d-ff1abfe2fbad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:29:54.819067 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:29:54.836558 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f181e694-790e-42d0-a26d-ff1abfe2fbad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:29:54.838009 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f181e694-790e-42d0-a26d-ff1abfe2fbad service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:29:54.856187 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 683/1343] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:29:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:29:57.534071 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e981e4b6-91f1-4313-ac0a-e67e1cac8de3 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:29:57.534683 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e981e4b6-91f1-4313-ac0a-e67e1cac8de3 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:29:57.534777 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e981e4b6-91f1-4313-ac0a-e67e1cac8de3 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:29:57.536652 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 661/1344] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:29:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:29:57.542539 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b146c235-dd24-44ff-a6aa-6b8ab15d8716 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:29:57.543098 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b146c235-dd24-44ff-a6aa-6b8ab15d8716 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:29:57.543193 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b146c235-dd24-44ff-a6aa-6b8ab15d8716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:29:57.613870 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-b146c235-dd24-44ff-a6aa-6b8ab15d8716 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:29:57.615148 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-b146c235-dd24-44ff-a6aa-6b8ab15d8716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:29:57.719432 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 684/1345] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:29:57 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:29:57.757117 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e981e4b6-91f1-4313-ac0a-e67e1cac8de3 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:29:57.758800 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-e981e4b6-91f1-4313-ac0a-e67e1cac8de3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:29:57.844517 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:29:57.865480 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e981e4b6-91f1-4313-ac0a-e67e1cac8de3 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:29:57.938139 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b238dba-19a6-47a4-b764-6d24f76c81c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e4a5a8965e4802a9055d332179b7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:29:57.938819 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b238dba-19a6-47a4-b764-6d24f76c81c5 service neutron] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:29:57.939103 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b238dba-19a6-47a4-b764-6d24f76c81c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:29:57.939378 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b238dba-19a6-47a4-b764-6d24f76c81c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:29:57.941062 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-6b238dba-19a6-47a4-b764-6d24f76c81c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:29:58.048858 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b238dba-19a6-47a4-b764-6d24f76c81c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:29:58.050870 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b238dba-19a6-47a4-b764-6d24f76c81c5 service neutron] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:29:58.069254 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 662/1346] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:29:57 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:30:02.366973 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8c91fa-3882-443b-a8a4-18b47d2b322a None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:30:02.367567 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8c91fa-3882-443b-a8a4-18b47d2b322a None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:30:02.367567 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8c91fa-3882-443b-a8a4-18b47d2b322a None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:30:02.368916 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 685/1347] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:30:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:30:02.374248 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a2e48e-4847-4561-a1b7-b9ef2b839623 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:30:02.374772 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a2e48e-4847-4561-a1b7-b9ef2b839623 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:30:02.374879 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a2e48e-4847-4561-a1b7-b9ef2b839623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:30:02.389760 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:30:02.445076 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-b8a2e48e-4847-4561-a1b7-b9ef2b839623 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:30:02.446175 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-b8a2e48e-4847-4561-a1b7-b9ef2b839623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:30:02.547403 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 663/1348] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:30:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:30:02.586409 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8c91fa-3882-443b-a8a4-18b47d2b322a None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:30:02.587969 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-3a8c91fa-3882-443b-a8a4-18b47d2b322a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:30:02.648546 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:30:02.700930 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8c91fa-3882-443b-a8a4-18b47d2b322a None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:30:02.786964 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9dd458-fc20-4b63-9fc1-e63f0cd23949 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e4a5a8965e4802a9055d332179b7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:30:02.787627 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9dd458-fc20-4b63-9fc1-e63f0cd23949 service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:30:02.787999 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9dd458-fc20-4b63-9fc1-e63f0cd23949 service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:30:02.788281 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9dd458-fc20-4b63-9fc1-e63f0cd23949 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:30:02.790133 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-9c9dd458-fc20-4b63-9fc1-e63f0cd23949 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:30:02.908504 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:30:02.914419 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9dd458-fc20-4b63-9fc1-e63f0cd23949 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:30:02.916148 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9dd458-fc20-4b63-9fc1-e63f0cd23949 service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:30:02.937293 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 686/1349] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:30:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:30:07.886171 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9874f8a1-0a1f-48d4-ad13-fbdd901a96ba None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:30:07.886689 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9874f8a1-0a1f-48d4-ad13-fbdd901a96ba None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:30:07.886807 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9874f8a1-0a1f-48d4-ad13-fbdd901a96ba None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:30:07.892261 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 664/1350] 10.222.0.40 () {54 vars in 921 bytes} [Thu Jul 14 09:30:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:30:07.895047 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09304592-534f-42b3-b580-4b6ec3357dd1 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:30:07.895473 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09304592-534f-42b3-b580-4b6ec3357dd1 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:30:07.895591 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09304592-534f-42b3-b580-4b6ec3357dd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:30:07.993645 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-09304592-534f-42b3-b580-4b6ec3357dd1 None None] MFA Rules not processed for user `6fc5a80144b84c609944a51a84fd5e6e`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:30:07.994949 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-09304592-534f-42b3-b580-4b6ec3357dd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:30:08.195169 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 687/1351] 10.222.0.40 () {58 vars in 1018 bytes} [Thu Jul 14 09:30:07 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:30:12.545445 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=59 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:30:12.629286 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b5f5b2-6ba4-4060-a4e8-95f58956c6d3 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:30:12.630059 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b5f5b2-6ba4-4060-a4e8-95f58956c6d3 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:30:12.630573 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b5f5b2-6ba4-4060-a4e8-95f58956c6d3 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:30:12.632321 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 665/1352] 10.222.0.40 () {54 vars in 921 bytes} [Thu Jul 14 09:30:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:30:12.637253 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb2dc53-556b-4322-b343-d962e0512c70 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:30:12.637695 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb2dc53-556b-4322-b343-d962e0512c70 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:30:12.637902 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb2dc53-556b-4322-b343-d962e0512c70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:30:12.708039 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:30:12.751836 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-1bb2dc53-556b-4322-b343-d962e0512c70 None None] MFA Rules not processed for user `6fc5a80144b84c609944a51a84fd5e6e`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:30:12.757398 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-1bb2dc53-556b-4322-b343-d962e0512c70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:30:12.930265 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 688/1353] 10.222.0.40 () {58 vars in 1018 bytes} [Thu Jul 14 09:30:12 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:30:14.253834 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22fa8f6-3aa1-4e9e-b7d8-dd099533a04e None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:30:14.254431 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22fa8f6-3aa1-4e9e-b7d8-dd099533a04e None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:30:14.254431 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22fa8f6-3aa1-4e9e-b7d8-dd099533a04e None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:30:14.255799 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 666/1354] 10.222.0.40 () {54 vars in 921 bytes} [Thu Jul 14 09:30:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:30:14.260925 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93946167-fbba-41da-8033-66f3e7b694fb None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:30:14.261334 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93946167-fbba-41da-8033-66f3e7b694fb None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:30:14.261649 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93946167-fbba-41da-8033-66f3e7b694fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:30:14.336437 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-93946167-fbba-41da-8033-66f3e7b694fb None None] MFA Rules not processed for user `6fc5a80144b84c609944a51a84fd5e6e`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:30:14.337646 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-93946167-fbba-41da-8033-66f3e7b694fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:30:14.380502 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:30:14.458061 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 689/1355] 10.222.0.40 () {58 vars in 1018 bytes} [Thu Jul 14 09:30:14 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 09:30:17.808082 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb896987-446e-4999-a488-cb3236dbf531 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:30:17.808985 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb896987-446e-4999-a488-cb3236dbf531 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:30:17.809429 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb896987-446e-4999-a488-cb3236dbf531 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:30:17.811280 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 667/1356] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:30:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:30:17.817405 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726fdace-99df-447f-a892-81dd03348e0c None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:30:17.818460 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726fdace-99df-447f-a892-81dd03348e0c None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:30:17.818923 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726fdace-99df-447f-a892-81dd03348e0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:30:17.894299 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-726fdace-99df-447f-a892-81dd03348e0c None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:30:17.895640 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-726fdace-99df-447f-a892-81dd03348e0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:30:18.004985 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 690/1357] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:30:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:30:18.062508 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7419f5-6aad-41f7-a747-fb431f38c2b1 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:30:18.063113 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7419f5-6aad-41f7-a747-fb431f38c2b1 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:30:18.063742 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7419f5-6aad-41f7-a747-fb431f38c2b1 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:30:18.065962 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 668/1358] 10.222.0.40 () {54 vars in 961 bytes} [Thu Jul 14 09:30:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 09:30:18.076347 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d4fb7b-adc6-456a-8cda-223f2d6c047b None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:30:18.077185 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d4fb7b-adc6-456a-8cda-223f2d6c047b None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:30:18.078016 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d4fb7b-adc6-456a-8cda-223f2d6c047b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:30:18.099888 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:30:18.167797 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-37d4fb7b-adc6-456a-8cda-223f2d6c047b None None] MFA Rules not processed for user `1f6962106dfa4c4c9af551053f8095e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:30:18.168998 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-37d4fb7b-adc6-456a-8cda-223f2d6c047b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:30:18.299539 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 691/1359] 10.222.0.40 () {58 vars in 1058 bytes} [Thu Jul 14 09:30:18 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:30:18.307352 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7419f5-6aad-41f7-a747-fb431f38c2b1 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:30:18.309104 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-3a7419f5-6aad-41f7-a747-fb431f38c2b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:30:18.482588 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7419f5-6aad-41f7-a747-fb431f38c2b1 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:30:18.563303 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:30:18.608608 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c37aa8-0ae9-4692-8765-0087cb567eb3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f6962106dfa4c4c9af551053f8095e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:30:18.609267 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c37aa8-0ae9-4692-8765-0087cb567eb3 service nova] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:30:18.609556 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c37aa8-0ae9-4692-8765-0087cb567eb3 service nova] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:30:18.609837 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c37aa8-0ae9-4692-8765-0087cb567eb3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:30:18.612058 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-30c37aa8-0ae9-4692-8765-0087cb567eb3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:30:18.730805 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c37aa8-0ae9-4692-8765-0087cb567eb3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:30:18.733004 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c37aa8-0ae9-4692-8765-0087cb567eb3 service nova] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:30:18.754879 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 669/1360] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:30:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:30:21.072846 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ae29fb-6c91-4246-a0f0-233d5a540457 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:30:21.073399 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ae29fb-6c91-4246-a0f0-233d5a540457 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:30:21.073399 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ae29fb-6c91-4246-a0f0-233d5a540457 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:30:21.074944 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 692/1361] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:30:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:30:21.080795 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc474d77-3110-4d87-b9d3-d1bf87a9dd19 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:30:21.081258 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc474d77-3110-4d87-b9d3-d1bf87a9dd19 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:30:21.081352 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc474d77-3110-4d87-b9d3-d1bf87a9dd19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:30:21.153032 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-bc474d77-3110-4d87-b9d3-d1bf87a9dd19 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:30:21.154369 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-bc474d77-3110-4d87-b9d3-d1bf87a9dd19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:30:21.198032 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:30:21.286020 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 670/1362] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:30:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:30:21.332095 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ae29fb-6c91-4246-a0f0-233d5a540457 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:30:21.333736 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-34ae29fb-6c91-4246-a0f0-233d5a540457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:30:21.411859 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:30:21.549006 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ae29fb-6c91-4246-a0f0-233d5a540457 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:30:21.676781 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e501c82-ee0a-40f0-aab1-7409dc95b494 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f6962106dfa4c4c9af551053f8095e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:30:21.677912 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e501c82-ee0a-40f0-aab1-7409dc95b494 service nova] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:30:21.678210 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e501c82-ee0a-40f0-aab1-7409dc95b494 service nova] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:30:21.678667 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e501c82-ee0a-40f0-aab1-7409dc95b494 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:30:21.680383 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-2e501c82-ee0a-40f0-aab1-7409dc95b494 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:30:21.706155 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:30:21.785090 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e501c82-ee0a-40f0-aab1-7409dc95b494 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:30:21.786787 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e501c82-ee0a-40f0-aab1-7409dc95b494 service nova] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:30:21.807174 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 693/1363] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:30:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:30:24.213548 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b3fc68-beb2-480b-895f-c10ee0cd8ec8 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:30:24.214087 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b3fc68-beb2-480b-895f-c10ee0cd8ec8 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:30:24.214211 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b3fc68-beb2-480b-895f-c10ee0cd8ec8 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:30:24.215584 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 671/1364] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:30:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:30:24.221776 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa54eab2-ac36-4fdd-819e-be1d49231932 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:30:24.222296 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa54eab2-ac36-4fdd-819e-be1d49231932 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:30:24.222408 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa54eab2-ac36-4fdd-819e-be1d49231932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:30:24.313307 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-fa54eab2-ac36-4fdd-819e-be1d49231932 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:30:24.316313 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-fa54eab2-ac36-4fdd-819e-be1d49231932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:30:24.448644 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:30:24.454256 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 694/1365] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:30:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:30:24.512337 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c76612d-7bc4-4f62-aaeb-592de1924628 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:30:24.512763 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c76612d-7bc4-4f62-aaeb-592de1924628 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:30:24.513144 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c76612d-7bc4-4f62-aaeb-592de1924628 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:30:24.515909 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 672/1366] 10.222.0.40 () {54 vars in 961 bytes} [Thu Jul 14 09:30:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:30:24.524446 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93d6779-9212-4b43-a7b9-65ad7650f466 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:30:24.524952 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93d6779-9212-4b43-a7b9-65ad7650f466 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:30:24.526849 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93d6779-9212-4b43-a7b9-65ad7650f466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:30:24.652578 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-f93d6779-9212-4b43-a7b9-65ad7650f466 None None] MFA Rules not processed for user `1f6962106dfa4c4c9af551053f8095e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:30:24.653841 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-f93d6779-9212-4b43-a7b9-65ad7650f466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:30:24.913270 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 695/1367] 10.222.0.40 () {58 vars in 1058 bytes} [Thu Jul 14 09:30:24 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 390 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:30:24.921265 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c76612d-7bc4-4f62-aaeb-592de1924628 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:30:24.923062 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-7c76612d-7bc4-4f62-aaeb-592de1924628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:30:25.121023 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c76612d-7bc4-4f62-aaeb-592de1924628 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:30:25.143993 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:30:25.254681 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5f5d25-f0e2-430a-8d9e-400817a3405e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f6962106dfa4c4c9af551053f8095e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:30:25.255526 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5f5d25-f0e2-430a-8d9e-400817a3405e service nova] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:30:25.255912 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5f5d25-f0e2-430a-8d9e-400817a3405e service nova] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:30:25.256293 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5f5d25-f0e2-430a-8d9e-400817a3405e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:30:25.258278 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-1c5f5d25-f0e2-430a-8d9e-400817a3405e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:30:25.364384 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5f5d25-f0e2-430a-8d9e-400817a3405e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:30:25.366022 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5f5d25-f0e2-430a-8d9e-400817a3405e service nova] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:30:25.387527 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 673/1368] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:30:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 09:30:26.152948 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d66843-7692-424f-b69e-d264e0bb5a8e None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:30:26.153514 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d66843-7692-424f-b69e-d264e0bb5a8e None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:30:26.153514 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d66843-7692-424f-b69e-d264e0bb5a8e None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:30:26.155140 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 696/1369] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:30:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:30:26.160779 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662b1099-4417-41ec-82fa-3dac6846d441 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:30:26.161241 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662b1099-4417-41ec-82fa-3dac6846d441 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:30:26.161529 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662b1099-4417-41ec-82fa-3dac6846d441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:30:26.195541 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:30:26.235612 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-662b1099-4417-41ec-82fa-3dac6846d441 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:30:26.237384 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-662b1099-4417-41ec-82fa-3dac6846d441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:30:26.351939 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 674/1370] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:30:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:30:26.665967 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423704d9-90fd-4556-8cfa-8ef1f9882ad9 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:30:26.666342 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423704d9-90fd-4556-8cfa-8ef1f9882ad9 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:30:26.666555 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423704d9-90fd-4556-8cfa-8ef1f9882ad9 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:30:26.668085 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 697/1371] 10.222.0.40 () {54 vars in 963 bytes} [Thu Jul 14 09:30:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:30:26.673002 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5652ff31-5e29-4a88-aecb-a4add4c3d2a4 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:30:26.673327 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5652ff31-5e29-4a88-aecb-a4add4c3d2a4 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:30:26.673605 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5652ff31-5e29-4a88-aecb-a4add4c3d2a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:30:26.754357 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-5652ff31-5e29-4a88-aecb-a4add4c3d2a4 None None] MFA Rules not processed for user `25048b29787d482783ebc944f1a7df65`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:30:26.755576 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-5652ff31-5e29-4a88-aecb-a4add4c3d2a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:30:26.805562 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:30:26.842227 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 675/1372] 10.222.0.40 () {58 vars in 1060 bytes} [Thu Jul 14 09:30:26 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:30:26.850085 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423704d9-90fd-4556-8cfa-8ef1f9882ad9 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:30:26.851613 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-423704d9-90fd-4556-8cfa-8ef1f9882ad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:30:26.906493 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:30:26.966500 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423704d9-90fd-4556-8cfa-8ef1f9882ad9 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:30:27.052830 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f49243-5162-4cca-8198-30e32011d84e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25048b29787d482783ebc944f1a7df65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:30:27.053573 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f49243-5162-4cca-8198-30e32011d84e service cinder] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:30:27.053952 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f49243-5162-4cca-8198-30e32011d84e service cinder] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:30:27.054347 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f49243-5162-4cca-8198-30e32011d84e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:30:27.056305 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-25f49243-5162-4cca-8198-30e32011d84e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:30:27.163775 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:30:27.178841 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f49243-5162-4cca-8198-30e32011d84e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:30:27.180294 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f49243-5162-4cca-8198-30e32011d84e service cinder] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:30:27.201549 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 698/1373] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:30:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:30:27.575523 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d838a6-eebe-412b-b200-c9e82c13e9a5 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:30:27.575966 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d838a6-eebe-412b-b200-c9e82c13e9a5 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:30:27.576145 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d838a6-eebe-412b-b200-c9e82c13e9a5 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:30:27.577630 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 676/1374] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:30:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:30:27.582925 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343eca7e-6864-418c-b0af-3334e18d4a4e None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:30:27.583120 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343eca7e-6864-418c-b0af-3334e18d4a4e None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:30:27.583478 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343eca7e-6864-418c-b0af-3334e18d4a4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:30:27.666048 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-343eca7e-6864-418c-b0af-3334e18d4a4e None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:30:27.667789 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-343eca7e-6864-418c-b0af-3334e18d4a4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:30:27.798989 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 699/1375] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:30:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 09:30:27.844694 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d838a6-eebe-412b-b200-c9e82c13e9a5 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:30:27.857033 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-87d838a6-eebe-412b-b200-c9e82c13e9a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:30:28.055978 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d838a6-eebe-412b-b200-c9e82c13e9a5 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:30:28.115413 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:30:28.200469 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6248656b-d6a6-44bb-ab21-a29a04ca1210 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f6962106dfa4c4c9af551053f8095e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:30:28.201055 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6248656b-d6a6-44bb-ab21-a29a04ca1210 service nova] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:30:28.201568 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6248656b-d6a6-44bb-ab21-a29a04ca1210 service nova] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:30:28.201839 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6248656b-d6a6-44bb-ab21-a29a04ca1210 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:30:28.203738 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-6248656b-d6a6-44bb-ab21-a29a04ca1210 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:30:28.313048 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6248656b-d6a6-44bb-ab21-a29a04ca1210 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:30:28.315577 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6248656b-d6a6-44bb-ab21-a29a04ca1210 service nova] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:30:28.339880 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 677/1376] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:30:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:30:30.482948 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7840f81-c11e-4445-9530-af92b9abd514 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:30:30.482948 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7840f81-c11e-4445-9530-af92b9abd514 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:30:30.482948 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7840f81-c11e-4445-9530-af92b9abd514 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:30:30.483866 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 700/1377] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:30:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:30:30.490081 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e54d4c2-5e06-4687-9e5b-ed5537667103 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:30:30.490640 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e54d4c2-5e06-4687-9e5b-ed5537667103 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:30:30.490640 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e54d4c2-5e06-4687-9e5b-ed5537667103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:30:30.599516 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-9e54d4c2-5e06-4687-9e5b-ed5537667103 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:30:30.601002 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-9e54d4c2-5e06-4687-9e5b-ed5537667103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:30:30.609534 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:30:30.738855 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 678/1378] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:30:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:30:30.790702 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7840f81-c11e-4445-9530-af92b9abd514 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:30:30.792209 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-f7840f81-c11e-4445-9530-af92b9abd514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:30:30.871527 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:30:31.004395 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7840f81-c11e-4445-9530-af92b9abd514 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:30:31.206927 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cb4f5e-0588-4bd4-a970-23030b8401c1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f6962106dfa4c4c9af551053f8095e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:30:31.208018 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cb4f5e-0588-4bd4-a970-23030b8401c1 service nova] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:30:31.208413 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cb4f5e-0588-4bd4-a970-23030b8401c1 service nova] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:30:31.208787 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cb4f5e-0588-4bd4-a970-23030b8401c1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:30:31.210932 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-e6cb4f5e-0588-4bd4-a970-23030b8401c1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:30:31.238785 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:30:31.329583 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cb4f5e-0588-4bd4-a970-23030b8401c1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:30:31.331257 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cb4f5e-0588-4bd4-a970-23030b8401c1 service nova] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:30:31.355827 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 701/1379] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:30:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 565 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:30:33.510129 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19074311-2ee4-4936-a9bd-d7ec28a0756c None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:30:33.510745 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19074311-2ee4-4936-a9bd-d7ec28a0756c None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:30:33.511032 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19074311-2ee4-4936-a9bd-d7ec28a0756c None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:30:33.512595 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 679/1380] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:30:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:30:33.519049 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395eaec4-6189-43b3-b939-c69022836404 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:30:33.519584 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395eaec4-6189-43b3-b939-c69022836404 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:30:33.519584 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395eaec4-6189-43b3-b939-c69022836404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:30:33.592352 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-395eaec4-6189-43b3-b939-c69022836404 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:30:33.593551 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-395eaec4-6189-43b3-b939-c69022836404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:30:33.709006 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:30:33.722234 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 702/1381] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:30:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:30:33.767653 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19074311-2ee4-4936-a9bd-d7ec28a0756c None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:30:33.771170 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-19074311-2ee4-4936-a9bd-d7ec28a0756c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:30:33.980382 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:30:33.993144 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19074311-2ee4-4936-a9bd-d7ec28a0756c None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:30:34.144122 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104394ba-f058-43fc-ad73-c58823d61184 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f6962106dfa4c4c9af551053f8095e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:30:34.145171 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104394ba-f058-43fc-ad73-c58823d61184 service nova] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:30:34.145652 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104394ba-f058-43fc-ad73-c58823d61184 service nova] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:30:34.146106 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104394ba-f058-43fc-ad73-c58823d61184 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:30:34.148220 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-104394ba-f058-43fc-ad73-c58823d61184 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:30:34.267724 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104394ba-f058-43fc-ad73-c58823d61184 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:30:34.270324 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104394ba-f058-43fc-ad73-c58823d61184 service nova] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:30:34.289077 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:30:34.295611 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 680/1382] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:30:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 529 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:30:36.599507 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602b2d29-6b65-43cf-a597-ba390f0bed1b None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:30:36.600052 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602b2d29-6b65-43cf-a597-ba390f0bed1b None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:30:36.600157 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602b2d29-6b65-43cf-a597-ba390f0bed1b None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:30:36.601560 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 703/1383] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:30:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:30:36.607133 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742acd7f-ea72-430d-9e50-b5ad5dd720e4 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:30:36.607781 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742acd7f-ea72-430d-9e50-b5ad5dd720e4 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:30:36.607781 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742acd7f-ea72-430d-9e50-b5ad5dd720e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:30:36.684611 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-742acd7f-ea72-430d-9e50-b5ad5dd720e4 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:30:36.685843 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-742acd7f-ea72-430d-9e50-b5ad5dd720e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:30:36.800121 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 681/1384] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:30:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:30:36.846990 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602b2d29-6b65-43cf-a597-ba390f0bed1b None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:30:36.849337 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-602b2d29-6b65-43cf-a597-ba390f0bed1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:30:37.039426 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602b2d29-6b65-43cf-a597-ba390f0bed1b None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:30:37.124580 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:30:37.175660 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a38e616-6fc1-4836-ae52-7afa30854822 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f6962106dfa4c4c9af551053f8095e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:30:37.176322 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a38e616-6fc1-4836-ae52-7afa30854822 service nova] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:30:37.176618 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a38e616-6fc1-4836-ae52-7afa30854822 service nova] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:30:37.177307 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a38e616-6fc1-4836-ae52-7afa30854822 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:30:37.178915 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-8a38e616-6fc1-4836-ae52-7afa30854822 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:30:37.280188 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a38e616-6fc1-4836-ae52-7afa30854822 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:30:37.281879 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a38e616-6fc1-4836-ae52-7afa30854822 service nova] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:30:37.306671 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 704/1385] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:30:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:30:39.798622 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14937310-8c4e-4b1f-8490-00f8c84d4301 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:30:39.799215 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14937310-8c4e-4b1f-8490-00f8c84d4301 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:30:39.799315 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14937310-8c4e-4b1f-8490-00f8c84d4301 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:30:39.800927 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 682/1386] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:30:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:30:39.807348 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723ac75d-6ef5-43d2-95f9-f71ce40d0e0e None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:30:39.807793 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723ac75d-6ef5-43d2-95f9-f71ce40d0e0e None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:30:39.807952 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723ac75d-6ef5-43d2-95f9-f71ce40d0e0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:30:39.900105 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-723ac75d-6ef5-43d2-95f9-f71ce40d0e0e None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:30:39.902037 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-723ac75d-6ef5-43d2-95f9-f71ce40d0e0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:30:39.962765 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:30:40.062068 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 705/1387] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:30:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:30:40.116640 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14937310-8c4e-4b1f-8490-00f8c84d4301 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:30:40.118282 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-14937310-8c4e-4b1f-8490-00f8c84d4301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:30:40.210274 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:30:40.293062 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14937310-8c4e-4b1f-8490-00f8c84d4301 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:30:40.424475 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41663763-a153-449e-b4d4-beb37321f330 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f6962106dfa4c4c9af551053f8095e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:30:40.425134 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41663763-a153-449e-b4d4-beb37321f330 service nova] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:30:40.425420 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41663763-a153-449e-b4d4-beb37321f330 service nova] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:30:40.425701 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41663763-a153-449e-b4d4-beb37321f330 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:30:40.427466 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-41663763-a153-449e-b4d4-beb37321f330 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:30:40.466124 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:30:40.526537 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41663763-a153-449e-b4d4-beb37321f330 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:30:40.528588 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41663763-a153-449e-b4d4-beb37321f330 service nova] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:30:40.551814 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 683/1388] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:30:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:30:42.646362 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b388eb-390b-4c5e-884a-57e8b0b9adc4 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:30:42.646971 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b388eb-390b-4c5e-884a-57e8b0b9adc4 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:30:42.646971 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b388eb-390b-4c5e-884a-57e8b0b9adc4 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:30:42.648276 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 706/1389] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:30:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:30:42.653447 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba17319-6267-4756-b413-3af4daa5b9da None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:30:42.653883 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba17319-6267-4756-b413-3af4daa5b9da None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:30:42.654013 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba17319-6267-4756-b413-3af4daa5b9da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:30:42.718654 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-9ba17319-6267-4756-b413-3af4daa5b9da None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:30:42.719890 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-9ba17319-6267-4756-b413-3af4daa5b9da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:30:42.815555 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 684/1390] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:30:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:30:42.860194 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b388eb-390b-4c5e-884a-57e8b0b9adc4 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:30:42.861714 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-60b388eb-390b-4c5e-884a-57e8b0b9adc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:30:43.006681 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b388eb-390b-4c5e-884a-57e8b0b9adc4 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:30:43.022748 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:30:43.120382 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cef301-0568-4673-a17f-b89ff022939f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f6962106dfa4c4c9af551053f8095e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:30:43.120951 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cef301-0568-4673-a17f-b89ff022939f service nova] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:30:43.121236 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cef301-0568-4673-a17f-b89ff022939f service nova] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:30:43.121510 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cef301-0568-4673-a17f-b89ff022939f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:30:43.123241 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-d0cef301-0568-4673-a17f-b89ff022939f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:30:43.213228 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cef301-0568-4673-a17f-b89ff022939f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:30:43.214859 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cef301-0568-4673-a17f-b89ff022939f service nova] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:30:43.233415 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 707/1391] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:30:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:30:43.311400 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1def9fdf-e041-4598-b66d-693d50d113f5 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:30:43.311693 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1def9fdf-e041-4598-b66d-693d50d113f5 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:30:43.311973 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1def9fdf-e041-4598-b66d-693d50d113f5 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:30:43.314028 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 685/1392] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:30:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:30:43.320028 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620ecbc6-665f-48fd-8539-d08d1ca38203 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:30:43.320317 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620ecbc6-665f-48fd-8539-d08d1ca38203 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:30:43.320698 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620ecbc6-665f-48fd-8539-d08d1ca38203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:30:43.347901 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:30:43.396860 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-620ecbc6-665f-48fd-8539-d08d1ca38203 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:30:43.398056 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-620ecbc6-665f-48fd-8539-d08d1ca38203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:30:43.500849 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 708/1393] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:30:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:30:43.558580 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29856fc7-579f-4284-ad63-57dfbf62f525 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:30:43.559267 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29856fc7-579f-4284-ad63-57dfbf62f525 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:30:43.559267 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29856fc7-579f-4284-ad63-57dfbf62f525 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:30:43.560481 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 686/1394] 10.222.0.40 () {54 vars in 962 bytes} [Thu Jul 14 09:30:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:30:43.566353 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c04afbe-e5fb-45ac-be12-c964bd138c78 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:30:43.566654 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c04afbe-e5fb-45ac-be12-c964bd138c78 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:30:43.566936 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c04afbe-e5fb-45ac-be12-c964bd138c78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:30:43.642618 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-9c04afbe-e5fb-45ac-be12-c964bd138c78 None None] MFA Rules not processed for user `7ba461800d6845e6a767c83777ae5213`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:30:43.643801 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-9c04afbe-e5fb-45ac-be12-c964bd138c78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:30:43.683324 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:30:43.721512 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 709/1395] 10.222.0.40 () {58 vars in 1059 bytes} [Thu Jul 14 09:30:43 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:30:43.729473 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29856fc7-579f-4284-ad63-57dfbf62f525 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:30:43.731282 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-29856fc7-579f-4284-ad63-57dfbf62f525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:30:43.746317 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:30:43.840975 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29856fc7-579f-4284-ad63-57dfbf62f525 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:30:43.920763 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d056a3e-f001-4b7e-9c77-8a4be012d091 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba461800d6845e6a767c83777ae5213', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:30:43.921421 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d056a3e-f001-4b7e-9c77-8a4be012d091 service glance] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:30:43.921708 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d056a3e-f001-4b7e-9c77-8a4be012d091 service glance] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:30:43.922592 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d056a3e-f001-4b7e-9c77-8a4be012d091 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:30:43.924401 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-6d056a3e-f001-4b7e-9c77-8a4be012d091 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:30:43.992561 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:30:44.033888 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d056a3e-f001-4b7e-9c77-8a4be012d091 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:30:44.035365 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d056a3e-f001-4b7e-9c77-8a4be012d091 service glance] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:30:44.053670 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 687/1396] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:30:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:30:44.765222 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4099fd-b7fc-462d-9941-808c810a059e None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:30:44.766279 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4099fd-b7fc-462d-9941-808c810a059e None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:30:44.766410 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4099fd-b7fc-462d-9941-808c810a059e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:30:44.830476 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-0e4099fd-b7fc-462d-9941-808c810a059e None None] MFA Rules not processed for user `6cf35868f9ff46e2835a6cc023641da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:30:44.831683 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-0e4099fd-b7fc-462d-9941-808c810a059e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:30:44.917581 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 710/1397] 10.222.0.40 () {58 vars in 1009 bytes} [Thu Jul 14 09:30:44 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:30:44.959920 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bc44f0-ec65-42e7-a15c-1d57f30f864c None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:30:44.960414 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bc44f0-ec65-42e7-a15c-1d57f30f864c None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:30:44.960614 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bc44f0-ec65-42e7-a15c-1d57f30f864c None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:30:44.962115 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 688/1398] 10.222.0.40 () {54 vars in 942 bytes} [Thu Jul 14 09:30:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:30:44.968421 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e8977d-9f57-46c3-8552-ad9774d0e465 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:30:44.968713 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e8977d-9f57-46c3-8552-ad9774d0e465 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:30:44.969598 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e8977d-9f57-46c3-8552-ad9774d0e465 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:30:45.037216 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:30:45.044807 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-15e8977d-9f57-46c3-8552-ad9774d0e465 None None] MFA Rules not processed for user `302c0f7dd3bf4829aad0b29bd0c091a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:30:45.046058 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-15e8977d-9f57-46c3-8552-ad9774d0e465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:30:45.152954 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 711/1399] 10.222.0.40 () {58 vars in 1039 bytes} [Thu Jul 14 09:30:44 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:30:45.162606 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bc44f0-ec65-42e7-a15c-1d57f30f864c None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:30:45.164359 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-68bc44f0-ec65-42e7-a15c-1d57f30f864c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:30:45.300330 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bc44f0-ec65-42e7-a15c-1d57f30f864c None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:30:45.314755 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb488e3-1521-4b35-b938-1372fd2b5f29 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:30:45.315046 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb488e3-1521-4b35-b938-1372fd2b5f29 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:30:45.315332 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb488e3-1521-4b35-b938-1372fd2b5f29 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:30:45.316700 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 712/1400] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:30:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 09:30:45.321500 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a769fe8-7d31-4a7e-abe6-e027889321d3 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:30:45.321796 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a769fe8-7d31-4a7e-abe6-e027889321d3 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:30:45.322079 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a769fe8-7d31-4a7e-abe6-e027889321d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:30:45.337628 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:30:45.388571 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-3a769fe8-7d31-4a7e-abe6-e027889321d3 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:30:45.389775 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-3a769fe8-7d31-4a7e-abe6-e027889321d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:30:45.407325 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de5ee8f-7487-4f1a-bc03-9853eee9dc46 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '302c0f7dd3bf4829aad0b29bd0c091a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:30:45.407988 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de5ee8f-7487-4f1a-bc03-9853eee9dc46 service swift] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:30:45.408279 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de5ee8f-7487-4f1a-bc03-9853eee9dc46 service swift] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:30:45.408562 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de5ee8f-7487-4f1a-bc03-9853eee9dc46 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:30:45.410282 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-9de5ee8f-7487-4f1a-bc03-9853eee9dc46 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:30:45.451947 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:30:45.488459 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 713/1401] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:30:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 09:30:45.493772 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de5ee8f-7487-4f1a-bc03-9853eee9dc46 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:30:45.495404 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de5ee8f-7487-4f1a-bc03-9853eee9dc46 service swift] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:30:45.504041 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 689/1402] 10.222.0.40 () {60 vars in 1384 bytes} [Thu Jul 14 09:30:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 09:30:45.533672 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a769fe8-7d31-4a7e-abe6-e027889321d3 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:30:45.535025 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-3a769fe8-7d31-4a7e-abe6-e027889321d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:30:45.669747 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a769fe8-7d31-4a7e-abe6-e027889321d3 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:30:45.756818 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:30:45.799018 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7d42da-fc81-4874-b34c-17f277e3ee9c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f6962106dfa4c4c9af551053f8095e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:30:45.799691 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7d42da-fc81-4874-b34c-17f277e3ee9c service nova] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:30:45.799947 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7d42da-fc81-4874-b34c-17f277e3ee9c service nova] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:30:45.800224 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7d42da-fc81-4874-b34c-17f277e3ee9c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:30:45.802066 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-fd7d42da-fc81-4874-b34c-17f277e3ee9c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:30:45.900310 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7d42da-fc81-4874-b34c-17f277e3ee9c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:30:45.901909 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7d42da-fc81-4874-b34c-17f277e3ee9c service nova] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:30:45.920936 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 714/1403] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:30:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:30:48.076678 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa9bcdc-1ddd-4df4-8813-f99a528be0fc None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:30:48.077214 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa9bcdc-1ddd-4df4-8813-f99a528be0fc None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:30:48.077214 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa9bcdc-1ddd-4df4-8813-f99a528be0fc None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:30:48.079499 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 690/1404] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:30:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:30:48.084678 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3780d7ef-4422-4a84-904f-4c63395edeeb None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:30:48.085121 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3780d7ef-4422-4a84-904f-4c63395edeeb None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:30:48.085246 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3780d7ef-4422-4a84-904f-4c63395edeeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:30:48.158319 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-3780d7ef-4422-4a84-904f-4c63395edeeb None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:30:48.159592 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-3780d7ef-4422-4a84-904f-4c63395edeeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:30:48.205419 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:30:48.275781 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 715/1405] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:30:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:30:48.322790 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa9bcdc-1ddd-4df4-8813-f99a528be0fc None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:30:48.324465 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-eaa9bcdc-1ddd-4df4-8813-f99a528be0fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:30:48.406549 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:30:48.495390 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa9bcdc-1ddd-4df4-8813-f99a528be0fc None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:30:48.617453 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cdfac2-ad11-4c20-9282-087c79b8be27 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f6962106dfa4c4c9af551053f8095e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:30:48.618450 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cdfac2-ad11-4c20-9282-087c79b8be27 service nova] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:30:48.618740 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cdfac2-ad11-4c20-9282-087c79b8be27 service nova] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:30:48.619020 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cdfac2-ad11-4c20-9282-087c79b8be27 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:30:48.620669 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-98cdfac2-ad11-4c20-9282-087c79b8be27 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:30:48.680395 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:30:48.789784 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cdfac2-ad11-4c20-9282-087c79b8be27 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:30:48.792508 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cdfac2-ad11-4c20-9282-087c79b8be27 service nova] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:30:48.818406 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 691/1406] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:30:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:30:50.913372 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95854f6e-3e32-43c0-b416-3cfe5850ee0d None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:30:50.913911 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95854f6e-3e32-43c0-b416-3cfe5850ee0d None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:30:50.914077 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95854f6e-3e32-43c0-b416-3cfe5850ee0d None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:30:50.915718 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 716/1407] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:30:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:30:50.920844 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81edde88-4c4a-4146-8d58-9c8a4df64472 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:30:50.921246 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81edde88-4c4a-4146-8d58-9c8a4df64472 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:30:50.925544 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81edde88-4c4a-4146-8d58-9c8a4df64472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:30:50.991664 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-81edde88-4c4a-4146-8d58-9c8a4df64472 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:30:50.992952 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-81edde88-4c4a-4146-8d58-9c8a4df64472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:30:51.096825 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 692/1408] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:30:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:30:51.140096 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95854f6e-3e32-43c0-b416-3cfe5850ee0d None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:30:51.142237 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-95854f6e-3e32-43c0-b416-3cfe5850ee0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:30:51.306173 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95854f6e-3e32-43c0-b416-3cfe5850ee0d None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:30:51.330365 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:30:51.429836 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c98171-8c82-4503-aa29-34f2518e9a2e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f6962106dfa4c4c9af551053f8095e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:30:51.430660 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c98171-8c82-4503-aa29-34f2518e9a2e service nova] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:30:51.430999 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c98171-8c82-4503-aa29-34f2518e9a2e service nova] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:30:51.431282 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c98171-8c82-4503-aa29-34f2518e9a2e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:30:51.432948 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-d4c98171-8c82-4503-aa29-34f2518e9a2e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:30:51.533972 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c98171-8c82-4503-aa29-34f2518e9a2e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:30:51.535691 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c98171-8c82-4503-aa29-34f2518e9a2e service nova] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:30:51.563070 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 717/1409] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:30:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:31:01.095086 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=97 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:31:01.553031 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=88 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:31:07.846065 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa146a7b-3c55-4706-891d-8af02c16c4b8 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:31:07.846653 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa146a7b-3c55-4706-891d-8af02c16c4b8 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:31:07.846653 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa146a7b-3c55-4706-891d-8af02c16c4b8 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:31:07.847956 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 693/1410] 10.222.0.40 () {54 vars in 918 bytes} [Thu Jul 14 09:31:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:31:07.853711 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d524486-aeb9-4e34-933b-33bb7b985cba None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:31:07.854112 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d524486-aeb9-4e34-933b-33bb7b985cba None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:31:07.854305 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d524486-aeb9-4e34-933b-33bb7b985cba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:31:07.957127 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-1d524486-aeb9-4e34-933b-33bb7b985cba None None] MFA Rules not processed for user `6fc5a80144b84c609944a51a84fd5e6e`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:31:07.958394 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-1d524486-aeb9-4e34-933b-33bb7b985cba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:31:08.064673 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 718/1411] 10.222.0.40 () {58 vars in 1015 bytes} [Thu Jul 14 09:31:07 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:31:08.079899 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74230720-2a07-4633-bb71-0a203e123429 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:31:08.080190 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74230720-2a07-4633-bb71-0a203e123429 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:31:08.080467 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74230720-2a07-4633-bb71-0a203e123429 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:31:08.081822 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 694/1412] 10.222.0.40 () {54 vars in 918 bytes} [Thu Jul 14 09:31:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:31:08.086753 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50bb069-5a44-4e02-ba56-54a87d5aa8a0 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:31:08.087042 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50bb069-5a44-4e02-ba56-54a87d5aa8a0 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:31:08.087319 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50bb069-5a44-4e02-ba56-54a87d5aa8a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:31:08.157951 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:31:08.160684 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-e50bb069-5a44-4e02-ba56-54a87d5aa8a0 None None] MFA Rules not processed for user `1f6962106dfa4c4c9af551053f8095e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:31:08.162456 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-e50bb069-5a44-4e02-ba56-54a87d5aa8a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:31:08.289555 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 719/1413] 10.222.0.40 () {58 vars in 1015 bytes} [Thu Jul 14 09:31:08 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:31:10.807656 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197ab7f6-69e4-4a81-beda-31fed2556753 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:31:10.808199 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197ab7f6-69e4-4a81-beda-31fed2556753 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:31:10.808306 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197ab7f6-69e4-4a81-beda-31fed2556753 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:31:10.809645 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 695/1414] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 09:31:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:31:10.815535 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dab5ce9-5d99-460e-a985-04b6e38742d2 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:31:10.815936 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dab5ce9-5d99-460e-a985-04b6e38742d2 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:31:10.816109 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dab5ce9-5d99-460e-a985-04b6e38742d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:31:10.880479 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-7dab5ce9-5d99-460e-a985-04b6e38742d2 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:31:10.881685 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-7dab5ce9-5d99-460e-a985-04b6e38742d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:31:10.937254 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:31:10.979104 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 720/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 09:31:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:31:11.022726 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197ab7f6-69e4-4a81-beda-31fed2556753 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:31:11.024278 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-197ab7f6-69e4-4a81-beda-31fed2556753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:31:11.167756 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197ab7f6-69e4-4a81-beda-31fed2556753 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:31:11.240503 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:31:11.281820 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c9eed0-44f2-475c-885b-cad04014a247 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f6962106dfa4c4c9af551053f8095e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:31:11.282510 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c9eed0-44f2-475c-885b-cad04014a247 service nova] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:31:11.282794 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c9eed0-44f2-475c-885b-cad04014a247 service nova] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:31:11.283069 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c9eed0-44f2-475c-885b-cad04014a247 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:31:11.284709 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-41c9eed0-44f2-475c-885b-cad04014a247 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:31:11.380088 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c9eed0-44f2-475c-885b-cad04014a247 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:31:11.381704 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c9eed0-44f2-475c-885b-cad04014a247 service nova] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:31:11.399466 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 696/1416] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:31:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:31:12.299982 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1fb5e6-1aca-4f88-a3eb-d95a95b35fde None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:31:12.300525 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1fb5e6-1aca-4f88-a3eb-d95a95b35fde None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:31:12.300525 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1fb5e6-1aca-4f88-a3eb-d95a95b35fde None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:31:12.301921 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 721/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 09:31:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:31:12.306786 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096b1452-3395-4a99-b11a-3ca7003d9c26 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:31:12.307182 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096b1452-3395-4a99-b11a-3ca7003d9c26 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:31:12.307348 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096b1452-3395-4a99-b11a-3ca7003d9c26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:31:12.380627 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-096b1452-3395-4a99-b11a-3ca7003d9c26 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:31:12.381841 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-096b1452-3395-4a99-b11a-3ca7003d9c26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:31:12.409092 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:31:12.480892 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 697/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 09:31:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:31:12.642651 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1fb5e6-1aca-4f88-a3eb-d95a95b35fde None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:31:12.644151 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-9c1fb5e6-1aca-4f88-a3eb-d95a95b35fde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:31:12.787688 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1fb5e6-1aca-4f88-a3eb-d95a95b35fde None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:31:12.827284 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:31:12.898711 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d8fb62-5726-4d0e-8c2e-3549fc866600 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f6962106dfa4c4c9af551053f8095e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:31:12.899364 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d8fb62-5726-4d0e-8c2e-3549fc866600 service nova] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:31:12.899675 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d8fb62-5726-4d0e-8c2e-3549fc866600 service nova] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:31:12.899950 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d8fb62-5726-4d0e-8c2e-3549fc866600 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:31:12.901624 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-c3d8fb62-5726-4d0e-8c2e-3549fc866600 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:31:12.988186 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d8fb62-5726-4d0e-8c2e-3549fc866600 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:31:12.989764 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d8fb62-5726-4d0e-8c2e-3549fc866600 service nova] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:31:13.007693 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 722/1419] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:31:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:31:13.885471 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83c3b2c-d43b-4f6a-a588-00234d20e3ff None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:31:13.886044 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83c3b2c-d43b-4f6a-a588-00234d20e3ff None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:31:13.886044 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83c3b2c-d43b-4f6a-a588-00234d20e3ff None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:31:13.887343 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 698/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 09:31:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:31:13.892949 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad430d06-013f-4d47-af06-a344bc0f1ae1 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:31:13.893394 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad430d06-013f-4d47-af06-a344bc0f1ae1 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:31:13.893553 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad430d06-013f-4d47-af06-a344bc0f1ae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:31:13.945351 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:31:13.967580 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-ad430d06-013f-4d47-af06-a344bc0f1ae1 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:31:13.968780 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-ad430d06-013f-4d47-af06-a344bc0f1ae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:31:14.063487 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 723/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 09:31:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:31:14.214211 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83c3b2c-d43b-4f6a-a588-00234d20e3ff None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:31:14.215740 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-e83c3b2c-d43b-4f6a-a588-00234d20e3ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:31:14.359903 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83c3b2c-d43b-4f6a-a588-00234d20e3ff None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:31:14.371677 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:31:14.470296 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e02c95d-2848-4317-86b5-4d512b765f52 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f6962106dfa4c4c9af551053f8095e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:31:14.470891 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e02c95d-2848-4317-86b5-4d512b765f52 service nova] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:31:14.471177 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e02c95d-2848-4317-86b5-4d512b765f52 service nova] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:31:14.471459 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e02c95d-2848-4317-86b5-4d512b765f52 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:31:14.473118 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-1e02c95d-2848-4317-86b5-4d512b765f52 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:31:14.563325 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e02c95d-2848-4317-86b5-4d512b765f52 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:31:14.564953 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e02c95d-2848-4317-86b5-4d512b765f52 service nova] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:31:14.583307 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 699/1422] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:31:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:31:15.445959 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceef76a-0f6a-44ef-9923-80dac8b8fcaa None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:31:15.446567 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceef76a-0f6a-44ef-9923-80dac8b8fcaa None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:31:15.446567 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceef76a-0f6a-44ef-9923-80dac8b8fcaa None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:31:15.447885 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 724/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 09:31:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:31:15.453354 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a38e64-96f1-4f5b-a1bc-4da115d0fd38 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:31:15.453795 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a38e64-96f1-4f5b-a1bc-4da115d0fd38 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:31:15.453919 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a38e64-96f1-4f5b-a1bc-4da115d0fd38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:31:15.472728 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:31:15.528622 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-53a38e64-96f1-4f5b-a1bc-4da115d0fd38 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:31:15.530425 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-53a38e64-96f1-4f5b-a1bc-4da115d0fd38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:31:15.625106 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 700/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 09:31:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:31:15.775835 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceef76a-0f6a-44ef-9923-80dac8b8fcaa None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:31:15.777259 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-3ceef76a-0f6a-44ef-9923-80dac8b8fcaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:31:15.883783 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:31:15.919357 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceef76a-0f6a-44ef-9923-80dac8b8fcaa None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:31:16.029276 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf1d547-d013-46ee-be44-244a1539619a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f6962106dfa4c4c9af551053f8095e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:31:16.029874 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf1d547-d013-46ee-be44-244a1539619a service nova] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:31:16.030158 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf1d547-d013-46ee-be44-244a1539619a service nova] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:31:16.030460 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf1d547-d013-46ee-be44-244a1539619a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:31:16.032118 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-ebf1d547-d013-46ee-be44-244a1539619a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:31:16.105692 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:31:16.120321 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf1d547-d013-46ee-be44-244a1539619a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:31:16.121912 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf1d547-d013-46ee-be44-244a1539619a service nova] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:31:16.140026 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 725/1425] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:31:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:31:16.999051 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0333def0-9ac6-4be9-8cf2-11900d99a44d None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:31:16.999643 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0333def0-9ac6-4be9-8cf2-11900d99a44d None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:31:16.999643 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0333def0-9ac6-4be9-8cf2-11900d99a44d None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:31:17.000969 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 701/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 09:31:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:31:17.005919 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3f2e86-4257-4ffd-b025-7ad753ad414c None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:31:17.007033 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3f2e86-4257-4ffd-b025-7ad753ad414c None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:31:17.007033 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3f2e86-4257-4ffd-b025-7ad753ad414c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:31:17.079822 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-2a3f2e86-4257-4ffd-b025-7ad753ad414c None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:31:17.081026 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-2a3f2e86-4257-4ffd-b025-7ad753ad414c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:31:17.176774 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 726/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 09:31:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:31:17.327266 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0333def0-9ac6-4be9-8cf2-11900d99a44d None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:31:17.328722 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-0333def0-9ac6-4be9-8cf2-11900d99a44d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:31:17.414896 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:31:17.484016 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0333def0-9ac6-4be9-8cf2-11900d99a44d None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:31:17.596446 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d47008c-9743-42c4-a88b-aaf27edf38c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f6962106dfa4c4c9af551053f8095e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:31:17.597043 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d47008c-9743-42c4-a88b-aaf27edf38c8 service nova] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:31:17.597423 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d47008c-9743-42c4-a88b-aaf27edf38c8 service nova] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:31:17.597698 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d47008c-9743-42c4-a88b-aaf27edf38c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:31:17.599380 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-8d47008c-9743-42c4-a88b-aaf27edf38c8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:31:17.647037 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:31:17.687769 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d47008c-9743-42c4-a88b-aaf27edf38c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:31:17.689383 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d47008c-9743-42c4-a88b-aaf27edf38c8 service nova] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:31:17.707811 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 702/1428] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:31:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:31:18.523983 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2401b23-5d8e-4163-b3a1-ccc087ce7bdd None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:31:18.524526 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2401b23-5d8e-4163-b3a1-ccc087ce7bdd None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:31:18.524634 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2401b23-5d8e-4163-b3a1-ccc087ce7bdd None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:31:18.525957 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 727/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 09:31:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:31:18.531141 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52294022-fe1e-4c13-bada-4a69f850dd50 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:31:18.531553 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52294022-fe1e-4c13-bada-4a69f850dd50 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:31:18.531697 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52294022-fe1e-4c13-bada-4a69f850dd50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:31:18.605027 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-52294022-fe1e-4c13-bada-4a69f850dd50 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:31:18.606159 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-52294022-fe1e-4c13-bada-4a69f850dd50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:31:18.710432 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 703/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 09:31:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:31:18.861008 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2401b23-5d8e-4163-b3a1-ccc087ce7bdd None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:31:18.862483 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-f2401b23-5d8e-4163-b3a1-ccc087ce7bdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:31:18.910633 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:31:19.006871 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2401b23-5d8e-4163-b3a1-ccc087ce7bdd None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:31:19.125461 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81153fde-ddcc-4f75-9a22-4c17dd2ff568 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f6962106dfa4c4c9af551053f8095e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:31:19.126018 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81153fde-ddcc-4f75-9a22-4c17dd2ff568 service nova] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:31:19.126339 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81153fde-ddcc-4f75-9a22-4c17dd2ff568 service nova] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:31:19.126619 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81153fde-ddcc-4f75-9a22-4c17dd2ff568 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:31:19.128277 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-81153fde-ddcc-4f75-9a22-4c17dd2ff568 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:31:19.135135 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:31:19.216802 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81153fde-ddcc-4f75-9a22-4c17dd2ff568 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:31:19.219053 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81153fde-ddcc-4f75-9a22-4c17dd2ff568 service nova] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:31:19.237067 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 728/1431] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:31:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:31:20.037964 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74985008-0cd2-4c48-a97d-ddd1f11519a9 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:31:20.038572 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74985008-0cd2-4c48-a97d-ddd1f11519a9 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:31:20.038864 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74985008-0cd2-4c48-a97d-ddd1f11519a9 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:31:20.040240 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 704/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 09:31:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:31:20.045194 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28fead2-1459-4b6b-9d43-33462cb500b5 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:31:20.045623 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28fead2-1459-4b6b-9d43-33462cb500b5 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:31:20.045784 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28fead2-1459-4b6b-9d43-33462cb500b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:31:20.118923 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-b28fead2-1459-4b6b-9d43-33462cb500b5 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:31:20.120047 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-b28fead2-1459-4b6b-9d43-33462cb500b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:31:20.187787 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:31:20.216865 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 729/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 09:31:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:31:20.366567 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74985008-0cd2-4c48-a97d-ddd1f11519a9 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:31:20.368082 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-74985008-0cd2-4c48-a97d-ddd1f11519a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:31:20.385938 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:31:20.519279 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74985008-0cd2-4c48-a97d-ddd1f11519a9 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:31:20.605093 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:31:20.632802 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e57c2ff-2d21-492a-afec-ead61ab2f1c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f6962106dfa4c4c9af551053f8095e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:31:20.633459 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e57c2ff-2d21-492a-afec-ead61ab2f1c0 service nova] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:31:20.633744 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e57c2ff-2d21-492a-afec-ead61ab2f1c0 service nova] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:31:20.634028 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e57c2ff-2d21-492a-afec-ead61ab2f1c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:31:20.635712 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-5e57c2ff-2d21-492a-afec-ead61ab2f1c0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:31:20.731734 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e57c2ff-2d21-492a-afec-ead61ab2f1c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:31:20.734051 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e57c2ff-2d21-492a-afec-ead61ab2f1c0 service nova] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:31:20.753380 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 705/1434] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:31:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:31:21.547276 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffb5aa6-f743-42ad-b33c-38a5b382ba54 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:31:21.547795 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffb5aa6-f743-42ad-b33c-38a5b382ba54 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:31:21.547904 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffb5aa6-f743-42ad-b33c-38a5b382ba54 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:31:21.549234 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 730/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 09:31:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:31:21.554396 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c2c0fd-df90-4d47-a580-4bfdc057efe1 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:31:21.554808 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c2c0fd-df90-4d47-a580-4bfdc057efe1 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:31:21.554961 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c2c0fd-df90-4d47-a580-4bfdc057efe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:31:21.629350 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-99c2c0fd-df90-4d47-a580-4bfdc057efe1 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:31:21.630590 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-99c2c0fd-df90-4d47-a580-4bfdc057efe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:31:21.672216 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:31:21.727046 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 706/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 09:31:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:31:21.879201 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffb5aa6-f743-42ad-b33c-38a5b382ba54 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:31:21.881093 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-9ffb5aa6-f743-42ad-b33c-38a5b382ba54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:31:22.024528 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffb5aa6-f743-42ad-b33c-38a5b382ba54 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:31:22.076687 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:31:22.136044 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecc9936-a016-4348-a4ef-6784d4dd0434 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f6962106dfa4c4c9af551053f8095e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:31:22.136622 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecc9936-a016-4348-a4ef-6784d4dd0434 service nova] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:31:22.136910 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecc9936-a016-4348-a4ef-6784d4dd0434 service nova] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:31:22.137188 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecc9936-a016-4348-a4ef-6784d4dd0434 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:31:22.138862 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-cecc9936-a016-4348-a4ef-6784d4dd0434 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:31:22.225491 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecc9936-a016-4348-a4ef-6784d4dd0434 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:31:22.227124 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecc9936-a016-4348-a4ef-6784d4dd0434 service nova] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:31:22.245420 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 731/1437] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:31:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:31:23.058865 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41acbff8-85cf-4dbb-836a-d978aa833f90 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:31:23.059436 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41acbff8-85cf-4dbb-836a-d978aa833f90 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:31:23.059436 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41acbff8-85cf-4dbb-836a-d978aa833f90 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:31:23.060815 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 707/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 09:31:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:31:23.065837 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7da854-66f0-4ea3-8b97-c3417e67e795 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:31:23.066283 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7da854-66f0-4ea3-8b97-c3417e67e795 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:31:23.066435 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7da854-66f0-4ea3-8b97-c3417e67e795 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:31:23.140414 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-fe7da854-66f0-4ea3-8b97-c3417e67e795 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:31:23.141610 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-fe7da854-66f0-4ea3-8b97-c3417e67e795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:31:23.143626 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:31:23.239243 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 732/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 09:31:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:31:23.396225 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41acbff8-85cf-4dbb-836a-d978aa833f90 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:31:23.397832 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-41acbff8-85cf-4dbb-836a-d978aa833f90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:31:23.543176 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41acbff8-85cf-4dbb-836a-d978aa833f90 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:31:23.569889 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:31:23.655867 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e2a46a-1a07-40ea-9060-08301aabf5cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f6962106dfa4c4c9af551053f8095e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:31:23.656451 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e2a46a-1a07-40ea-9060-08301aabf5cc service nova] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:31:23.657226 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e2a46a-1a07-40ea-9060-08301aabf5cc service nova] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:31:23.657226 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e2a46a-1a07-40ea-9060-08301aabf5cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:31:23.661414 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-29e2a46a-1a07-40ea-9060-08301aabf5cc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:31:23.752668 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e2a46a-1a07-40ea-9060-08301aabf5cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:31:23.754379 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e2a46a-1a07-40ea-9060-08301aabf5cc service nova] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:31:23.772338 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 708/1440] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:31:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:31:25.696029 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee03997-d065-4c62-bf5b-d37d87935495 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:31:25.696585 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee03997-d065-4c62-bf5b-d37d87935495 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:31:25.696585 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee03997-d065-4c62-bf5b-d37d87935495 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:31:25.697947 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 733/1441] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 09:31:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:31:25.703731 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61288602-b3cd-4f4e-a5bc-ae011a723d3f None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:31:25.704159 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61288602-b3cd-4f4e-a5bc-ae011a723d3f None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:31:25.704343 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61288602-b3cd-4f4e-a5bc-ae011a723d3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:31:25.743655 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:31:25.769475 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-61288602-b3cd-4f4e-a5bc-ae011a723d3f None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:31:25.770718 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-61288602-b3cd-4f4e-a5bc-ae011a723d3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:31:25.866510 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 709/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 09:31:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:31:25.903753 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee03997-d065-4c62-bf5b-d37d87935495 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:31:25.905879 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-3ee03997-d065-4c62-bf5b-d37d87935495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:31:26.005690 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee03997-d065-4c62-bf5b-d37d87935495 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:31:26.037819 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:31:26.078289 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850bd680-da58-4a81-8ff7-54cd81297d9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e4a5a8965e4802a9055d332179b7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:31:26.078938 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850bd680-da58-4a81-8ff7-54cd81297d9f service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:31:26.079224 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850bd680-da58-4a81-8ff7-54cd81297d9f service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:31:26.079499 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850bd680-da58-4a81-8ff7-54cd81297d9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:31:26.081139 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-850bd680-da58-4a81-8ff7-54cd81297d9f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:31:26.188535 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850bd680-da58-4a81-8ff7-54cd81297d9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:31:26.189963 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850bd680-da58-4a81-8ff7-54cd81297d9f service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:31:26.209724 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 734/1443] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:31:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:31:28.381355 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff00f85-1578-4e30-abca-9884f32297a6 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:31:28.381931 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff00f85-1578-4e30-abca-9884f32297a6 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:31:28.381931 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff00f85-1578-4e30-abca-9884f32297a6 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:31:28.383299 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 710/1444] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 09:31:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:31:28.388600 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b02664a-dc75-45c4-872e-f6fcc718f867 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:31:28.389057 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b02664a-dc75-45c4-872e-f6fcc718f867 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:31:28.389164 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b02664a-dc75-45c4-872e-f6fcc718f867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:31:28.452967 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-7b02664a-dc75-45c4-872e-f6fcc718f867 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:31:28.454162 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-7b02664a-dc75-45c4-872e-f6fcc718f867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:31:28.466563 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:31:28.555802 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 735/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 09:31:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:31:28.595413 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff00f85-1578-4e30-abca-9884f32297a6 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:31:28.596941 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-8ff00f85-1578-4e30-abca-9884f32297a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:31:28.713908 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff00f85-1578-4e30-abca-9884f32297a6 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:31:28.731125 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:31:28.802081 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d6d4b9-a056-4bf5-8a69-f280c4d76d54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e4a5a8965e4802a9055d332179b7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:31:28.802772 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d6d4b9-a056-4bf5-8a69-f280c4d76d54 service neutron] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:31:28.803056 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d6d4b9-a056-4bf5-8a69-f280c4d76d54 service neutron] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:31:28.803340 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d6d4b9-a056-4bf5-8a69-f280c4d76d54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:31:28.805118 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-60d6d4b9-a056-4bf5-8a69-f280c4d76d54 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:31:28.927297 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d6d4b9-a056-4bf5-8a69-f280c4d76d54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:31:28.928913 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d6d4b9-a056-4bf5-8a69-f280c4d76d54 service neutron] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:31:28.948430 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 711/1446] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:31:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:31:31.307361 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3611e26-38f2-412b-80ce-5f852e499c97 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:31:31.307890 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3611e26-38f2-412b-80ce-5f852e499c97 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:31:31.307989 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3611e26-38f2-412b-80ce-5f852e499c97 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:31:31.309297 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 736/1447] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 09:31:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:31:31.314593 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7258695-02ee-4740-9220-5b31327bee3c None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:31:31.315016 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7258695-02ee-4740-9220-5b31327bee3c None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:31:31.315154 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7258695-02ee-4740-9220-5b31327bee3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:31:31.361808 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:31:31.379977 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-c7258695-02ee-4740-9220-5b31327bee3c None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:31:31.381219 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-c7258695-02ee-4740-9220-5b31327bee3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:31:31.476800 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 712/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 09:31:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:31:31.515968 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3611e26-38f2-412b-80ce-5f852e499c97 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:31:31.517488 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-d3611e26-38f2-412b-80ce-5f852e499c97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:31:31.618663 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3611e26-38f2-412b-80ce-5f852e499c97 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:31:31.658479 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:31:31.691842 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98822e6d-cd98-4c76-a982-40ba74cf0aa1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e4a5a8965e4802a9055d332179b7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:31:31.692493 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98822e6d-cd98-4c76-a982-40ba74cf0aa1 service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:31:31.692784 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98822e6d-cd98-4c76-a982-40ba74cf0aa1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:31:31.693059 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98822e6d-cd98-4c76-a982-40ba74cf0aa1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:31:31.694723 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-98822e6d-cd98-4c76-a982-40ba74cf0aa1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:31:31.801559 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98822e6d-cd98-4c76-a982-40ba74cf0aa1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:31:31.803025 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98822e6d-cd98-4c76-a982-40ba74cf0aa1 service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:31:31.821751 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 737/1449] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:31:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:31:33.941362 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38322227-64fe-4feb-8063-76ce9c3aff89 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:31:33.941919 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38322227-64fe-4feb-8063-76ce9c3aff89 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:31:33.941919 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38322227-64fe-4feb-8063-76ce9c3aff89 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:31:33.943359 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 713/1450] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 09:31:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:31:33.948692 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f8f376-116c-4030-9721-5d6ac56c0150 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:31:33.949097 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f8f376-116c-4030-9721-5d6ac56c0150 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:31:33.949258 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f8f376-116c-4030-9721-5d6ac56c0150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:31:34.012846 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-95f8f376-116c-4030-9721-5d6ac56c0150 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:31:34.014076 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-95f8f376-116c-4030-9721-5d6ac56c0150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:31:34.034819 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:31:34.112417 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 738/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 09:31:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:31:34.150646 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38322227-64fe-4feb-8063-76ce9c3aff89 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:31:34.152674 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-38322227-64fe-4feb-8063-76ce9c3aff89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:31:34.256037 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38322227-64fe-4feb-8063-76ce9c3aff89 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:31:34.276494 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:31:34.330027 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a90e14c-33e3-44c7-809a-89b4f27e0915 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e4a5a8965e4802a9055d332179b7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:31:34.330720 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a90e14c-33e3-44c7-809a-89b4f27e0915 service neutron] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:31:34.331012 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a90e14c-33e3-44c7-809a-89b4f27e0915 service neutron] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:31:34.331296 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a90e14c-33e3-44c7-809a-89b4f27e0915 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:31:34.333229 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-6a90e14c-33e3-44c7-809a-89b4f27e0915 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:31:34.441674 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a90e14c-33e3-44c7-809a-89b4f27e0915 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:31:34.443152 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a90e14c-33e3-44c7-809a-89b4f27e0915 service neutron] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:31:34.463417 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 714/1452] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:31:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:31:36.536837 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e150b55-68c3-4654-8897-0bab0530b243 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:31:36.537367 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e150b55-68c3-4654-8897-0bab0530b243 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:31:36.537367 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e150b55-68c3-4654-8897-0bab0530b243 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:31:36.538772 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 739/1453] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 09:31:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:31:36.543827 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a42ce84-483a-411b-b40a-7f9e431e828f None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:31:36.544231 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a42ce84-483a-411b-b40a-7f9e431e828f None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:31:36.544376 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a42ce84-483a-411b-b40a-7f9e431e828f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:31:36.613813 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:31:36.616707 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-8a42ce84-483a-411b-b40a-7f9e431e828f None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:31:36.618622 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-8a42ce84-483a-411b-b40a-7f9e431e828f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:31:36.714078 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 715/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 09:31:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:31:36.751509 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e150b55-68c3-4654-8897-0bab0530b243 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:31:36.753042 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-5e150b55-68c3-4654-8897-0bab0530b243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:31:36.855494 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e150b55-68c3-4654-8897-0bab0530b243 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:31:36.902969 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:31:36.927118 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843a11e1-75a2-4a8a-b947-bcf6e3505994 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e4a5a8965e4802a9055d332179b7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:31:36.927767 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843a11e1-75a2-4a8a-b947-bcf6e3505994 service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:31:36.928058 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843a11e1-75a2-4a8a-b947-bcf6e3505994 service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:31:36.928333 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843a11e1-75a2-4a8a-b947-bcf6e3505994 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:31:36.929965 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-843a11e1-75a2-4a8a-b947-bcf6e3505994 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:31:37.038454 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843a11e1-75a2-4a8a-b947-bcf6e3505994 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:31:37.039890 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843a11e1-75a2-4a8a-b947-bcf6e3505994 service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:31:37.057844 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 740/1455] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:31:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:31:39.111995 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c651d2-43ef-4b06-8fd2-16d13218a0dc None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:31:39.112534 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c651d2-43ef-4b06-8fd2-16d13218a0dc None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:31:39.112534 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c651d2-43ef-4b06-8fd2-16d13218a0dc None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:31:39.113982 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 716/1456] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 09:31:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:31:39.119688 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784fc385-936d-4585-bc91-bd1d2c534c4c None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:31:39.120134 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784fc385-936d-4585-bc91-bd1d2c534c4c None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:31:39.120256 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784fc385-936d-4585-bc91-bd1d2c534c4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:31:39.184065 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-784fc385-936d-4585-bc91-bd1d2c534c4c None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:31:39.185254 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-784fc385-936d-4585-bc91-bd1d2c534c4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:31:39.214703 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:31:39.282677 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 741/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 09:31:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 09:31:39.319697 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c651d2-43ef-4b06-8fd2-16d13218a0dc None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:31:39.321207 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-d3c651d2-43ef-4b06-8fd2-16d13218a0dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:31:39.427625 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c651d2-43ef-4b06-8fd2-16d13218a0dc None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:31:39.455141 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:31:39.500357 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a0a46a-87d7-4279-b03e-cc90f448605c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e4a5a8965e4802a9055d332179b7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:31:39.501008 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a0a46a-87d7-4279-b03e-cc90f448605c service neutron] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:31:39.501290 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a0a46a-87d7-4279-b03e-cc90f448605c service neutron] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:31:39.501565 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a0a46a-87d7-4279-b03e-cc90f448605c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:31:39.503225 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-25a0a46a-87d7-4279-b03e-cc90f448605c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:31:39.610532 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a0a46a-87d7-4279-b03e-cc90f448605c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:31:39.611987 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a0a46a-87d7-4279-b03e-cc90f448605c service neutron] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:31:39.630373 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 717/1458] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:31:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:31:41.723962 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea4795a-913d-4d5e-8d3a-2a7d90219182 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:31:41.724487 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea4795a-913d-4d5e-8d3a-2a7d90219182 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:31:41.724601 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea4795a-913d-4d5e-8d3a-2a7d90219182 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:31:41.725916 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 742/1459] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 09:31:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:31:41.731331 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e088d0-309f-4b97-854d-0da5c9422c95 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:31:41.731769 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e088d0-309f-4b97-854d-0da5c9422c95 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:31:41.731890 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e088d0-309f-4b97-854d-0da5c9422c95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:31:41.799433 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-59e088d0-309f-4b97-854d-0da5c9422c95 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:31:41.800632 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-59e088d0-309f-4b97-854d-0da5c9422c95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:31:41.808840 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:31:41.897290 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 718/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 09:31:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:31:41.934794 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea4795a-913d-4d5e-8d3a-2a7d90219182 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:31:41.936882 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-cea4795a-913d-4d5e-8d3a-2a7d90219182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:31:42.040217 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea4795a-913d-4d5e-8d3a-2a7d90219182 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:31:42.099781 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:31:42.122907 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaec1f78-cb1b-4451-aa53-35fc96e936ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e4a5a8965e4802a9055d332179b7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:31:42.123569 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaec1f78-cb1b-4451-aa53-35fc96e936ff service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:31:42.123858 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaec1f78-cb1b-4451-aa53-35fc96e936ff service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:31:42.124140 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaec1f78-cb1b-4451-aa53-35fc96e936ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:31:42.125827 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-eaec1f78-cb1b-4451-aa53-35fc96e936ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:31:42.234916 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaec1f78-cb1b-4451-aa53-35fc96e936ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:31:42.236352 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaec1f78-cb1b-4451-aa53-35fc96e936ff service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:31:42.254626 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 743/1461] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:31:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:31:44.316712 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868a138e-de6b-4b9c-8afa-f0dff4a98020 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:31:44.317375 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868a138e-de6b-4b9c-8afa-f0dff4a98020 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:31:44.317375 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868a138e-de6b-4b9c-8afa-f0dff4a98020 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:31:44.318678 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 719/1462] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 09:31:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:31:44.323859 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f1793a-ab8d-42a4-af8e-89f15bda6df1 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:31:44.324315 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f1793a-ab8d-42a4-af8e-89f15bda6df1 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:31:44.324419 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f1793a-ab8d-42a4-af8e-89f15bda6df1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:31:44.389137 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-49f1793a-ab8d-42a4-af8e-89f15bda6df1 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:31:44.390380 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-49f1793a-ab8d-42a4-af8e-89f15bda6df1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:31:44.428662 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:31:44.487497 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 744/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 09:31:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:31:44.524919 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868a138e-de6b-4b9c-8afa-f0dff4a98020 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:31:44.526500 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-868a138e-de6b-4b9c-8afa-f0dff4a98020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:31:44.628851 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868a138e-de6b-4b9c-8afa-f0dff4a98020 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:31:44.667025 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:31:44.702764 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebd57dc-b9c3-41fb-9648-454f0bc8be5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e4a5a8965e4802a9055d332179b7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:31:44.703421 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebd57dc-b9c3-41fb-9648-454f0bc8be5d service neutron] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:31:44.703714 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebd57dc-b9c3-41fb-9648-454f0bc8be5d service neutron] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:31:44.703996 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebd57dc-b9c3-41fb-9648-454f0bc8be5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:31:44.706155 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-2ebd57dc-b9c3-41fb-9648-454f0bc8be5d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:31:44.815007 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebd57dc-b9c3-41fb-9648-454f0bc8be5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:31:44.816481 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebd57dc-b9c3-41fb-9648-454f0bc8be5d service neutron] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:31:44.834685 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 720/1464] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:31:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:31:46.857485 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa480b8-b810-4caa-891a-869f1447fd4c None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:31:46.858007 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa480b8-b810-4caa-891a-869f1447fd4c None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:31:46.858007 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa480b8-b810-4caa-891a-869f1447fd4c None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:31:46.859378 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 745/1465] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 09:31:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:31:46.864491 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69650020-e5e8-41c6-b0ab-cb7f04f21ef5 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:31:46.864891 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69650020-e5e8-41c6-b0ab-cb7f04f21ef5 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:31:46.865048 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69650020-e5e8-41c6-b0ab-cb7f04f21ef5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:31:46.928438 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-69650020-e5e8-41c6-b0ab-cb7f04f21ef5 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:31:46.929643 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-69650020-e5e8-41c6-b0ab-cb7f04f21ef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:31:46.947726 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:31:47.026412 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 721/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 09:31:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:31:47.063137 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa480b8-b810-4caa-891a-869f1447fd4c None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:31:47.064656 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-dfa480b8-b810-4caa-891a-869f1447fd4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:31:47.167776 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa480b8-b810-4caa-891a-869f1447fd4c None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:31:47.234362 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:31:47.241378 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0440d2e3-61a5-4e3a-abca-d4d23617d38e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e4a5a8965e4802a9055d332179b7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:31:47.242024 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0440d2e3-61a5-4e3a-abca-d4d23617d38e service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:31:47.242336 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0440d2e3-61a5-4e3a-abca-d4d23617d38e service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:31:47.242619 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0440d2e3-61a5-4e3a-abca-d4d23617d38e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:31:47.244234 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-0440d2e3-61a5-4e3a-abca-d4d23617d38e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:31:47.350520 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0440d2e3-61a5-4e3a-abca-d4d23617d38e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:31:47.351964 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0440d2e3-61a5-4e3a-abca-d4d23617d38e service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:31:47.370647 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 746/1467] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:31:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:31:49.401796 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b960d21-3b18-4ad6-a4bd-a1a056cb959d None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:31:49.402412 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b960d21-3b18-4ad6-a4bd-a1a056cb959d None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:31:49.402412 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b960d21-3b18-4ad6-a4bd-a1a056cb959d None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:31:49.404327 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 722/1468] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 09:31:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:31:49.409522 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20dd1d0-b4df-4f43-9d6a-a765324db602 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:31:49.409948 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20dd1d0-b4df-4f43-9d6a-a765324db602 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:31:49.410081 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20dd1d0-b4df-4f43-9d6a-a765324db602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:31:49.475180 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-c20dd1d0-b4df-4f43-9d6a-a765324db602 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:31:49.476394 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-c20dd1d0-b4df-4f43-9d6a-a765324db602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:31:49.527723 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:31:49.577296 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 747/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 09:31:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:31:49.612524 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b960d21-3b18-4ad6-a4bd-a1a056cb959d None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:31:49.614093 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-1b960d21-3b18-4ad6-a4bd-a1a056cb959d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:31:49.719644 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b960d21-3b18-4ad6-a4bd-a1a056cb959d None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:31:49.767482 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:31:49.795198 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3b8c84-b24c-4214-9ade-86b5b7783fa0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e4a5a8965e4802a9055d332179b7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:31:49.795874 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3b8c84-b24c-4214-9ade-86b5b7783fa0 service neutron] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:31:49.796146 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3b8c84-b24c-4214-9ade-86b5b7783fa0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:31:49.796426 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3b8c84-b24c-4214-9ade-86b5b7783fa0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:31:49.798134 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-5b3b8c84-b24c-4214-9ade-86b5b7783fa0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:31:49.917371 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3b8c84-b24c-4214-9ade-86b5b7783fa0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:31:49.918865 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3b8c84-b24c-4214-9ade-86b5b7783fa0 service neutron] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:31:49.937145 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 723/1470] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:31:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:31:59.575423 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=22 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:31:59.934870 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=66 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:32:09.702790 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcae8528-e00f-4518-8ad0-f2adc49171c3 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:32:09.703357 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcae8528-e00f-4518-8ad0-f2adc49171c3 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:32:09.703357 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcae8528-e00f-4518-8ad0-f2adc49171c3 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:32:09.705015 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 748/1471] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:32:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:32:09.710233 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e348d047-fbe3-4793-aa9e-6cd0d7aba7e6 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:32:09.710712 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e348d047-fbe3-4793-aa9e-6cd0d7aba7e6 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:32:09.710817 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e348d047-fbe3-4793-aa9e-6cd0d7aba7e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:32:09.778280 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-e348d047-fbe3-4793-aa9e-6cd0d7aba7e6 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:32:09.779489 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-e348d047-fbe3-4793-aa9e-6cd0d7aba7e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:32:09.889175 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 724/1472] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:32:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:32:09.976043 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a290cb7-37bf-45ba-87e9-4eedd8193473 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:32:09.976329 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a290cb7-37bf-45ba-87e9-4eedd8193473 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:32:09.976608 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a290cb7-37bf-45ba-87e9-4eedd8193473 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:32:09.978424 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 749/1473] 10.222.0.40 () {54 vars in 962 bytes} [Thu Jul 14 09:32:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:32:09.983784 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6371d02c-f3a3-4e2f-9147-d2d97ad6ba19 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:32:09.984077 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6371d02c-f3a3-4e2f-9147-d2d97ad6ba19 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:32:09.984356 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6371d02c-f3a3-4e2f-9147-d2d97ad6ba19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:32:10.062126 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-6371d02c-f3a3-4e2f-9147-d2d97ad6ba19 None None] MFA Rules not processed for user `7ba461800d6845e6a767c83777ae5213`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:32:10.063395 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-6371d02c-f3a3-4e2f-9147-d2d97ad6ba19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:32:10.084944 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:32:10.144202 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 725/1474] 10.222.0.40 () {58 vars in 1059 bytes} [Thu Jul 14 09:32:09 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:32:10.154275 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a290cb7-37bf-45ba-87e9-4eedd8193473 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:32:10.155856 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-7a290cb7-37bf-45ba-87e9-4eedd8193473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:32:10.266368 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a290cb7-37bf-45ba-87e9-4eedd8193473 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:32:10.342811 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b6b8be-a839-461a-9851-ca843a211b43 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba461800d6845e6a767c83777ae5213', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:32:10.343403 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b6b8be-a839-461a-9851-ca843a211b43 service glance] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:32:10.343692 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b6b8be-a839-461a-9851-ca843a211b43 service glance] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:32:10.343971 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b6b8be-a839-461a-9851-ca843a211b43 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:32:10.345618 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-91b6b8be-a839-461a-9851-ca843a211b43 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:32:10.402598 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:32:10.458968 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b6b8be-a839-461a-9851-ca843a211b43 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:32:10.460407 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b6b8be-a839-461a-9851-ca843a211b43 service glance] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:32:10.478648 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 750/1475] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:32:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:32:12.627466 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1406651a-5c38-4324-8af1-01c8d4952673 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:32:12.627988 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1406651a-5c38-4324-8af1-01c8d4952673 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:32:12.628083 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1406651a-5c38-4324-8af1-01c8d4952673 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:32:12.629421 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 726/1476] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:32:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:32:12.634891 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43183273-e4b0-4d8f-b7a1-777cbe3927d7 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:32:12.635322 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43183273-e4b0-4d8f-b7a1-777cbe3927d7 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:32:12.635433 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43183273-e4b0-4d8f-b7a1-777cbe3927d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:32:12.703892 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-43183273-e4b0-4d8f-b7a1-777cbe3927d7 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:32:12.705279 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-43183273-e4b0-4d8f-b7a1-777cbe3927d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:32:12.806422 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 751/1477] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:32:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:32:12.829928 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1406651a-5c38-4324-8af1-01c8d4952673 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:32:12.831422 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-1406651a-5c38-4324-8af1-01c8d4952673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:32:12.971483 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1406651a-5c38-4324-8af1-01c8d4952673 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:32:13.021881 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:32:13.069379 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1536254a-9b5a-4ff1-9213-d9737e2cea3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:32:13.070056 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1536254a-9b5a-4ff1-9213-d9737e2cea3f admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:32:13.070443 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1536254a-9b5a-4ff1-9213-d9737e2cea3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:32:13.070722 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1536254a-9b5a-4ff1-9213-d9737e2cea3f admin admin] PATH_INFO: `/v3/projects` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:32:13.071464 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1536254a-9b5a-4ff1-9213-d9737e2cea3f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:32:13.073275 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: WARNING py.warnings [None req-1536254a-9b5a-4ff1-9213-d9737e2cea3f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 09:32:13.073275 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: warnings.warn(msg) Jul 14 09:32:13.073275 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: Jul 14 09:32:13.075018 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1536254a-9b5a-4ff1-9213-d9737e2cea3f admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:32:13.095708 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 727/1478] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 09:32:12 2022] GET /identity/v3/projects => generated 2553 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:32:15.156608 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d1e590-1f54-474a-96e7-476688d1dbc9 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:32:15.157265 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d1e590-1f54-474a-96e7-476688d1dbc9 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:32:15.157265 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d1e590-1f54-474a-96e7-476688d1dbc9 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:32:15.158570 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 752/1479] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:32:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:32:15.163753 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3653075-dd4f-44c4-b7b0-a549ab4a5599 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:32:15.164190 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3653075-dd4f-44c4-b7b0-a549ab4a5599 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:32:15.164294 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3653075-dd4f-44c4-b7b0-a549ab4a5599 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:32:15.228871 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-e3653075-dd4f-44c4-b7b0-a549ab4a5599 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:32:15.230118 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-e3653075-dd4f-44c4-b7b0-a549ab4a5599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:32:15.326326 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 728/1480] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:32:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:32:15.368583 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d1e590-1f54-474a-96e7-476688d1dbc9 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:32:15.370177 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-d2d1e590-1f54-474a-96e7-476688d1dbc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:32:15.379916 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:32:15.521008 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d1e590-1f54-474a-96e7-476688d1dbc9 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:32:15.601357 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:32:15.634326 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d714f859-60f5-4b12-8849-64791c67f1c7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f6962106dfa4c4c9af551053f8095e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:32:15.634978 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d714f859-60f5-4b12-8849-64791c67f1c7 service nova] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:32:15.635262 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d714f859-60f5-4b12-8849-64791c67f1c7 service nova] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:32:15.635543 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d714f859-60f5-4b12-8849-64791c67f1c7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:32:15.637699 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-d714f859-60f5-4b12-8849-64791c67f1c7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:32:15.725510 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d714f859-60f5-4b12-8849-64791c67f1c7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:32:15.727112 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d714f859-60f5-4b12-8849-64791c67f1c7 service nova] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:32:15.744791 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 753/1481] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:32:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:32:17.965887 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9185612c-67ce-41cd-8fbc-b559dc331b98 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:32:17.966493 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9185612c-67ce-41cd-8fbc-b559dc331b98 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:32:17.966493 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9185612c-67ce-41cd-8fbc-b559dc331b98 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:32:17.967861 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 729/1482] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:32:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:32:17.973145 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3f2249-7532-4d21-84ed-e5ff11dee670 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:32:17.973539 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3f2249-7532-4d21-84ed-e5ff11dee670 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:32:17.973706 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3f2249-7532-4d21-84ed-e5ff11dee670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:32:18.037180 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-5d3f2249-7532-4d21-84ed-e5ff11dee670 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:32:18.038433 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-5d3f2249-7532-4d21-84ed-e5ff11dee670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:32:18.084638 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:32:18.135122 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 754/1483] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:32:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:32:18.172596 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9185612c-67ce-41cd-8fbc-b559dc331b98 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:32:18.174142 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-9185612c-67ce-41cd-8fbc-b559dc331b98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:32:18.197004 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:32:18.278225 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9185612c-67ce-41cd-8fbc-b559dc331b98 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:32:18.350257 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad9f594-c9e8-4bed-a28e-f4365b49fcde service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e4a5a8965e4802a9055d332179b7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:32:18.350910 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad9f594-c9e8-4bed-a28e-f4365b49fcde service neutron] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:32:18.351195 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad9f594-c9e8-4bed-a28e-f4365b49fcde service neutron] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:32:18.351476 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad9f594-c9e8-4bed-a28e-f4365b49fcde service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:32:18.353385 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-aad9f594-c9e8-4bed-a28e-f4365b49fcde service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:32:18.426280 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:32:18.461548 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad9f594-c9e8-4bed-a28e-f4365b49fcde service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:32:18.463017 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad9f594-c9e8-4bed-a28e-f4365b49fcde service neutron] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:32:18.481708 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 730/1484] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:32:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:32:20.558458 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c699f10-c84f-4423-8dec-e8481583c65b None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:32:20.558997 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c699f10-c84f-4423-8dec-e8481583c65b None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:32:20.558997 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c699f10-c84f-4423-8dec-e8481583c65b None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:32:20.560364 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 755/1485] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:32:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:32:20.565761 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce597411-b24c-47ad-9b16-deb89cf6ce8a None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:32:20.566234 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce597411-b24c-47ad-9b16-deb89cf6ce8a None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:32:20.566361 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce597411-b24c-47ad-9b16-deb89cf6ce8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:32:20.631969 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-ce597411-b24c-47ad-9b16-deb89cf6ce8a None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:32:20.633174 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-ce597411-b24c-47ad-9b16-deb89cf6ce8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:32:20.731169 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 731/1486] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:32:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:32:20.769425 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c699f10-c84f-4423-8dec-e8481583c65b None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:32:20.771008 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-2c699f10-c84f-4423-8dec-e8481583c65b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:32:20.873805 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c699f10-c84f-4423-8dec-e8481583c65b None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:32:20.943753 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:32:20.945683 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7e3c47-0fba-4197-b4a1-6bb1f24d28a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e4a5a8965e4802a9055d332179b7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:32:20.946374 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7e3c47-0fba-4197-b4a1-6bb1f24d28a1 service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:32:20.946710 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7e3c47-0fba-4197-b4a1-6bb1f24d28a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:32:20.946943 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7e3c47-0fba-4197-b4a1-6bb1f24d28a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:32:20.949783 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-dd7e3c47-0fba-4197-b4a1-6bb1f24d28a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:32:21.064062 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7e3c47-0fba-4197-b4a1-6bb1f24d28a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:32:21.065407 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7e3c47-0fba-4197-b4a1-6bb1f24d28a1 service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:32:21.084283 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 756/1487] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:32:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:32:23.251102 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d8bab0-d685-4ef7-ab41-32a1054dc774 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:32:23.251679 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d8bab0-d685-4ef7-ab41-32a1054dc774 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:32:23.251679 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d8bab0-d685-4ef7-ab41-32a1054dc774 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:32:23.253030 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 732/1488] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:32:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:32:23.258108 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a063e0c1-538b-45fc-b383-2a2f252694ec None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:32:23.258533 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a063e0c1-538b-45fc-b383-2a2f252694ec None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:32:23.258694 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a063e0c1-538b-45fc-b383-2a2f252694ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:32:23.322052 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-a063e0c1-538b-45fc-b383-2a2f252694ec None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:32:23.323831 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-a063e0c1-538b-45fc-b383-2a2f252694ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:32:23.377763 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:32:23.421580 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 757/1489] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:32:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:32:23.461847 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d8bab0-d685-4ef7-ab41-32a1054dc774 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:32:23.463405 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-b0d8bab0-d685-4ef7-ab41-32a1054dc774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:32:23.500591 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:32:23.567106 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d8bab0-d685-4ef7-ab41-32a1054dc774 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:32:23.640101 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715ce7a2-5cd3-4e80-9e42-51a4b3ef2527 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e4a5a8965e4802a9055d332179b7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:32:23.640754 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715ce7a2-5cd3-4e80-9e42-51a4b3ef2527 service neutron] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:32:23.641041 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715ce7a2-5cd3-4e80-9e42-51a4b3ef2527 service neutron] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:32:23.641315 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715ce7a2-5cd3-4e80-9e42-51a4b3ef2527 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:32:23.643004 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-715ce7a2-5cd3-4e80-9e42-51a4b3ef2527 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:32:23.722799 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:32:23.754277 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715ce7a2-5cd3-4e80-9e42-51a4b3ef2527 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:32:23.755729 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715ce7a2-5cd3-4e80-9e42-51a4b3ef2527 service neutron] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:32:23.773993 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 733/1490] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:32:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:32:25.969938 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075e58a8-2e5e-4a22-a95d-b3559fb2539f None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:32:25.970531 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075e58a8-2e5e-4a22-a95d-b3559fb2539f None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:32:25.970531 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075e58a8-2e5e-4a22-a95d-b3559fb2539f None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:32:25.971910 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 758/1491] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 09:32:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:32:25.977466 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ed4fea-01f0-489f-8542-bc8c892a73c3 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:32:25.977885 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ed4fea-01f0-489f-8542-bc8c892a73c3 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:32:25.978030 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ed4fea-01f0-489f-8542-bc8c892a73c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:32:26.042511 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-46ed4fea-01f0-489f-8542-bc8c892a73c3 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:32:26.043708 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-46ed4fea-01f0-489f-8542-bc8c892a73c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:32:26.138632 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 734/1492] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 09:32:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:32:26.176995 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075e58a8-2e5e-4a22-a95d-b3559fb2539f None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:32:26.178555 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-075e58a8-2e5e-4a22-a95d-b3559fb2539f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:32:26.280848 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075e58a8-2e5e-4a22-a95d-b3559fb2539f None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:32:26.351645 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5373e9-d908-4d17-87fc-0450afc98437 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e4a5a8965e4802a9055d332179b7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:32:26.352538 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5373e9-d908-4d17-87fc-0450afc98437 service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:32:26.352819 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5373e9-d908-4d17-87fc-0450afc98437 service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:32:26.353090 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5373e9-d908-4d17-87fc-0450afc98437 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:32:26.355429 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-cb5373e9-d908-4d17-87fc-0450afc98437 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:32:26.364381 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:32:26.461231 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5373e9-d908-4d17-87fc-0450afc98437 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:32:26.462700 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5373e9-d908-4d17-87fc-0450afc98437 service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:32:26.481542 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 759/1493] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:32:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:32:36.136771 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=82 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:32:36.479250 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=50 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:33:53.508343 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4856da78-e4c9-4a5e-848e-5f7c76222966 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:33:53.509220 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4856da78-e4c9-4a5e-848e-5f7c76222966 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:33:53.509408 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4856da78-e4c9-4a5e-848e-5f7c76222966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:33:53.588164 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-4856da78-e4c9-4a5e-848e-5f7c76222966 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:33:53.589382 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-4856da78-e4c9-4a5e-848e-5f7c76222966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:33:53.682907 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 735/1494] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:33:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:33:53.691068 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282b499f-0f25-483e-993c-6c752717b5fa None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:33:53.691587 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282b499f-0f25-483e-993c-6c752717b5fa None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:33:53.691696 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282b499f-0f25-483e-993c-6c752717b5fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:33:53.771120 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-282b499f-0f25-483e-993c-6c752717b5fa None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:33:53.772358 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-282b499f-0f25-483e-993c-6c752717b5fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:33:53.868581 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 760/1495] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:33:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:33:53.873356 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4856da78-e4c9-4a5e-848e-5f7c76222966 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:33:53.874644 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-4856da78-e4c9-4a5e-848e-5f7c76222966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:33:53.886494 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4856da78-e4c9-4a5e-848e-5f7c76222966 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:33:53.947175 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:33:53.980735 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6fe91e-4979-4c4f-9999-2ce2a4a79eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:33:53.981401 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6fe91e-4979-4c4f-9999-2ce2a4a79eef admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:33:53.981680 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6fe91e-4979-4c4f-9999-2ce2a4a79eef admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:33:53.981950 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6fe91e-4979-4c4f-9999-2ce2a4a79eef admin admin] PATH_INFO: `/v3/domains` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:33:53.982704 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6fe91e-4979-4c4f-9999-2ce2a4a79eef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:33:53.983006 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6fe91e-4979-4c4f-9999-2ce2a4a79eef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:33:53.984012 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: WARNING py.warnings [None req-5e6fe91e-4979-4c4f-9999-2ce2a4a79eef admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 09:33:53.984012 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: warnings.warn(msg) Jul 14 09:33:53.984012 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: Jul 14 09:33:53.984899 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6fe91e-4979-4c4f-9999-2ce2a4a79eef admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:33:53.996533 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 736/1496] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jul 14 09:33:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:33:54.005313 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282b499f-0f25-483e-993c-6c752717b5fa None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:33:54.014513 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282b499f-0f25-483e-993c-6c752717b5fa None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:33:54.074086 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:33:54.109069 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e177b51-828e-476e-8f12-0017ce213554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:33:54.109728 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e177b51-828e-476e-8f12-0017ce213554 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:33:54.110010 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e177b51-828e-476e-8f12-0017ce213554 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:33:54.110318 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e177b51-828e-476e-8f12-0017ce213554 admin admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:33:54.111011 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e177b51-828e-476e-8f12-0017ce213554 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:33:54.112707 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: WARNING py.warnings [None req-2e177b51-828e-476e-8f12-0017ce213554 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 09:33:54.112707 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: warnings.warn(msg) Jul 14 09:33:54.112707 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: Jul 14 09:33:54.114428 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e177b51-828e-476e-8f12-0017ce213554 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:33:54.166533 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 761/1497] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 14 09:33:54 2022] POST /identity/v3/projects => generated 377 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:33:54.170727 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6fe91e-4979-4c4f-9999-2ce2a4a79eef admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:33:54.172245 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-5e6fe91e-4979-4c4f-9999-2ce2a4a79eef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:33:54.205132 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6fe91e-4979-4c4f-9999-2ce2a4a79eef admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:33:54.298564 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36851e5-de54-4ca3-8e03-17eb5dae1adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:33:54.299232 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36851e5-de54-4ca3-8e03-17eb5dae1adb admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:33:54.299513 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36851e5-de54-4ca3-8e03-17eb5dae1adb admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:33:54.299788 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36851e5-de54-4ca3-8e03-17eb5dae1adb admin admin] PATH_INFO: `/v3/users` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:33:54.300473 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36851e5-de54-4ca3-8e03-17eb5dae1adb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:33:54.301994 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: WARNING py.warnings [None req-e36851e5-de54-4ca3-8e03-17eb5dae1adb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 09:33:54.301994 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: warnings.warn(msg) Jul 14 09:33:54.301994 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: Jul 14 09:33:54.303210 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36851e5-de54-4ca3-8e03-17eb5dae1adb admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:33:54.342366 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 737/1498] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 14 09:33:54 2022] POST /identity/v3/users => generated 289 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:33:54.346585 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e177b51-828e-476e-8f12-0017ce213554 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:33:54.348088 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-2e177b51-828e-476e-8f12-0017ce213554 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:33:54.408770 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e177b51-828e-476e-8f12-0017ce213554 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:33:54.490386 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:33:54.501781 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa02591-4909-4668-9494-2e40f45736db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:33:54.502475 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa02591-4909-4668-9494-2e40f45736db admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:33:54.502760 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa02591-4909-4668-9494-2e40f45736db admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:33:54.503034 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa02591-4909-4668-9494-2e40f45736db admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:33:54.503759 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa02591-4909-4668-9494-2e40f45736db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:33:54.504800 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: WARNING py.warnings [None req-7aa02591-4909-4668-9494-2e40f45736db admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 09:33:54.504800 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: warnings.warn(msg) Jul 14 09:33:54.504800 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: Jul 14 09:33:54.505673 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa02591-4909-4668-9494-2e40f45736db admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:33:54.517705 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 762/1499] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 09:33:54 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:33:54.521748 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36851e5-de54-4ca3-8e03-17eb5dae1adb admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:33:54.523302 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-e36851e5-de54-4ca3-8e03-17eb5dae1adb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:33:54.535019 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36851e5-de54-4ca3-8e03-17eb5dae1adb admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:33:54.560991 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:33:54.635037 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd025f26-e826-4b3b-859b-7d41a755af3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:33:54.635714 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd025f26-e826-4b3b-859b-7d41a755af3b admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:33:54.636139 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd025f26-e826-4b3b-859b-7d41a755af3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:33:54.636421 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd025f26-e826-4b3b-859b-7d41a755af3b admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:33:54.637150 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd025f26-e826-4b3b-859b-7d41a755af3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:33:54.638165 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: WARNING py.warnings [None req-bd025f26-e826-4b3b-859b-7d41a755af3b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 09:33:54.638165 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: warnings.warn(msg) Jul 14 09:33:54.638165 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: Jul 14 09:33:54.639077 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd025f26-e826-4b3b-859b-7d41a755af3b admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:33:54.651577 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 738/1500] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 09:33:54 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:33:54.655767 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa02591-4909-4668-9494-2e40f45736db admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:33:54.657292 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-7aa02591-4909-4668-9494-2e40f45736db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:33:54.690949 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa02591-4909-4668-9494-2e40f45736db admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:33:54.784833 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a8630d-590a-45d0-a171-75b502cc13c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:33:54.785641 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a8630d-590a-45d0-a171-75b502cc13c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:33:54.785927 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a8630d-590a-45d0-a171-75b502cc13c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:33:54.786229 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a8630d-590a-45d0-a171-75b502cc13c3 admin admin] PATH_INFO: `/v3/projects/df749570e61146fca592765faa9e29a4/users/3631a452a8c643a186f3d821c3f6353d/roles/17dfac38a2e540fea229af7de99911bb` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:33:54.808597 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a8630d-590a-45d0-a171-75b502cc13c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df749570e61146fca592765faa9e29a4, user_id=3631a452a8c643a186f3d821c3f6353d, role_id=17dfac38a2e540fea229af7de99911bb)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:33:54.809628 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: WARNING py.warnings [None req-21a8630d-590a-45d0-a171-75b502cc13c3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 09:33:54.809628 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: warnings.warn(msg) Jul 14 09:33:54.809628 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: Jul 14 09:33:54.811623 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a8630d-590a-45d0-a171-75b502cc13c3 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:33:54.836777 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 763/1501] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 14 09:33:54 2022] PUT /identity/v3/projects/df749570e61146fca592765faa9e29a4/users/3631a452a8c643a186f3d821c3f6353d/roles/17dfac38a2e540fea229af7de99911bb => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:33:54.849063 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce69f29e-9991-4134-9973-92015926f043 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:33:54.849353 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce69f29e-9991-4134-9973-92015926f043 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:33:54.849636 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce69f29e-9991-4134-9973-92015926f043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:33:54.908025 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-ce69f29e-9991-4134-9973-92015926f043 None None] MFA Rules not processed for user `3631a452a8c643a186f3d821c3f6353d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:33:54.909244 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-ce69f29e-9991-4134-9973-92015926f043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:33:54.984416 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 739/1502] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:33:54 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:33:54.998178 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c65977-06fa-4658-a914-027448043c33 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:33:54.998498 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c65977-06fa-4658-a914-027448043c33 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:33:54.998778 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c65977-06fa-4658-a914-027448043c33 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:33:55.000181 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 764/1503] 10.222.0.40 () {54 vars in 963 bytes} [Thu Jul 14 09:33:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:33:55.005598 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6ab4ca-4d58-4b4f-b43f-84e891d0aa63 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:33:55.005874 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6ab4ca-4d58-4b4f-b43f-84e891d0aa63 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:33:55.006153 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6ab4ca-4d58-4b4f-b43f-84e891d0aa63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:33:55.035910 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:33:55.080602 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-cc6ab4ca-4d58-4b4f-b43f-84e891d0aa63 None None] MFA Rules not processed for user `25048b29787d482783ebc944f1a7df65`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:33:55.081801 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-cc6ab4ca-4d58-4b4f-b43f-84e891d0aa63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:33:55.155972 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 740/1504] 10.222.0.40 () {58 vars in 1060 bytes} [Thu Jul 14 09:33:55 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 09:33:55.164269 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c65977-06fa-4658-a914-027448043c33 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:33:55.165831 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-08c65977-06fa-4658-a914-027448043c33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:33:55.214459 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:33:55.272696 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c65977-06fa-4658-a914-027448043c33 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:33:55.343483 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcef1c29-2246-4ab2-aa11-4bfaf527b3b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25048b29787d482783ebc944f1a7df65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:33:55.344060 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcef1c29-2246-4ab2-aa11-4bfaf527b3b1 service cinder] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:33:55.344341 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcef1c29-2246-4ab2-aa11-4bfaf527b3b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:33:55.344611 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcef1c29-2246-4ab2-aa11-4bfaf527b3b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:33:55.346274 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-fcef1c29-2246-4ab2-aa11-4bfaf527b3b1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:33:55.444845 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcef1c29-2246-4ab2-aa11-4bfaf527b3b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:33:55.446315 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcef1c29-2246-4ab2-aa11-4bfaf527b3b1 service cinder] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:33:55.449943 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:33:55.464766 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 765/1505] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:33:55 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:33:55.506076 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116aea5a-dfc6-4767-81b7-81b938301725 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:33:55.506396 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116aea5a-dfc6-4767-81b7-81b938301725 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:33:55.506678 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116aea5a-dfc6-4767-81b7-81b938301725 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:33:55.507953 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 741/1506] 10.222.0.40 () {52 vars in 829 bytes} [Thu Jul 14 09:33:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:33:55.511822 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcef1c29-2246-4ab2-aa11-4bfaf527b3b1 service cinder] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:33:55.513026 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-fcef1c29-2246-4ab2-aa11-4bfaf527b3b1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:33:55.612654 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcef1c29-2246-4ab2-aa11-4bfaf527b3b1 service cinder] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:33:55.709125 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f902355-1f0c-40b0-826c-2cb1591d8f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:33:55.710005 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f902355-1f0c-40b0-826c-2cb1591d8f9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:33:55.710450 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f902355-1f0c-40b0-826c-2cb1591d8f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:33:55.710733 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f902355-1f0c-40b0-826c-2cb1591d8f9e admin admin] PATH_INFO: `/v3/users/3631a452a8c643a186f3d821c3f6353d` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:33:55.722997 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f902355-1f0c-40b0-826c-2cb1591d8f9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=3631a452a8c643a186f3d821c3f6353d)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:33:55.724724 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: WARNING py.warnings [None req-5f902355-1f0c-40b0-826c-2cb1591d8f9e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 09:33:55.724724 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: warnings.warn(msg) Jul 14 09:33:55.724724 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: Jul 14 09:33:55.725919 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f902355-1f0c-40b0-826c-2cb1591d8f9e admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:33:55.740459 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:33:55.794159 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-5f902355-1f0c-40b0-826c-2cb1591d8f9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3631a452a8c643a186f3d821c3f6353d'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:33:55.811781 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-5f902355-1f0c-40b0-826c-2cb1591d8f9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3631a452a8c643a186f3d821c3f6353d'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:33:55.812320 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-5f902355-1f0c-40b0-826c-2cb1591d8f9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3631a452a8c643a186f3d821c3f6353d'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:33:55.821543 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-5f902355-1f0c-40b0-826c-2cb1591d8f9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3631a452a8c643a186f3d821c3f6353d'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:33:55.834480 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-5f902355-1f0c-40b0-826c-2cb1591d8f9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3631a452a8c643a186f3d821c3f6353d'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:33:55.839970 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 766/1507] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 14 09:33:55 2022] DELETE /identity/v3/users/3631a452a8c643a186f3d821c3f6353d => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:33:55.844429 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2c8771-b7cc-4baf-96a6-a11adbde81c0 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:33:55.844989 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2c8771-b7cc-4baf-96a6-a11adbde81c0 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:33:55.844989 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2c8771-b7cc-4baf-96a6-a11adbde81c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:33:55.899666 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-3e2c8771-b7cc-4baf-96a6-a11adbde81c0 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:33:55.900804 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-3e2c8771-b7cc-4baf-96a6-a11adbde81c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:33:55.975233 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:33:55.987817 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 742/1508] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:33:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:33:55.997268 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f902355-1f0c-40b0-826c-2cb1591d8f9e admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:33:55.998508 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-5f902355-1f0c-40b0-826c-2cb1591d8f9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:33:56.104197 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f902355-1f0c-40b0-826c-2cb1591d8f9e admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:33:56.160895 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:33:56.181909 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cb1f0d-2c7b-4cc4-b3a3-b6fa61081900 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e4a5a8965e4802a9055d332179b7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:33:56.182601 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cb1f0d-2c7b-4cc4-b3a3-b6fa61081900 service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:33:56.182890 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cb1f0d-2c7b-4cc4-b3a3-b6fa61081900 service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:33:56.183171 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cb1f0d-2c7b-4cc4-b3a3-b6fa61081900 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:33:56.184817 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-41cb1f0d-2c7b-4cc4-b3a3-b6fa61081900 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:33:56.295660 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cb1f0d-2c7b-4cc4-b3a3-b6fa61081900 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:33:56.297101 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cb1f0d-2c7b-4cc4-b3a3-b6fa61081900 service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:33:56.318508 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 767/1509] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:33:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:33:56.668402 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2c8771-b7cc-4baf-96a6-a11adbde81c0 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:33:56.669649 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-3e2c8771-b7cc-4baf-96a6-a11adbde81c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:33:56.681699 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2c8771-b7cc-4baf-96a6-a11adbde81c0 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:33:56.779644 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81cfa52-add4-4d0a-93db-11d99d1fbc47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:33:56.780555 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81cfa52-add4-4d0a-93db-11d99d1fbc47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:33:56.780832 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81cfa52-add4-4d0a-93db-11d99d1fbc47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:33:56.781103 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81cfa52-add4-4d0a-93db-11d99d1fbc47 admin admin] PATH_INFO: `/v3/projects/df749570e61146fca592765faa9e29a4` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:33:56.790903 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81cfa52-add4-4d0a-93db-11d99d1fbc47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df749570e61146fca592765faa9e29a4)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:33:56.791928 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: WARNING py.warnings [None req-d81cfa52-add4-4d0a-93db-11d99d1fbc47 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 09:33:56.791928 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: warnings.warn(msg) Jul 14 09:33:56.791928 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: Jul 14 09:33:56.793126 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81cfa52-add4-4d0a-93db-11d99d1fbc47 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:33:56.861745 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-d81cfa52-add4-4d0a-93db-11d99d1fbc47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df749570e61146fca592765faa9e29a4', 'request_id': 'req-d81cfa52-add4-4d0a-93db-11d99d1fbc47'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:33:56.871038 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-d81cfa52-add4-4d0a-93db-11d99d1fbc47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df749570e61146fca592765faa9e29a4', 'request_id': 'req-d81cfa52-add4-4d0a-93db-11d99d1fbc47'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:33:56.878090 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-d81cfa52-add4-4d0a-93db-11d99d1fbc47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df749570e61146fca592765faa9e29a4', 'request_id': 'req-d81cfa52-add4-4d0a-93db-11d99d1fbc47'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:33:56.909522 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-d81cfa52-add4-4d0a-93db-11d99d1fbc47 admin admin] The token cache is being invalidate because project df749570e61146fca592765faa9e29a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 09:33:56.909818 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-d81cfa52-add4-4d0a-93db-11d99d1fbc47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:33:56.910450 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-d81cfa52-add4-4d0a-93db-11d99d1fbc47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:33:56.911765 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 743/1510] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 14 09:33:56 2022] DELETE /identity/v3/projects/df749570e61146fca592765faa9e29a4 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:34:06.315550 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=62 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:34:06.907351 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:35:41.849587 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ce1b28-f7e2-43a1-9985-b3d2886add86 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:35:41.850146 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ce1b28-f7e2-43a1-9985-b3d2886add86 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:35:41.850146 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ce1b28-f7e2-43a1-9985-b3d2886add86 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:35:41.851464 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 768/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 09:35:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:35:41.856234 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02defc5f-cd4a-4531-bf60-c7b3ef2b10db None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:35:41.856684 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02defc5f-cd4a-4531-bf60-c7b3ef2b10db None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:35:41.856787 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02defc5f-cd4a-4531-bf60-c7b3ef2b10db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:35:41.934599 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-02defc5f-cd4a-4531-bf60-c7b3ef2b10db None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:35:41.935818 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-02defc5f-cd4a-4531-bf60-c7b3ef2b10db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:35:42.040252 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 744/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 09:35:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:35:42.195772 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ce1b28-f7e2-43a1-9985-b3d2886add86 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:35:42.197880 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-75ce1b28-f7e2-43a1-9985-b3d2886add86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:35:42.323164 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ce1b28-f7e2-43a1-9985-b3d2886add86 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:35:42.328611 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d64ff46-161e-452e-91c3-25feab16a8ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f6962106dfa4c4c9af551053f8095e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:35:42.329260 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d64ff46-161e-452e-91c3-25feab16a8ee service nova] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:35:42.329547 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d64ff46-161e-452e-91c3-25feab16a8ee service nova] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:35:42.329828 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d64ff46-161e-452e-91c3-25feab16a8ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:35:42.337862 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d64ff46-161e-452e-91c3-25feab16a8ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:35:42.339494 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d64ff46-161e-452e-91c3-25feab16a8ee service nova] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:35:42.349085 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 769/1513] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:35:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:35:43.182358 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c48962-351e-4f31-9e0c-16109baab58e None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:35:43.182895 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c48962-351e-4f31-9e0c-16109baab58e None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:35:43.183003 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c48962-351e-4f31-9e0c-16109baab58e None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:35:43.184317 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 745/1514] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 09:35:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:35:43.189261 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637cc570-35fb-46ae-8a9e-c9437c364be0 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:35:43.189713 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637cc570-35fb-46ae-8a9e-c9437c364be0 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:35:43.189823 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637cc570-35fb-46ae-8a9e-c9437c364be0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:35:43.207889 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-637cc570-35fb-46ae-8a9e-c9437c364be0 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:35:43.209066 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-637cc570-35fb-46ae-8a9e-c9437c364be0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:35:43.216783 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 770/1515] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 09:35:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:35:43.368759 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c48962-351e-4f31-9e0c-16109baab58e None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:35:43.383365 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c48962-351e-4f31-9e0c-16109baab58e None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:35:43.388665 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9766dd-9cf4-44a3-af18-f6a9dd3d2629 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f6962106dfa4c4c9af551053f8095e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:35:43.389298 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9766dd-9cf4-44a3-af18-f6a9dd3d2629 service nova] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:35:43.389582 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9766dd-9cf4-44a3-af18-f6a9dd3d2629 service nova] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:35:43.389861 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9766dd-9cf4-44a3-af18-f6a9dd3d2629 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:35:43.398483 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9766dd-9cf4-44a3-af18-f6a9dd3d2629 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:35:43.400052 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9766dd-9cf4-44a3-af18-f6a9dd3d2629 service nova] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:35:43.409329 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 746/1516] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:35:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:35:43.857323 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4f0481-d296-4393-a95a-8e64c3e7aa7a None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:35:43.857527 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4f0481-d296-4393-a95a-8e64c3e7aa7a None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:35:43.857805 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4f0481-d296-4393-a95a-8e64c3e7aa7a None None] PATH_INFO: `/v3` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:35:43.859158 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 771/1517] 10.222.0.49 () {54 vars in 925 bytes} [Thu Jul 14 09:35:43 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:35:43.865767 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9732d33-144e-4879-a3ef-180529ab2673 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:35:43.866060 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9732d33-144e-4879-a3ef-180529ab2673 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:35:43.866368 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9732d33-144e-4879-a3ef-180529ab2673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:35:43.922361 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-c9732d33-144e-4879-a3ef-180529ab2673 None None] MFA Rules not processed for user `6fc5a80144b84c609944a51a84fd5e6e`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:35:43.923576 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-c9732d33-144e-4879-a3ef-180529ab2673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:35:43.940959 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:35:43.995452 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 747/1518] 10.222.0.49 () {58 vars in 1015 bytes} [Thu Jul 14 09:35:43 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:35:52.991765 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb189e7e-d9fe-48ad-adcb-455e16b41a24 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:35:52.992357 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb189e7e-d9fe-48ad-adcb-455e16b41a24 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:35:52.992357 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb189e7e-d9fe-48ad-adcb-455e16b41a24 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:35:52.993708 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 772/1519] 10.222.0.40 () {54 vars in 960 bytes} [Thu Jul 14 09:35:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 09:35:52.998616 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d80bfd1-1fcb-4de5-8d01-5c7c45d92628 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:35:52.999064 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d80bfd1-1fcb-4de5-8d01-5c7c45d92628 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:35:52.999179 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d80bfd1-1fcb-4de5-8d01-5c7c45d92628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:35:53.019062 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-6d80bfd1-1fcb-4de5-8d01-5c7c45d92628 None None] MFA Rules not processed for user `6fc5a80144b84c609944a51a84fd5e6e`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:35:53.020282 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-6d80bfd1-1fcb-4de5-8d01-5c7c45d92628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:35:53.028901 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 748/1520] 10.222.0.40 () {58 vars in 1057 bytes} [Thu Jul 14 09:35:52 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:35:53.037453 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb189e7e-d9fe-48ad-adcb-455e16b41a24 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:35:53.050687 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb189e7e-d9fe-48ad-adcb-455e16b41a24 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:35:53.055597 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d1d0df-ddd6-4805-b01c-4d24d4de632a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc5a80144b84c609944a51a84fd5e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:35:53.056231 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d1d0df-ddd6-4805-b01c-4d24d4de632a service placement] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:35:53.056518 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d1d0df-ddd6-4805-b01c-4d24d4de632a service placement] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:35:53.056799 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d1d0df-ddd6-4805-b01c-4d24d4de632a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:35:53.064991 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d1d0df-ddd6-4805-b01c-4d24d4de632a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:35:53.067093 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d1d0df-ddd6-4805-b01c-4d24d4de632a service placement] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:35:53.076806 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 773/1521] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:35:53 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 09:35:54.641656 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e82c0c9-e0e7-4e0c-b701-25cfac678e68 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:35:54.642098 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e82c0c9-e0e7-4e0c-b701-25cfac678e68 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:35:54.642269 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e82c0c9-e0e7-4e0c-b701-25cfac678e68 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:35:54.644465 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 749/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 09:35:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:35:54.649262 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddfbc04-93ec-4ff0-9234-19e6e2c0402a None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:35:54.649676 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddfbc04-93ec-4ff0-9234-19e6e2c0402a None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:35:54.649826 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddfbc04-93ec-4ff0-9234-19e6e2c0402a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:35:54.667622 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-7ddfbc04-93ec-4ff0-9234-19e6e2c0402a None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:35:54.668825 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-7ddfbc04-93ec-4ff0-9234-19e6e2c0402a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:35:54.676679 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 774/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 09:35:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:35:54.829926 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e82c0c9-e0e7-4e0c-b701-25cfac678e68 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:35:54.845149 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e82c0c9-e0e7-4e0c-b701-25cfac678e68 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:35:54.850662 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7351d8-e2cb-49d5-97af-da136fcdd4aa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f6962106dfa4c4c9af551053f8095e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:35:54.851303 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7351d8-e2cb-49d5-97af-da136fcdd4aa service nova] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:35:54.851588 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7351d8-e2cb-49d5-97af-da136fcdd4aa service nova] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:35:54.851864 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7351d8-e2cb-49d5-97af-da136fcdd4aa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:35:54.859980 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7351d8-e2cb-49d5-97af-da136fcdd4aa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:35:54.861564 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7351d8-e2cb-49d5-97af-da136fcdd4aa service nova] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:35:54.870903 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 750/1524] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:35:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:35:55.685254 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a75a45-7a56-4153-842b-a0cc5e1e36a8 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:35:55.685817 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a75a45-7a56-4153-842b-a0cc5e1e36a8 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:35:55.685817 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a75a45-7a56-4153-842b-a0cc5e1e36a8 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:35:55.687217 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 775/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 09:35:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:35:55.692080 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117bb057-4b70-4ab7-947c-6d4897446f42 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:35:55.692506 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117bb057-4b70-4ab7-947c-6d4897446f42 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:35:55.692640 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117bb057-4b70-4ab7-947c-6d4897446f42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:35:55.830108 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-117bb057-4b70-4ab7-947c-6d4897446f42 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:35:55.835358 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-117bb057-4b70-4ab7-947c-6d4897446f42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:35:55.847116 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 751/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 09:35:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:35:55.999106 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a75a45-7a56-4153-842b-a0cc5e1e36a8 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:35:56.013669 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a75a45-7a56-4153-842b-a0cc5e1e36a8 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:35:56.019564 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d3dc76-f507-4fd6-ab6a-22225e56ab1b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f6962106dfa4c4c9af551053f8095e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:35:56.020203 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d3dc76-f507-4fd6-ab6a-22225e56ab1b service nova] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:35:56.020488 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d3dc76-f507-4fd6-ab6a-22225e56ab1b service nova] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:35:56.020761 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d3dc76-f507-4fd6-ab6a-22225e56ab1b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:35:56.028888 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d3dc76-f507-4fd6-ab6a-22225e56ab1b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:35:56.030491 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d3dc76-f507-4fd6-ab6a-22225e56ab1b service nova] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:35:56.040337 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 776/1527] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:35:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:36:00.004907 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a798688-c0a6-44d0-bf17-c72108ae951c None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:36:00.005498 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a798688-c0a6-44d0-bf17-c72108ae951c None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:36:00.005498 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a798688-c0a6-44d0-bf17-c72108ae951c None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:36:00.006901 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 752/1528] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 09:36:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:36:00.012147 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce6cf82-7965-43d8-a27c-ac6b43efeb50 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:36:00.012560 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce6cf82-7965-43d8-a27c-ac6b43efeb50 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:36:00.012711 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce6cf82-7965-43d8-a27c-ac6b43efeb50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:36:00.031237 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-fce6cf82-7965-43d8-a27c-ac6b43efeb50 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:36:00.032437 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-fce6cf82-7965-43d8-a27c-ac6b43efeb50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:36:00.040792 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 777/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 09:36:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:36:00.112759 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a798688-c0a6-44d0-bf17-c72108ae951c None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:36:00.114517 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-9a798688-c0a6-44d0-bf17-c72108ae951c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:36:00.192854 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a798688-c0a6-44d0-bf17-c72108ae951c None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:36:00.196427 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84574f59-d81b-4f06-bc41-f2cce5a8afe2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e4a5a8965e4802a9055d332179b7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:36:00.197076 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84574f59-d81b-4f06-bc41-f2cce5a8afe2 service neutron] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:36:00.197362 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84574f59-d81b-4f06-bc41-f2cce5a8afe2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:36:00.197640 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84574f59-d81b-4f06-bc41-f2cce5a8afe2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:36:00.206629 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84574f59-d81b-4f06-bc41-f2cce5a8afe2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:36:00.208052 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84574f59-d81b-4f06-bc41-f2cce5a8afe2 service neutron] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:36:00.217288 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 753/1530] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:36:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:36:02.226571 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3658d9d0-6c83-4b53-9daf-9c20bef60812 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:36:02.227074 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3658d9d0-6c83-4b53-9daf-9c20bef60812 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:36:02.227074 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3658d9d0-6c83-4b53-9daf-9c20bef60812 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:36:02.228463 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 778/1531] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 09:36:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:36:02.233713 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f81f4f-56d5-433e-a34e-3a413be733ae None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:36:02.234110 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f81f4f-56d5-433e-a34e-3a413be733ae None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:36:02.234311 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f81f4f-56d5-433e-a34e-3a413be733ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:36:02.252561 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-f5f81f4f-56d5-433e-a34e-3a413be733ae None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:36:02.253755 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-f5f81f4f-56d5-433e-a34e-3a413be733ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:36:02.261543 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 754/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 09:36:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:36:02.296918 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3658d9d0-6c83-4b53-9daf-9c20bef60812 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:36:02.308615 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3658d9d0-6c83-4b53-9daf-9c20bef60812 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:36:02.312129 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf19fa6-7279-4735-a2dd-27ac6a0dd48b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e4a5a8965e4802a9055d332179b7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:36:02.312777 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf19fa6-7279-4735-a2dd-27ac6a0dd48b service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:36:02.313068 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf19fa6-7279-4735-a2dd-27ac6a0dd48b service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:36:02.313382 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf19fa6-7279-4735-a2dd-27ac6a0dd48b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:36:02.322240 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf19fa6-7279-4735-a2dd-27ac6a0dd48b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:36:02.323673 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf19fa6-7279-4735-a2dd-27ac6a0dd48b service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:36:02.332987 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 779/1533] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:36:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:36:05.883587 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950c7c2d-a77d-408c-a210-48ba5b4c6bfc None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:36:05.884132 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950c7c2d-a77d-408c-a210-48ba5b4c6bfc None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:36:05.884132 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950c7c2d-a77d-408c-a210-48ba5b4c6bfc None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:36:05.885453 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 755/1534] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 09:36:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:36:05.890542 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468c4501-31f1-4a81-864c-82a79ef23b19 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:36:05.890948 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468c4501-31f1-4a81-864c-82a79ef23b19 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:36:05.891108 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468c4501-31f1-4a81-864c-82a79ef23b19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:36:05.909280 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-468c4501-31f1-4a81-864c-82a79ef23b19 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:36:05.910573 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-468c4501-31f1-4a81-864c-82a79ef23b19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:36:05.919081 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 780/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 09:36:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:36:06.219225 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950c7c2d-a77d-408c-a210-48ba5b4c6bfc None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:36:06.220896 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-950c7c2d-a77d-408c-a210-48ba5b4c6bfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:36:06.289690 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:36:06.308553 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950c7c2d-a77d-408c-a210-48ba5b4c6bfc None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:36:06.312087 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27a5499-7f77-48bd-8198-937937d30609 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25048b29787d482783ebc944f1a7df65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:36:06.312733 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27a5499-7f77-48bd-8198-937937d30609 service cinder] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:36:06.313015 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27a5499-7f77-48bd-8198-937937d30609 service cinder] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:36:06.313291 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27a5499-7f77-48bd-8198-937937d30609 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:36:06.322849 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27a5499-7f77-48bd-8198-937937d30609 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:36:06.324266 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27a5499-7f77-48bd-8198-937937d30609 service cinder] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:36:06.333401 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 756/1536] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:36:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:36:08.377369 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b29fb57-c5df-417b-926c-830a91d7182c None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:36:08.377937 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b29fb57-c5df-417b-926c-830a91d7182c None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:36:08.377937 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b29fb57-c5df-417b-926c-830a91d7182c None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:36:08.379329 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 781/1537] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 09:36:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:36:08.384456 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942fe0dd-4e01-4c5a-a080-bcfad4bcbbaa None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:36:08.384864 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942fe0dd-4e01-4c5a-a080-bcfad4bcbbaa None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:36:08.385016 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942fe0dd-4e01-4c5a-a080-bcfad4bcbbaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:36:08.402492 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-942fe0dd-4e01-4c5a-a080-bcfad4bcbbaa None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:36:08.403706 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-942fe0dd-4e01-4c5a-a080-bcfad4bcbbaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:36:08.412140 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 757/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 09:36:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:36:08.711863 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b29fb57-c5df-417b-926c-830a91d7182c None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:36:08.713549 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-4b29fb57-c5df-417b-926c-830a91d7182c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:36:08.722223 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=84 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:36:08.728920 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b29fb57-c5df-417b-926c-830a91d7182c None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:36:08.732555 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4c3623-6a77-4114-9138-b8750ad8d001 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25048b29787d482783ebc944f1a7df65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:36:08.733230 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4c3623-6a77-4114-9138-b8750ad8d001 service cinder] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:36:08.733516 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4c3623-6a77-4114-9138-b8750ad8d001 service cinder] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:36:08.733794 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4c3623-6a77-4114-9138-b8750ad8d001 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:36:08.743244 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4c3623-6a77-4114-9138-b8750ad8d001 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:36:08.744766 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4c3623-6a77-4114-9138-b8750ad8d001 service cinder] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:36:08.754439 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 782/1539] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:36:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 09:36:18.397713 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=11 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:36:18.750313 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=5 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:37:42.094845 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ee1615-bc66-4d39-bf02-a390f523c8fa None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:37:42.095627 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ee1615-bc66-4d39-bf02-a390f523c8fa None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:37:42.095627 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ee1615-bc66-4d39-bf02-a390f523c8fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:37:42.124155 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-97ee1615-bc66-4d39-bf02-a390f523c8fa None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:37:42.125389 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-97ee1615-bc66-4d39-bf02-a390f523c8fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:37:42.136990 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 758/1540] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:37:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:37:42.146745 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031025f4-f283-44f6-bc40-19c55863133d None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:37:42.147810 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031025f4-f283-44f6-bc40-19c55863133d None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:37:42.148317 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031025f4-f283-44f6-bc40-19c55863133d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:37:42.177108 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-031025f4-f283-44f6-bc40-19c55863133d None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:37:42.178817 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-031025f4-f283-44f6-bc40-19c55863133d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:37:42.193680 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 783/1541] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:37:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:37:42.198054 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ee1615-bc66-4d39-bf02-a390f523c8fa None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:37:42.214730 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ee1615-bc66-4d39-bf02-a390f523c8fa None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:37:42.224126 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2670a826-530f-40ed-99f0-7687f3018a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:37:42.225038 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2670a826-530f-40ed-99f0-7687f3018a00 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:37:42.225477 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2670a826-530f-40ed-99f0-7687f3018a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:37:42.225920 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2670a826-530f-40ed-99f0-7687f3018a00 admin admin] PATH_INFO: `/v3/domains` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:37:42.226863 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2670a826-530f-40ed-99f0-7687f3018a00 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:37:42.227340 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2670a826-530f-40ed-99f0-7687f3018a00 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:37:42.229378 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2670a826-530f-40ed-99f0-7687f3018a00 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:37:42.245144 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab18a1c-1986-46a3-a60a-7b498d4007e8 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:37:42.245579 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab18a1c-1986-46a3-a60a-7b498d4007e8 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:37:42.246009 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab18a1c-1986-46a3-a60a-7b498d4007e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:37:42.249368 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 759/1542] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jul 14 09:37:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:37:42.259940 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2670a826-530f-40ed-99f0-7687f3018a00 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:37:42.274091 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2670a826-530f-40ed-99f0-7687f3018a00 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:37:42.276577 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-aab18a1c-1986-46a3-a60a-7b498d4007e8 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:37:42.278082 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-aab18a1c-1986-46a3-a60a-7b498d4007e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:37:42.288389 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c818522-c36e-4f5d-a126-de73a12a850b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:37:42.289607 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c818522-c36e-4f5d-a126-de73a12a850b admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:37:42.290059 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c818522-c36e-4f5d-a126-de73a12a850b admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:37:42.290615 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c818522-c36e-4f5d-a126-de73a12a850b admin admin] PATH_INFO: `/v3/projects` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:37:42.291541 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c818522-c36e-4f5d-a126-de73a12a850b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:37:42.292785 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: WARNING py.warnings [None req-0c818522-c36e-4f5d-a126-de73a12a850b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 09:37:42.292785 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: warnings.warn(msg) Jul 14 09:37:42.292785 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: Jul 14 09:37:42.294401 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c818522-c36e-4f5d-a126-de73a12a850b admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:37:42.302212 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 784/1543] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:37:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 09:37:42.306425 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378d2e6c-f75e-4f88-8eaa-295847648a2a None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:37:42.309685 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378d2e6c-f75e-4f88-8eaa-295847648a2a None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:37:42.309685 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378d2e6c-f75e-4f88-8eaa-295847648a2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:37:42.336039 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-378d2e6c-f75e-4f88-8eaa-295847648a2a None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:37:42.337256 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-378d2e6c-f75e-4f88-8eaa-295847648a2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:37:42.355774 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 785/1544] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:37:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 09:37:42.359321 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19154d68-1a17-4b4e-b36f-175beae3926f None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:37:42.359619 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19154d68-1a17-4b4e-b36f-175beae3926f None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:37:42.359950 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19154d68-1a17-4b4e-b36f-175beae3926f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:37:42.375957 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 760/1545] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 14 09:37:42 2022] POST /identity/v3/projects => generated 375 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 09:37:42.377566 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c818522-c36e-4f5d-a126-de73a12a850b admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:37:42.386169 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-19154d68-1a17-4b4e-b36f-175beae3926f None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:37:42.387584 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-19154d68-1a17-4b4e-b36f-175beae3926f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:37:42.497989 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c818522-c36e-4f5d-a126-de73a12a850b admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:37:42.504341 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 786/1546] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:37:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 09:37:42.506364 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19154d68-1a17-4b4e-b36f-175beae3926f None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:37:42.512866 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0618c947-6751-4771-9ce0-0dd1b8b0c7dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:37:42.513552 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0618c947-6751-4771-9ce0-0dd1b8b0c7dc admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:37:42.513844 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0618c947-6751-4771-9ce0-0dd1b8b0c7dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:37:42.514121 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0618c947-6751-4771-9ce0-0dd1b8b0c7dc admin admin] PATH_INFO: `/v3/domains` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:37:42.514894 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0618c947-6751-4771-9ce0-0dd1b8b0c7dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:37:42.515207 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0618c947-6751-4771-9ce0-0dd1b8b0c7dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:37:42.517501 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0618c947-6751-4771-9ce0-0dd1b8b0c7dc admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:37:42.530425 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19154d68-1a17-4b4e-b36f-175beae3926f None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:37:42.539666 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 761/1547] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jul 14 09:37:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:37:42.541041 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c96c8b7-4cef-4172-8d78-125f2b6c005f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:37:42.541732 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c96c8b7-4cef-4172-8d78-125f2b6c005f admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:37:42.542021 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c96c8b7-4cef-4172-8d78-125f2b6c005f admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:37:42.542327 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c96c8b7-4cef-4172-8d78-125f2b6c005f admin admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:37:42.543057 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c96c8b7-4cef-4172-8d78-125f2b6c005f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:37:42.544083 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: WARNING py.warnings [None req-6c96c8b7-4cef-4172-8d78-125f2b6c005f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 09:37:42.544083 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: warnings.warn(msg) Jul 14 09:37:42.544083 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: Jul 14 09:37:42.545291 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c96c8b7-4cef-4172-8d78-125f2b6c005f admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:37:42.547124 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55d7aa6-dcc0-47e2-a32b-6795a420d991 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:37:42.547455 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55d7aa6-dcc0-47e2-a32b-6795a420d991 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:37:42.547741 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55d7aa6-dcc0-47e2-a32b-6795a420d991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:37:42.574926 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-b55d7aa6-dcc0-47e2-a32b-6795a420d991 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:37:42.576184 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-b55d7aa6-dcc0-47e2-a32b-6795a420d991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:37:42.583503 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 787/1548] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 14 09:37:42 2022] POST /identity/v3/users => generated 288 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:37:42.585002 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc91ad56-1f1b-441e-a445-e5818110e045 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:37:42.585300 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc91ad56-1f1b-441e-a445-e5818110e045 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:37:42.585634 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc91ad56-1f1b-441e-a445-e5818110e045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:37:42.588263 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 762/1549] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:37:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:37:42.590072 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ea1342-bf8f-4317-af53-518f1cfdcd14 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:37:42.590576 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ea1342-bf8f-4317-af53-518f1cfdcd14 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:37:42.590860 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ea1342-bf8f-4317-af53-518f1cfdcd14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:37:42.609878 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-12ea1342-bf8f-4317-af53-518f1cfdcd14 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:37:42.610832 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-fc91ad56-1f1b-441e-a445-e5818110e045 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:37:42.611044 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-12ea1342-bf8f-4317-af53-518f1cfdcd14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:37:42.612031 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-fc91ad56-1f1b-441e-a445-e5818110e045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:37:42.619061 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 763/1550] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:37:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:37:42.619880 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ea1342-bf8f-4317-af53-518f1cfdcd14 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:37:42.620223 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 788/1551] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:37:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:37:42.621450 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28977f06-ef5a-4d10-b336-1c67855578e4 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:37:42.621737 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28977f06-ef5a-4d10-b336-1c67855578e4 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:37:42.622013 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28977f06-ef5a-4d10-b336-1c67855578e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:37:42.635185 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ea1342-bf8f-4317-af53-518f1cfdcd14 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:37:42.639694 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-28977f06-ef5a-4d10-b336-1c67855578e4 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:37:42.639835 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21005661-10eb-4082-8ff6-e7b5de823bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:37:42.640458 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21005661-10eb-4082-8ff6-e7b5de823bb0 admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:37:42.640741 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21005661-10eb-4082-8ff6-e7b5de823bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:37:42.640976 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-28977f06-ef5a-4d10-b336-1c67855578e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:37:42.641648 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21005661-10eb-4082-8ff6-e7b5de823bb0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:37:42.642406 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21005661-10eb-4082-8ff6-e7b5de823bb0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:37:42.644227 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21005661-10eb-4082-8ff6-e7b5de823bb0 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:37:42.649342 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 789/1552] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:37:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:37:42.650573 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c65c45-9993-422b-b662-3e247abf37d7 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:37:42.650859 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c65c45-9993-422b-b662-3e247abf37d7 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:37:42.651125 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c65c45-9993-422b-b662-3e247abf37d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:37:42.671729 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-68c65c45-9993-422b-b662-3e247abf37d7 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:37:42.672330 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 764/1553] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 14 09:37:42 2022] POST /identity/v3/projects => generated 379 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:37:42.673040 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-68c65c45-9993-422b-b662-3e247abf37d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:37:42.673273 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21005661-10eb-4082-8ff6-e7b5de823bb0 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:37:42.734052 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 790/1554] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:37:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:37:42.734444 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21005661-10eb-4082-8ff6-e7b5de823bb0 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:37:42.736218 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560e7384-3451-4ddc-95ce-55a31613c5df None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:37:42.736742 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560e7384-3451-4ddc-95ce-55a31613c5df None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:37:42.737231 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560e7384-3451-4ddc-95ce-55a31613c5df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:37:42.739709 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b6faec-09a9-49f1-97e1-47401fbe426b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:37:42.740367 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b6faec-09a9-49f1-97e1-47401fbe426b admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:37:42.740653 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b6faec-09a9-49f1-97e1-47401fbe426b admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:37:42.741065 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b6faec-09a9-49f1-97e1-47401fbe426b admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:37:42.741767 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b6faec-09a9-49f1-97e1-47401fbe426b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:37:42.743393 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b6faec-09a9-49f1-97e1-47401fbe426b admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:37:42.754324 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 765/1555] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 09:37:42 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:37:42.755635 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28994979-8ce3-4c9e-a299-2f89f532af6a None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:37:42.755923 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28994979-8ce3-4c9e-a299-2f89f532af6a None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:37:42.756196 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28994979-8ce3-4c9e-a299-2f89f532af6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:37:42.763689 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:37:42.763866 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-560e7384-3451-4ddc-95ce-55a31613c5df None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:37:42.764945 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-560e7384-3451-4ddc-95ce-55a31613c5df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:37:42.774054 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 791/1556] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:37:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:37:42.774876 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560e7384-3451-4ddc-95ce-55a31613c5df None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:37:42.775490 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-28994979-8ce3-4c9e-a299-2f89f532af6a None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:37:42.776667 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-28994979-8ce3-4c9e-a299-2f89f532af6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:37:42.784679 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560e7384-3451-4ddc-95ce-55a31613c5df None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:37:42.785218 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 766/1557] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:37:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:37:42.786479 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f275135-1713-488e-8cdc-039eed571fe6 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:37:42.786775 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f275135-1713-488e-8cdc-039eed571fe6 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:37:42.787056 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f275135-1713-488e-8cdc-039eed571fe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:37:42.798499 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd88a7ac-b92c-4c6b-8e60-f27ba0bfe4cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:37:42.799181 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd88a7ac-b92c-4c6b-8e60-f27ba0bfe4cb admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:37:42.799463 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd88a7ac-b92c-4c6b-8e60-f27ba0bfe4cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:37:42.799738 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd88a7ac-b92c-4c6b-8e60-f27ba0bfe4cb admin admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:37:42.800482 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd88a7ac-b92c-4c6b-8e60-f27ba0bfe4cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:37:42.800793 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd88a7ac-b92c-4c6b-8e60-f27ba0bfe4cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:37:42.801808 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: WARNING py.warnings [None req-bd88a7ac-b92c-4c6b-8e60-f27ba0bfe4cb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 09:37:42.801808 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: warnings.warn(msg) Jul 14 09:37:42.801808 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: Jul 14 09:37:42.802721 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd88a7ac-b92c-4c6b-8e60-f27ba0bfe4cb admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:37:42.805476 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-9f275135-1713-488e-8cdc-039eed571fe6 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:37:42.806699 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-9f275135-1713-488e-8cdc-039eed571fe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:37:42.820818 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 792/1558] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jul 14 09:37:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:37:42.821155 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 767/1559] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:37:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:37:42.821155 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f275135-1713-488e-8cdc-039eed571fe6 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:37:42.821354 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f2e1d7-dcc6-49c6-8ceb-a057002cdef4 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:37:42.821354 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f2e1d7-dcc6-49c6-8ceb-a057002cdef4 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:37:42.821354 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f2e1d7-dcc6-49c6-8ceb-a057002cdef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:37:42.827025 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f275135-1713-488e-8cdc-039eed571fe6 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:37:42.831694 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41652a45-a431-4e59-b7b2-708dbc41ec02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:37:42.832351 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41652a45-a431-4e59-b7b2-708dbc41ec02 admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:37:42.832637 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41652a45-a431-4e59-b7b2-708dbc41ec02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:37:42.833248 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41652a45-a431-4e59-b7b2-708dbc41ec02 admin admin] PATH_INFO: `/v3/users` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:37:42.833597 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41652a45-a431-4e59-b7b2-708dbc41ec02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:37:42.835525 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41652a45-a431-4e59-b7b2-708dbc41ec02 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:37:42.837994 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-68f2e1d7-dcc6-49c6-8ceb-a057002cdef4 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:37:42.839290 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-68f2e1d7-dcc6-49c6-8ceb-a057002cdef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:37:42.849735 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 793/1560] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:37:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:37:42.851282 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02dc309-050d-45ad-9e21-9e8f287f2590 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:37:42.851682 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02dc309-050d-45ad-9e21-9e8f287f2590 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:37:42.852085 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02dc309-050d-45ad-9e21-9e8f287f2590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:37:42.864570 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 768/1561] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 14 09:37:42 2022] POST /identity/v3/users => generated 290 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:37:42.864570 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41652a45-a431-4e59-b7b2-708dbc41ec02 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:37:42.872046 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41652a45-a431-4e59-b7b2-708dbc41ec02 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:37:42.876093 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-c02dc309-050d-45ad-9e21-9e8f287f2590 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:37:42.877299 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-c02dc309-050d-45ad-9e21-9e8f287f2590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:37:42.882283 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9d87c6-7156-43c9-b164-4a572c0aefc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:37:42.882977 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9d87c6-7156-43c9-b164-4a572c0aefc0 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:37:42.883263 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9d87c6-7156-43c9-b164-4a572c0aefc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:37:42.883544 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9d87c6-7156-43c9-b164-4a572c0aefc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:37:42.884290 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9d87c6-7156-43c9-b164-4a572c0aefc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:37:42.885896 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9d87c6-7156-43c9-b164-4a572c0aefc0 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:37:42.886546 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 794/1562] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:37:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:37:42.887430 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02dc309-050d-45ad-9e21-9e8f287f2590 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:37:42.897524 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02dc309-050d-45ad-9e21-9e8f287f2590 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:37:42.899873 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 769/1563] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 09:37:42 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:37:42.901178 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9ff9fc-e77d-4ca6-bc7e-a282a381b22d None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:37:42.901475 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9ff9fc-e77d-4ca6-bc7e-a282a381b22d None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:37:42.901757 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9ff9fc-e77d-4ca6-bc7e-a282a381b22d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:37:42.905435 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd327265-200f-460b-bade-e80de1f6c338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:37:42.906093 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd327265-200f-460b-bade-e80de1f6c338 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:37:42.906409 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd327265-200f-460b-bade-e80de1f6c338 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:37:42.906689 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd327265-200f-460b-bade-e80de1f6c338 admin admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:37:42.907962 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd327265-200f-460b-bade-e80de1f6c338 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:37:42.908300 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd327265-200f-460b-bade-e80de1f6c338 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:37:42.909946 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd327265-200f-460b-bade-e80de1f6c338 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:37:42.920889 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-3d9ff9fc-e77d-4ca6-bc7e-a282a381b22d None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:37:42.921782 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 795/1564] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jul 14 09:37:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:37:42.922080 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-3d9ff9fc-e77d-4ca6-bc7e-a282a381b22d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:37:42.923160 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd327265-200f-460b-bade-e80de1f6c338 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:37:42.929705 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:37:42.931097 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 770/1565] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:37:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:37:42.931887 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9ff9fc-e77d-4ca6-bc7e-a282a381b22d None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:37:42.934373 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd327265-200f-460b-bade-e80de1f6c338 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:37:42.941317 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9ff9fc-e77d-4ca6-bc7e-a282a381b22d None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:37:42.944012 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c2e0b6-2a5a-42df-bde1-2bc250dd3900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:37:42.944670 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c2e0b6-2a5a-42df-bde1-2bc250dd3900 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:37:42.944954 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c2e0b6-2a5a-42df-bde1-2bc250dd3900 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:37:42.945229 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c2e0b6-2a5a-42df-bde1-2bc250dd3900 admin admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:37:42.946395 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c2e0b6-2a5a-42df-bde1-2bc250dd3900 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:37:42.946501 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b7962d-70ad-4455-863e-0ea87eee9b92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:37:42.946605 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c2e0b6-2a5a-42df-bde1-2bc250dd3900 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:37:42.946746 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b7962d-70ad-4455-863e-0ea87eee9b92 admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:37:42.947211 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b7962d-70ad-4455-863e-0ea87eee9b92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:37:42.947332 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b7962d-70ad-4455-863e-0ea87eee9b92 admin admin] PATH_INFO: `/v3/projects` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:37:42.947852 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c2e0b6-2a5a-42df-bde1-2bc250dd3900 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:37:42.947984 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b7962d-70ad-4455-863e-0ea87eee9b92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:37:42.949847 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b7962d-70ad-4455-863e-0ea87eee9b92 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:37:42.960022 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 796/1566] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jul 14 09:37:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:37:42.960888 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c2e0b6-2a5a-42df-bde1-2bc250dd3900 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:37:42.976829 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c2e0b6-2a5a-42df-bde1-2bc250dd3900 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:37:42.977970 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 771/1567] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 14 09:37:42 2022] POST /identity/v3/projects => generated 393 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:37:42.978995 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b7962d-70ad-4455-863e-0ea87eee9b92 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:37:43.034660 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aa92a8-255b-4615-a1d2-6c9c5578a3a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:37:43.035332 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aa92a8-255b-4615-a1d2-6c9c5578a3a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:37:43.035618 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aa92a8-255b-4615-a1d2-6c9c5578a3a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:37:43.035896 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aa92a8-255b-4615-a1d2-6c9c5578a3a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:37:43.036619 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54aa92a8-255b-4615-a1d2-6c9c5578a3a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:37:43.036926 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54aa92a8-255b-4615-a1d2-6c9c5578a3a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:37:43.038552 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54aa92a8-255b-4615-a1d2-6c9c5578a3a4 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:37:43.043169 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b7962d-70ad-4455-863e-0ea87eee9b92 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:37:43.048431 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237421b9-d561-47cf-ad11-d7c5cae5b039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:37:43.049104 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237421b9-d561-47cf-ad11-d7c5cae5b039 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:37:43.049396 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237421b9-d561-47cf-ad11-d7c5cae5b039 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:37:43.049676 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237421b9-d561-47cf-ad11-d7c5cae5b039 admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:37:43.050443 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237421b9-d561-47cf-ad11-d7c5cae5b039 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:37:43.051530 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 797/1568] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jul 14 09:37:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:37:43.052040 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237421b9-d561-47cf-ad11-d7c5cae5b039 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:37:43.052324 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aa92a8-255b-4615-a1d2-6c9c5578a3a4 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:37:43.063664 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aa92a8-255b-4615-a1d2-6c9c5578a3a4 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:37:43.066113 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 772/1569] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 09:37:42 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:37:43.066905 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237421b9-d561-47cf-ad11-d7c5cae5b039 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:37:43.069249 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186e2c5e-5417-4bdc-9fd8-7b9a98b1d936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:37:43.069984 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186e2c5e-5417-4bdc-9fd8-7b9a98b1d936 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:37:43.070387 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186e2c5e-5417-4bdc-9fd8-7b9a98b1d936 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:37:43.070778 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186e2c5e-5417-4bdc-9fd8-7b9a98b1d936 admin admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:37:43.072181 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186e2c5e-5417-4bdc-9fd8-7b9a98b1d936 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:37:43.072577 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186e2c5e-5417-4bdc-9fd8-7b9a98b1d936 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:37:43.074348 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186e2c5e-5417-4bdc-9fd8-7b9a98b1d936 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:37:43.076647 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237421b9-d561-47cf-ad11-d7c5cae5b039 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:37:43.081538 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1a263a-e05d-46ad-ad96-a69c2dcbb390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:37:43.082443 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1a263a-e05d-46ad-ad96-a69c2dcbb390 admin admin] REQUEST_METHOD: `PUT` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:37:43.082732 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1a263a-e05d-46ad-ad96-a69c2dcbb390 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:37:43.083017 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1a263a-e05d-46ad-ad96-a69c2dcbb390 admin admin] PATH_INFO: `/v3/projects/a4324e0082184371a7f886a43dcfb358/users/43d67da8d2554d6c9eb1e28eca883b87/roles/17dfac38a2e540fea229af7de99911bb` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:37:43.086810 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 798/1570] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jul 14 09:37:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:37:43.087573 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186e2c5e-5417-4bdc-9fd8-7b9a98b1d936 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:37:43.099314 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186e2c5e-5417-4bdc-9fd8-7b9a98b1d936 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:37:43.104426 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17535f1f-7fbd-4d98-9cde-6910c7c0a2a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:37:43.105070 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17535f1f-7fbd-4d98-9cde-6910c7c0a2a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:37:43.105195 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1a263a-e05d-46ad-ad96-a69c2dcbb390 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4324e0082184371a7f886a43dcfb358, user_id=43d67da8d2554d6c9eb1e28eca883b87, role_id=17dfac38a2e540fea229af7de99911bb)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:37:43.105692 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17535f1f-7fbd-4d98-9cde-6910c7c0a2a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:37:43.105692 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17535f1f-7fbd-4d98-9cde-6910c7c0a2a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:37:43.106161 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: WARNING py.warnings [None req-1f1a263a-e05d-46ad-ad96-a69c2dcbb390 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 09:37:43.106161 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: warnings.warn(msg) Jul 14 09:37:43.106161 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: Jul 14 09:37:43.106477 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17535f1f-7fbd-4d98-9cde-6910c7c0a2a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:37:43.108100 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1a263a-e05d-46ad-ad96-a69c2dcbb390 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:37:43.108222 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17535f1f-7fbd-4d98-9cde-6910c7c0a2a7 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:37:43.121839 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 773/1571] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 14 09:37:43 2022] PUT /identity/v3/projects/a4324e0082184371a7f886a43dcfb358/users/43d67da8d2554d6c9eb1e28eca883b87/roles/17dfac38a2e540fea229af7de99911bb => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:37:43.131267 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1a263a-e05d-46ad-ad96-a69c2dcbb390 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:37:43.144270 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 799/1572] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 14 09:37:43 2022] POST /identity/v3/projects => generated 383 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:37:43.145436 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17535f1f-7fbd-4d98-9cde-6910c7c0a2a7 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:37:43.185382 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1a263a-e05d-46ad-ad96-a69c2dcbb390 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:37:43.194476 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:37:43.207909 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17535f1f-7fbd-4d98-9cde-6910c7c0a2a7 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:37:43.212619 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d03e22-484d-463a-8ab6-0ded4737634b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:37:43.213283 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d03e22-484d-463a-8ab6-0ded4737634b admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:37:43.213568 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d03e22-484d-463a-8ab6-0ded4737634b admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:37:43.213851 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d03e22-484d-463a-8ab6-0ded4737634b admin admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:37:43.214606 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d03e22-484d-463a-8ab6-0ded4737634b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:37:43.216778 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d03e22-484d-463a-8ab6-0ded4737634b admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:37:43.244628 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 800/1573] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 14 09:37:43 2022] POST /identity/v3/projects => generated 387 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:37:43.245413 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d03e22-484d-463a-8ab6-0ded4737634b admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:37:43.249328 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ce2d2f-2a0a-4db1-a775-967196aa9d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:37:43.250007 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ce2d2f-2a0a-4db1-a775-967196aa9d01 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:37:43.250330 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ce2d2f-2a0a-4db1-a775-967196aa9d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:37:43.250743 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ce2d2f-2a0a-4db1-a775-967196aa9d01 admin admin] PATH_INFO: `/v3/domains` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:37:43.251489 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ce2d2f-2a0a-4db1-a775-967196aa9d01 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:37:43.251806 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ce2d2f-2a0a-4db1-a775-967196aa9d01 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:37:43.253423 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ce2d2f-2a0a-4db1-a775-967196aa9d01 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:37:43.265416 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 774/1574] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jul 14 09:37:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:37:43.265416 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ce2d2f-2a0a-4db1-a775-967196aa9d01 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:37:43.278130 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ce2d2f-2a0a-4db1-a775-967196aa9d01 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:37:43.288418 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:37:43.313002 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d03e22-484d-463a-8ab6-0ded4737634b admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:37:43.317713 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e91f9b-9813-4aa3-9277-d62baecd934c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:37:43.318436 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e91f9b-9813-4aa3-9277-d62baecd934c admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:37:43.318729 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e91f9b-9813-4aa3-9277-d62baecd934c admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:37:43.319015 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e91f9b-9813-4aa3-9277-d62baecd934c admin admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:37:43.319713 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e91f9b-9813-4aa3-9277-d62baecd934c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:37:43.321651 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e91f9b-9813-4aa3-9277-d62baecd934c admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:37:43.334986 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e631078f-ad3f-49d0-9e32-3b342b0b2e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:37:43.335746 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e631078f-ad3f-49d0-9e32-3b342b0b2e77 admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:37:43.335948 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e631078f-ad3f-49d0-9e32-3b342b0b2e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:37:43.336234 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e631078f-ad3f-49d0-9e32-3b342b0b2e77 admin admin] PATH_INFO: `/v3/projects` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:37:43.336996 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e631078f-ad3f-49d0-9e32-3b342b0b2e77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:37:43.339052 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e631078f-ad3f-49d0-9e32-3b342b0b2e77 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:37:43.342115 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 801/1575] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 14 09:37:43 2022] POST /identity/v3/users => generated 297 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:37:43.343028 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e91f9b-9813-4aa3-9277-d62baecd934c admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:37:43.354527 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e91f9b-9813-4aa3-9277-d62baecd934c admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:37:43.359766 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d43eafb-da4a-47d1-94fc-658c1696e97b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:37:43.360447 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d43eafb-da4a-47d1-94fc-658c1696e97b admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:37:43.360738 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d43eafb-da4a-47d1-94fc-658c1696e97b admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:37:43.361019 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d43eafb-da4a-47d1-94fc-658c1696e97b admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:37:43.361746 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d43eafb-da4a-47d1-94fc-658c1696e97b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:37:43.363371 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d43eafb-da4a-47d1-94fc-658c1696e97b admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:37:43.366130 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 775/1576] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 14 09:37:43 2022] POST /identity/v3/projects => generated 389 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:37:43.366959 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e631078f-ad3f-49d0-9e32-3b342b0b2e77 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:37:43.376997 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 802/1577] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 09:37:43 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:37:43.378382 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3e715d-4ce2-4476-8ba8-a381f1cc64d8 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:37:43.378676 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3e715d-4ce2-4476-8ba8-a381f1cc64d8 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:37:43.378960 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3e715d-4ce2-4476-8ba8-a381f1cc64d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:37:43.405119 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-3a3e715d-4ce2-4476-8ba8-a381f1cc64d8 None None] MFA Rules not processed for user `43d67da8d2554d6c9eb1e28eca883b87`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:37:43.406377 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-3a3e715d-4ce2-4476-8ba8-a381f1cc64d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:37:43.428525 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e631078f-ad3f-49d0-9e32-3b342b0b2e77 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:37:43.434362 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d76b99-75aa-4617-bca5-1986d23f745a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:37:43.435190 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d76b99-75aa-4617-bca5-1986d23f745a admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:37:43.435478 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d76b99-75aa-4617-bca5-1986d23f745a admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:37:43.435805 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d76b99-75aa-4617-bca5-1986d23f745a admin admin] PATH_INFO: `/v3/projects` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:37:43.436503 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d76b99-75aa-4617-bca5-1986d23f745a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:37:43.438425 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d76b99-75aa-4617-bca5-1986d23f745a admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:37:43.464430 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 776/1578] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 14 09:37:43 2022] POST /identity/v3/projects => generated 375 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:37:43.465520 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d76b99-75aa-4617-bca5-1986d23f745a admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:37:43.474035 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 803/1579] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:37:43 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:37:43.474892 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3e715d-4ce2-4476-8ba8-a381f1cc64d8 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:37:43.485038 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3e715d-4ce2-4476-8ba8-a381f1cc64d8 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:37:43.490996 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:37:43.540636 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d76b99-75aa-4617-bca5-1986d23f745a admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:37:43.545360 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7f657c-29ea-4ff8-9ded-800b236f66a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:37:43.546037 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7f657c-29ea-4ff8-9ded-800b236f66a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:37:43.546370 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7f657c-29ea-4ff8-9ded-800b236f66a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:37:43.546648 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7f657c-29ea-4ff8-9ded-800b236f66a1 admin admin] PATH_INFO: `/v3/users` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:37:43.547423 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7f657c-29ea-4ff8-9ded-800b236f66a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:37:43.549335 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7f657c-29ea-4ff8-9ded-800b236f66a1 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:37:43.556440 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66a0a14-6fc0-4593-b69a-5e49e11ae880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:37:43.557147 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66a0a14-6fc0-4593-b69a-5e49e11ae880 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:37:43.557435 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66a0a14-6fc0-4593-b69a-5e49e11ae880 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:37:43.557834 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66a0a14-6fc0-4593-b69a-5e49e11ae880 admin admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:37:43.558553 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66a0a14-6fc0-4593-b69a-5e49e11ae880 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:37:43.560731 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66a0a14-6fc0-4593-b69a-5e49e11ae880 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:37:43.572341 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 777/1580] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 14 09:37:43 2022] POST /identity/v3/users => generated 292 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:37:43.576472 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7f657c-29ea-4ff8-9ded-800b236f66a1 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:37:43.585198 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 804/1581] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 14 09:37:43 2022] POST /identity/v3/users => generated 294 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:37:43.585198 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66a0a14-6fc0-4593-b69a-5e49e11ae880 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:37:43.589566 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7f657c-29ea-4ff8-9ded-800b236f66a1 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:37:43.593361 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66a0a14-6fc0-4593-b69a-5e49e11ae880 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:37:43.594266 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c120e266-d990-4e58-9dc7-1b0bd34979a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:37:43.595080 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c120e266-d990-4e58-9dc7-1b0bd34979a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:37:43.595366 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c120e266-d990-4e58-9dc7-1b0bd34979a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:37:43.595644 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c120e266-d990-4e58-9dc7-1b0bd34979a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:37:43.596340 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c120e266-d990-4e58-9dc7-1b0bd34979a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:37:43.598261 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d2886b-ef17-4e13-9884-6449a57f7a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:37:43.598411 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c120e266-d990-4e58-9dc7-1b0bd34979a4 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:37:43.598925 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d2886b-ef17-4e13-9884-6449a57f7a94 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:37:43.599214 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d2886b-ef17-4e13-9884-6449a57f7a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:37:43.599499 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d2886b-ef17-4e13-9884-6449a57f7a94 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:37:43.600283 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d2886b-ef17-4e13-9884-6449a57f7a94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:37:43.601870 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d2886b-ef17-4e13-9884-6449a57f7a94 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:37:43.615300 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 805/1582] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 09:37:43 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:37:43.615300 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d2886b-ef17-4e13-9884-6449a57f7a94 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:37:43.623016 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d2886b-ef17-4e13-9884-6449a57f7a94 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:37:43.628286 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce039d8-55b0-4976-add9-47f0ab272ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:37:43.631664 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 778/1583] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 14 09:37:43 2022] POST /identity/v3/projects => generated 371 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:37:43.631780 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce039d8-55b0-4976-add9-47f0ab272ae8 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:37:43.631780 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce039d8-55b0-4976-add9-47f0ab272ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:37:43.631982 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c120e266-d990-4e58-9dc7-1b0bd34979a4 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:37:43.632102 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce039d8-55b0-4976-add9-47f0ab272ae8 admin admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:37:43.632102 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce039d8-55b0-4976-add9-47f0ab272ae8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:37:43.632102 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce039d8-55b0-4976-add9-47f0ab272ae8 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:37:43.653922 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 806/1584] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 14 09:37:43 2022] POST /identity/v3/users => generated 295 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:37:43.655053 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce039d8-55b0-4976-add9-47f0ab272ae8 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:37:43.661434 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:37:43.665349 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce039d8-55b0-4976-add9-47f0ab272ae8 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:37:43.694675 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c120e266-d990-4e58-9dc7-1b0bd34979a4 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:37:43.699380 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04104dd-c976-4f74-8a77-5cd175d3fb23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:37:43.700259 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04104dd-c976-4f74-8a77-5cd175d3fb23 admin admin] REQUEST_METHOD: `PUT` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:37:43.700565 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04104dd-c976-4f74-8a77-5cd175d3fb23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:37:43.700839 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04104dd-c976-4f74-8a77-5cd175d3fb23 admin admin] PATH_INFO: `/v3/projects/84ed99374b3b42b3b4cc3d68b2a67ed5/users/9b6ae4ed064a44c882b44b07d5595665/roles/17dfac38a2e540fea229af7de99911bb` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:37:43.715517 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04104dd-c976-4f74-8a77-5cd175d3fb23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84ed99374b3b42b3b4cc3d68b2a67ed5, user_id=9b6ae4ed064a44c882b44b07d5595665, role_id=17dfac38a2e540fea229af7de99911bb)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:37:43.718142 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04104dd-c976-4f74-8a77-5cd175d3fb23 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:37:43.722650 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ef5eec-f29f-4d3b-a063-f32ba4598fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:37:43.723380 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ef5eec-f29f-4d3b-a063-f32ba4598fd5 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:37:43.723671 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ef5eec-f29f-4d3b-a063-f32ba4598fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:37:43.724016 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ef5eec-f29f-4d3b-a063-f32ba4598fd5 admin admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:37:43.724750 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ef5eec-f29f-4d3b-a063-f32ba4598fd5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:37:43.727377 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ef5eec-f29f-4d3b-a063-f32ba4598fd5 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:37:43.731108 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 779/1585] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 14 09:37:43 2022] PUT /identity/v3/projects/84ed99374b3b42b3b4cc3d68b2a67ed5/users/9b6ae4ed064a44c882b44b07d5595665/roles/17dfac38a2e540fea229af7de99911bb => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:37:43.732386 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d55922-4353-41c1-87cd-a5ef93edd871 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:37:43.732673 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d55922-4353-41c1-87cd-a5ef93edd871 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:37:43.732951 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d55922-4353-41c1-87cd-a5ef93edd871 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:37:43.734214 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 780/1586] 10.222.0.40 () {54 vars in 961 bytes} [Thu Jul 14 09:37:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:37:43.734971 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d55922-4353-41c1-87cd-a5ef93edd871 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:37:43.749009 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 807/1587] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 14 09:37:43 2022] POST /identity/v3/users => generated 288 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:37:43.749940 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ef5eec-f29f-4d3b-a063-f32ba4598fd5 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:37:43.760236 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ef5eec-f29f-4d3b-a063-f32ba4598fd5 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:37:43.810638 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d55922-4353-41c1-87cd-a5ef93edd871 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:37:43.815953 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8c8dea-e9e4-4add-b8f8-cac4e7d8010c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:37:43.816720 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8c8dea-e9e4-4add-b8f8-cac4e7d8010c admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:37:43.817007 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8c8dea-e9e4-4add-b8f8-cac4e7d8010c admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:37:43.817282 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8c8dea-e9e4-4add-b8f8-cac4e7d8010c admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:37:43.818012 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8c8dea-e9e4-4add-b8f8-cac4e7d8010c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:37:43.819519 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fbf375-f41d-4f8c-a9ae-a12ea3b7e5f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:37:43.819670 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8c8dea-e9e4-4add-b8f8-cac4e7d8010c admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:37:43.820195 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fbf375-f41d-4f8c-a9ae-a12ea3b7e5f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:37:43.820483 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fbf375-f41d-4f8c-a9ae-a12ea3b7e5f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:37:43.820770 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fbf375-f41d-4f8c-a9ae-a12ea3b7e5f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:37:43.821504 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fbf375-f41d-4f8c-a9ae-a12ea3b7e5f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:37:43.823097 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fbf375-f41d-4f8c-a9ae-a12ea3b7e5f7 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:37:43.831458 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 781/1588] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 09:37:43 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:37:43.832425 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8c8dea-e9e4-4add-b8f8-cac4e7d8010c admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:37:43.835694 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 808/1589] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 09:37:43 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:37:43.835694 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fbf375-f41d-4f8c-a9ae-a12ea3b7e5f7 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:37:43.839572 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:37:43.843707 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8c8dea-e9e4-4add-b8f8-cac4e7d8010c admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:37:43.846328 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fbf375-f41d-4f8c-a9ae-a12ea3b7e5f7 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:37:43.849584 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d877f0e-b371-48a6-a79d-22d2bd2c2556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:37:43.850299 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d877f0e-b371-48a6-a79d-22d2bd2c2556 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:37:43.850587 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d877f0e-b371-48a6-a79d-22d2bd2c2556 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:37:43.850868 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d877f0e-b371-48a6-a79d-22d2bd2c2556 admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:37:43.851153 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0713df5-b39a-4117-8b69-7d40000617e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:37:43.851598 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d877f0e-b371-48a6-a79d-22d2bd2c2556 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:37:43.851809 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0713df5-b39a-4117-8b69-7d40000617e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:37:43.852098 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0713df5-b39a-4117-8b69-7d40000617e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:37:43.852383 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0713df5-b39a-4117-8b69-7d40000617e5 admin admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:37:43.853172 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d877f0e-b371-48a6-a79d-22d2bd2c2556 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:37:43.853286 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0713df5-b39a-4117-8b69-7d40000617e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:37:43.855161 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0713df5-b39a-4117-8b69-7d40000617e5 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:37:43.863325 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 782/1590] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 09:37:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:37:43.864234 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d877f0e-b371-48a6-a79d-22d2bd2c2556 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:37:43.876484 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 809/1591] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 14 09:37:43 2022] POST /identity/v3/users => generated 286 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:37:43.876763 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d877f0e-b371-48a6-a79d-22d2bd2c2556 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:37:43.880847 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c08a0d4-551f-4d6d-b0cd-a84cf6b92cca None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:37:43.881086 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c08a0d4-551f-4d6d-b0cd-a84cf6b92cca None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:37:43.881372 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c08a0d4-551f-4d6d-b0cd-a84cf6b92cca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:37:43.881584 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7da6263-eab9-445b-bd28-04939f40df89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:37:43.882279 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7da6263-eab9-445b-bd28-04939f40df89 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:37:43.882571 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7da6263-eab9-445b-bd28-04939f40df89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:37:43.882854 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7da6263-eab9-445b-bd28-04939f40df89 admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:37:43.883731 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7da6263-eab9-445b-bd28-04939f40df89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:37:43.885318 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7da6263-eab9-445b-bd28-04939f40df89 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:37:43.896517 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 783/1592] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 09:37:43 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:37:43.897759 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d7ad06-d037-4d75-9422-4d6c56149bc0 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:37:43.898052 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d7ad06-d037-4d75-9422-4d6c56149bc0 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:37:43.898362 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d7ad06-d037-4d75-9422-4d6c56149bc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:37:43.900416 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-0c08a0d4-551f-4d6d-b0cd-a84cf6b92cca None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:37:43.901705 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-0c08a0d4-551f-4d6d-b0cd-a84cf6b92cca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:37:43.912899 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 810/1593] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:37:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:37:43.912899 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c08a0d4-551f-4d6d-b0cd-a84cf6b92cca None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:37:43.923972 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c08a0d4-551f-4d6d-b0cd-a84cf6b92cca None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:37:43.928534 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2cb7e4-53aa-4ce8-908c-58598a4fd52b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:37:43.929200 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2cb7e4-53aa-4ce8-908c-58598a4fd52b admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:37:43.929488 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2cb7e4-53aa-4ce8-908c-58598a4fd52b admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:37:43.929767 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2cb7e4-53aa-4ce8-908c-58598a4fd52b admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:37:43.930530 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2cb7e4-53aa-4ce8-908c-58598a4fd52b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:37:43.932124 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2cb7e4-53aa-4ce8-908c-58598a4fd52b admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:37:43.942617 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-90d7ad06-d037-4d75-9422-4d6c56149bc0 None None] MFA Rules not processed for user `1f6962106dfa4c4c9af551053f8095e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:37:43.942778 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 811/1594] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 09:37:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:37:43.943523 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2cb7e4-53aa-4ce8-908c-58598a4fd52b admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:37:43.943893 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-90d7ad06-d037-4d75-9422-4d6c56149bc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:37:43.953341 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2cb7e4-53aa-4ce8-908c-58598a4fd52b admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:37:43.958085 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4d6b98-e9ac-44af-afba-aa69497c563d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:37:43.958765 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4d6b98-e9ac-44af-afba-aa69497c563d admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:37:43.959051 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4d6b98-e9ac-44af-afba-aa69497c563d admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:37:43.959333 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4d6b98-e9ac-44af-afba-aa69497c563d admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:37:43.960052 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4d6b98-e9ac-44af-afba-aa69497c563d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:37:43.961630 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4d6b98-e9ac-44af-afba-aa69497c563d admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:37:43.972452 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 812/1595] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 09:37:43 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:37:43.973331 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4d6b98-e9ac-44af-afba-aa69497c563d admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:37:43.982859 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4d6b98-e9ac-44af-afba-aa69497c563d admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:37:43.987959 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e410b1b2-b5e1-43a6-af26-6b01c9cc50f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:37:43.988596 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e410b1b2-b5e1-43a6-af26-6b01c9cc50f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:37:43.988881 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e410b1b2-b5e1-43a6-af26-6b01c9cc50f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:37:43.989158 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e410b1b2-b5e1-43a6-af26-6b01c9cc50f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:37:43.989893 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e410b1b2-b5e1-43a6-af26-6b01c9cc50f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:37:43.991496 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e410b1b2-b5e1-43a6-af26-6b01c9cc50f2 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:37:44.002439 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 813/1596] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 09:37:43 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:37:44.003308 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e410b1b2-b5e1-43a6-af26-6b01c9cc50f2 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:37:44.012543 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e410b1b2-b5e1-43a6-af26-6b01c9cc50f2 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:37:44.017035 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cabfdab-80f0-4837-9894-bae29c52f381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:37:44.017461 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 784/1597] 10.222.0.40 () {58 vars in 1058 bytes} [Thu Jul 14 09:37:43 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:37:44.017952 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cabfdab-80f0-4837-9894-bae29c52f381 admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:37:44.018266 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cabfdab-80f0-4837-9894-bae29c52f381 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:37:44.018403 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d7ad06-d037-4d75-9422-4d6c56149bc0 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:37:44.018586 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cabfdab-80f0-4837-9894-bae29c52f381 admin admin] PATH_INFO: `/v3/projects/f35a70c5090a4570ad8ba3701dad3f80/users/f1d0b9390f474de79828a675d4e0646a/roles/17dfac38a2e540fea229af7de99911bb` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:37:44.028229 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d7ad06-d037-4d75-9422-4d6c56149bc0 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:37:44.032834 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ede9b9-f1a3-45f5-9bf9-07410c8becc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:37:44.033494 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ede9b9-f1a3-45f5-9bf9-07410c8becc8 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:37:44.033781 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ede9b9-f1a3-45f5-9bf9-07410c8becc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:37:44.033911 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cabfdab-80f0-4837-9894-bae29c52f381 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f35a70c5090a4570ad8ba3701dad3f80, user_id=f1d0b9390f474de79828a675d4e0646a, role_id=17dfac38a2e540fea229af7de99911bb)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:37:44.034086 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ede9b9-f1a3-45f5-9bf9-07410c8becc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:37:44.034835 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ede9b9-f1a3-45f5-9bf9-07410c8becc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:37:44.036397 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ede9b9-f1a3-45f5-9bf9-07410c8becc8 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:37:44.036508 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cabfdab-80f0-4837-9894-bae29c52f381 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:37:44.050472 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 785/1598] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 09:37:44 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:37:44.050472 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ede9b9-f1a3-45f5-9bf9-07410c8becc8 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:37:44.056310 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 814/1599] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 14 09:37:44 2022] PUT /identity/v3/projects/f35a70c5090a4570ad8ba3701dad3f80/users/f1d0b9390f474de79828a675d4e0646a/roles/17dfac38a2e540fea229af7de99911bb => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:37:44.060049 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cabfdab-80f0-4837-9894-bae29c52f381 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:37:44.060147 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ede9b9-f1a3-45f5-9bf9-07410c8becc8 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:37:44.061813 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-9cabfdab-80f0-4837-9894-bae29c52f381 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:37:44.073637 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:37:44.117048 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c217db5b-b09a-4e9e-8b63-cda6b26dba3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:37:44.117735 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c217db5b-b09a-4e9e-8b63-cda6b26dba3b admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:37:44.118020 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c217db5b-b09a-4e9e-8b63-cda6b26dba3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:37:44.118335 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c217db5b-b09a-4e9e-8b63-cda6b26dba3b admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:37:44.119074 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c217db5b-b09a-4e9e-8b63-cda6b26dba3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:37:44.120673 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c217db5b-b09a-4e9e-8b63-cda6b26dba3b admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:37:44.121792 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cabfdab-80f0-4837-9894-bae29c52f381 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:37:44.126171 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2b182f-925e-43e6-805d-dfcfc2f7eada service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e4a5a8965e4802a9055d332179b7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:37:44.126925 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2b182f-925e-43e6-805d-dfcfc2f7eada service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:37:44.127210 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2b182f-925e-43e6-805d-dfcfc2f7eada service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:37:44.127486 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2b182f-925e-43e6-805d-dfcfc2f7eada service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:37:44.131229 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 786/1600] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 09:37:44 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:37:44.131918 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c217db5b-b09a-4e9e-8b63-cda6b26dba3b admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:37:44.136726 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2b182f-925e-43e6-805d-dfcfc2f7eada service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:37:44.138161 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2b182f-925e-43e6-805d-dfcfc2f7eada service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:37:44.141820 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c217db5b-b09a-4e9e-8b63-cda6b26dba3b admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:37:44.146688 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aae6c0-038f-47ac-b8ca-54d394018dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:37:44.147338 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aae6c0-038f-47ac-b8ca-54d394018dfe admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:37:44.147631 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aae6c0-038f-47ac-b8ca-54d394018dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:37:44.147855 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 815/1601] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:37:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:37:44.147955 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aae6c0-038f-47ac-b8ca-54d394018dfe admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:37:44.148615 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2b182f-925e-43e6-805d-dfcfc2f7eada service neutron] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:37:44.148722 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3aae6c0-038f-47ac-b8ca-54d394018dfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:37:44.150255 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3aae6c0-038f-47ac-b8ca-54d394018dfe admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:37:44.158123 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2b182f-925e-43e6-805d-dfcfc2f7eada service neutron] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:37:44.163621 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 787/1602] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 09:37:44 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:37:44.163621 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aae6c0-038f-47ac-b8ca-54d394018dfe admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:37:44.166016 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58930e4b-ae5e-4f3f-9278-bb4e38d0f010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:37:44.166918 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58930e4b-ae5e-4f3f-9278-bb4e38d0f010 admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:37:44.167198 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58930e4b-ae5e-4f3f-9278-bb4e38d0f010 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:37:44.167477 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58930e4b-ae5e-4f3f-9278-bb4e38d0f010 admin admin] PATH_INFO: `/v3/projects/0dde10631582463ab587bc4c275c856d/users/9cb02e863d1f4da6b29fd29674d92e33/roles/17dfac38a2e540fea229af7de99911bb` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:37:44.176370 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aae6c0-038f-47ac-b8ca-54d394018dfe admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:37:44.183975 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7456cca2-4ca3-4147-8c03-75f769f09879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:37:44.184279 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58930e4b-ae5e-4f3f-9278-bb4e38d0f010 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0dde10631582463ab587bc4c275c856d, user_id=9cb02e863d1f4da6b29fd29674d92e33, role_id=17dfac38a2e540fea229af7de99911bb)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:37:44.185314 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7456cca2-4ca3-4147-8c03-75f769f09879 admin admin] REQUEST_METHOD: `PUT` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:37:44.185752 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7456cca2-4ca3-4147-8c03-75f769f09879 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:37:44.186214 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7456cca2-4ca3-4147-8c03-75f769f09879 admin admin] PATH_INFO: `/v3/projects/52e6dceb3bb948dba52cdc9c4c1eab5e/users/c88c49bba312444b951141c266107e00/roles/17dfac38a2e540fea229af7de99911bb` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:37:44.187010 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58930e4b-ae5e-4f3f-9278-bb4e38d0f010 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:37:44.201221 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 816/1603] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 14 09:37:44 2022] PUT /identity/v3/projects/0dde10631582463ab587bc4c275c856d/users/9cb02e863d1f4da6b29fd29674d92e33/roles/17dfac38a2e540fea229af7de99911bb => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:37:44.202121 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58930e4b-ae5e-4f3f-9278-bb4e38d0f010 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:37:44.206099 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7456cca2-4ca3-4147-8c03-75f769f09879 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52e6dceb3bb948dba52cdc9c4c1eab5e, user_id=c88c49bba312444b951141c266107e00, role_id=17dfac38a2e540fea229af7de99911bb)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:37:44.209605 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7456cca2-4ca3-4147-8c03-75f769f09879 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:37:44.226148 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 788/1604] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 14 09:37:44 2022] PUT /identity/v3/projects/52e6dceb3bb948dba52cdc9c4c1eab5e/users/c88c49bba312444b951141c266107e00/roles/17dfac38a2e540fea229af7de99911bb => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:37:44.238110 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7456cca2-4ca3-4147-8c03-75f769f09879 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:37:44.254019 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:37:44.288351 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58930e4b-ae5e-4f3f-9278-bb4e38d0f010 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:37:44.320000 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7456cca2-4ca3-4147-8c03-75f769f09879 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:37:44.326152 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d335e68b-827e-4d9f-8de5-e8ad779e1ebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:37:44.327223 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d335e68b-827e-4d9f-8de5-e8ad779e1ebc admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:37:44.327503 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d335e68b-827e-4d9f-8de5-e8ad779e1ebc admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:37:44.327683 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d335e68b-827e-4d9f-8de5-e8ad779e1ebc admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:37:44.328737 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d335e68b-827e-4d9f-8de5-e8ad779e1ebc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:37:44.331212 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d335e68b-827e-4d9f-8de5-e8ad779e1ebc admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:37:44.347886 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 789/1605] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 09:37:44 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:37:44.349358 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf48c96-9a17-49c8-94d3-1e201e1a1606 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:37:44.349680 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf48c96-9a17-49c8-94d3-1e201e1a1606 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:37:44.349931 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf48c96-9a17-49c8-94d3-1e201e1a1606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:37:44.370286 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e2902f-0ec6-4f83-950f-6e389bb8e4af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f6962106dfa4c4c9af551053f8095e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:37:44.371029 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e2902f-0ec6-4f83-950f-6e389bb8e4af service nova] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:37:44.371531 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e2902f-0ec6-4f83-950f-6e389bb8e4af service nova] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:37:44.371985 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e2902f-0ec6-4f83-950f-6e389bb8e4af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:37:44.372312 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-daf48c96-9a17-49c8-94d3-1e201e1a1606 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:37:44.373622 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-daf48c96-9a17-49c8-94d3-1e201e1a1606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:37:44.383733 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 790/1606] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:37:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:37:44.384248 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf48c96-9a17-49c8-94d3-1e201e1a1606 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:37:44.394600 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:37:44.403043 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf48c96-9a17-49c8-94d3-1e201e1a1606 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:37:44.409013 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5fa63d-bede-4370-9505-6ac9ca46c75f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:37:44.409907 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5fa63d-bede-4370-9505-6ac9ca46c75f admin admin] REQUEST_METHOD: `PUT` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:37:44.410212 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5fa63d-bede-4370-9505-6ac9ca46c75f admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:37:44.410545 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5fa63d-bede-4370-9505-6ac9ca46c75f admin admin] PATH_INFO: `/v3/projects/e4d87102c8234c7f9ba0c1a6299ba3d7/users/f50c3855aa764c2fb86c48c90eb9e15c/roles/17dfac38a2e540fea229af7de99911bb` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:37:44.428897 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5fa63d-bede-4370-9505-6ac9ca46c75f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4d87102c8234c7f9ba0c1a6299ba3d7, user_id=f50c3855aa764c2fb86c48c90eb9e15c, role_id=17dfac38a2e540fea229af7de99911bb)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:37:44.432035 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5fa63d-bede-4370-9505-6ac9ca46c75f admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:37:44.439850 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e2902f-0ec6-4f83-950f-6e389bb8e4af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:37:44.441635 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e2902f-0ec6-4f83-950f-6e389bb8e4af service nova] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:37:44.447839 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 791/1607] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 14 09:37:44 2022] PUT /identity/v3/projects/e4d87102c8234c7f9ba0c1a6299ba3d7/users/f50c3855aa764c2fb86c48c90eb9e15c/roles/17dfac38a2e540fea229af7de99911bb => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:37:44.448507 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5fa63d-bede-4370-9505-6ac9ca46c75f admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:37:44.452609 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 817/1608] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:37:44 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:37:44.454205 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3f113b-b85a-4a01-b974-f9862ff89438 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:37:44.454900 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3f113b-b85a-4a01-b974-f9862ff89438 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:37:44.454900 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3f113b-b85a-4a01-b974-f9862ff89438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:37:44.502458 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-5b3f113b-b85a-4a01-b974-f9862ff89438 None None] MFA Rules not processed for user `9cb02e863d1f4da6b29fd29674d92e33`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:37:44.504326 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-5b3f113b-b85a-4a01-b974-f9862ff89438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:37:44.579267 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5fa63d-bede-4370-9505-6ac9ca46c75f admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:37:44.593974 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3defe548-8314-4b7c-a219-3eaf9194a9d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:37:44.595444 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3defe548-8314-4b7c-a219-3eaf9194a9d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:37:44.595726 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3defe548-8314-4b7c-a219-3eaf9194a9d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:37:44.600340 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3defe548-8314-4b7c-a219-3eaf9194a9d1 admin admin] PATH_INFO: `/v3/projects/140620648e604251bc9c5c1a0e9c483b/users/688f473972144fb6b7a398c1f775a5c1/roles/17dfac38a2e540fea229af7de99911bb` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:37:44.600502 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 818/1609] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:37:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:37:44.600502 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5084321a-9b77-4059-89ab-4465548a8dd2 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:37:44.600502 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5084321a-9b77-4059-89ab-4465548a8dd2 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:37:44.600502 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5084321a-9b77-4059-89ab-4465548a8dd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:37:44.631511 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3defe548-8314-4b7c-a219-3eaf9194a9d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=140620648e604251bc9c5c1a0e9c483b, user_id=688f473972144fb6b7a398c1f775a5c1, role_id=17dfac38a2e540fea229af7de99911bb)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:37:44.634335 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3defe548-8314-4b7c-a219-3eaf9194a9d1 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:37:44.636783 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-5084321a-9b77-4059-89ab-4465548a8dd2 None None] MFA Rules not processed for user `c88c49bba312444b951141c266107e00`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:37:44.638313 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-5084321a-9b77-4059-89ab-4465548a8dd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:37:44.661935 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 792/1610] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 14 09:37:44 2022] PUT /identity/v3/projects/140620648e604251bc9c5c1a0e9c483b/users/688f473972144fb6b7a398c1f775a5c1/roles/17dfac38a2e540fea229af7de99911bb => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:37:44.663522 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3defe548-8314-4b7c-a219-3eaf9194a9d1 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:37:44.739723 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 819/1611] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:37:44 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:37:44.741034 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5084321a-9b77-4059-89ab-4465548a8dd2 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:37:44.751591 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3defe548-8314-4b7c-a219-3eaf9194a9d1 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:37:44.759415 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af84e243-c847-4bd5-aab7-b81a500820cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:37:44.760615 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af84e243-c847-4bd5-aab7-b81a500820cb admin admin] REQUEST_METHOD: `PUT` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:37:44.762490 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af84e243-c847-4bd5-aab7-b81a500820cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:37:44.762786 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af84e243-c847-4bd5-aab7-b81a500820cb admin admin] PATH_INFO: `/v3/projects/6548d25383e940f7bd6885b4b0fb6dbf/users/37639dda61504653a4c74cd37e587ecf/roles/17dfac38a2e540fea229af7de99911bb` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:37:44.767772 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:37:44.807182 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af84e243-c847-4bd5-aab7-b81a500820cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=6548d25383e940f7bd6885b4b0fb6dbf, user_id=37639dda61504653a4c74cd37e587ecf, role_id=17dfac38a2e540fea229af7de99911bb)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:37:44.812716 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af84e243-c847-4bd5-aab7-b81a500820cb admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:37:44.834230 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:37:44.849427 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5084321a-9b77-4059-89ab-4465548a8dd2 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:37:44.863514 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 793/1612] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 14 09:37:44 2022] PUT /identity/v3/projects/6548d25383e940f7bd6885b4b0fb6dbf/users/37639dda61504653a4c74cd37e587ecf/roles/17dfac38a2e540fea229af7de99911bb => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:37:44.863514 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ebb4cd-3d92-4e9b-bb46-3a609be9a75d None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:37:44.863514 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ebb4cd-3d92-4e9b-bb46-3a609be9a75d None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:37:44.863514 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ebb4cd-3d92-4e9b-bb46-3a609be9a75d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:37:44.879056 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-c7ebb4cd-3d92-4e9b-bb46-3a609be9a75d None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:37:44.880731 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-c7ebb4cd-3d92-4e9b-bb46-3a609be9a75d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:37:44.913192 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a239e9a-db11-4d4a-b058-a552c213be81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e4a5a8965e4802a9055d332179b7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:37:44.914414 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a239e9a-db11-4d4a-b058-a552c213be81 service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:37:44.914414 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a239e9a-db11-4d4a-b058-a552c213be81 service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:37:44.914740 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a239e9a-db11-4d4a-b058-a552c213be81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:37:44.961170 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 794/1613] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:37:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:37:44.962589 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3dc96c-f256-4d44-8ebf-02fe1e72c520 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:37:44.962884 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3dc96c-f256-4d44-8ebf-02fe1e72c520 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:37:44.963168 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3dc96c-f256-4d44-8ebf-02fe1e72c520 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:37:44.965290 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 795/1614] 10.222.0.40 () {54 vars in 961 bytes} [Thu Jul 14 09:37:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:37:44.966283 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac87b42c-ed80-412e-be6e-64104228baea None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:37:44.966631 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac87b42c-ed80-412e-be6e-64104228baea None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:37:44.966922 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac87b42c-ed80-412e-be6e-64104228baea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:37:44.994508 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-ac87b42c-ed80-412e-be6e-64104228baea None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:37:44.995744 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-ac87b42c-ed80-412e-be6e-64104228baea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:37:45.008504 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 796/1615] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:37:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:37:45.012838 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac87b42c-ed80-412e-be6e-64104228baea None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:37:45.015168 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a239e9a-db11-4d4a-b058-a552c213be81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:37:45.017375 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a239e9a-db11-4d4a-b058-a552c213be81 service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:37:45.020202 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac87b42c-ed80-412e-be6e-64104228baea None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:37:45.026522 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c012a8-6568-48a2-a61b-1692f49615fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:37:45.027195 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c012a8-6568-48a2-a61b-1692f49615fa admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:37:45.027477 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c012a8-6568-48a2-a61b-1692f49615fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:37:45.027801 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c012a8-6568-48a2-a61b-1692f49615fa admin admin] PATH_INFO: `/v3/projects` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:37:45.028503 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c012a8-6568-48a2-a61b-1692f49615fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:37:45.030386 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 820/1616] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:37:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:37:45.031011 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c012a8-6568-48a2-a61b-1692f49615fa admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:37:45.033188 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d400124-2536-45d6-af27-f57efd010044 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:37:45.033583 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d400124-2536-45d6-af27-f57efd010044 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:37:45.033966 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d400124-2536-45d6-af27-f57efd010044 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:37:45.040373 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 821/1617] 10.222.0.40 () {54 vars in 912 bytes} [Thu Jul 14 09:37:45 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:37:45.041798 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3c6e8d-3d42-4732-aae8-4824051cec1e None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:37:45.042621 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3c6e8d-3d42-4732-aae8-4824051cec1e None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:37:45.042621 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3c6e8d-3d42-4732-aae8-4824051cec1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:37:45.070723 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 797/1618] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 14 09:37:45 2022] POST /identity/v3/projects => generated 385 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:37:45.072190 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401f96b7-b38d-43c9-92b4-6cf2fd466c6b None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:37:45.072447 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401f96b7-b38d-43c9-92b4-6cf2fd466c6b None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:37:45.072699 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401f96b7-b38d-43c9-92b4-6cf2fd466c6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:37:45.094799 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-3f3c6e8d-3d42-4732-aae8-4824051cec1e None None] MFA Rules not processed for user `37639dda61504653a4c74cd37e587ecf`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:37:45.097323 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-3f3c6e8d-3d42-4732-aae8-4824051cec1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:37:45.100403 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-401f96b7-b38d-43c9-92b4-6cf2fd466c6b None None] MFA Rules not processed for user `1f6962106dfa4c4c9af551053f8095e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:37:45.101740 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-401f96b7-b38d-43c9-92b4-6cf2fd466c6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:37:45.185194 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 822/1619] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:37:45 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:37:45.186244 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3c6e8d-3d42-4732-aae8-4824051cec1e None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:37:45.205848 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 798/1620] 10.222.0.40 () {58 vars in 1058 bytes} [Thu Jul 14 09:37:45 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:37:45.207437 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401f96b7-b38d-43c9-92b4-6cf2fd466c6b None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:37:45.250947 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:37:45.282173 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3c6e8d-3d42-4732-aae8-4824051cec1e None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:37:45.283685 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:37:45.289770 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17fa78e-2d8b-4c4d-b720-8c7bc3dac008 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e4a5a8965e4802a9055d332179b7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:37:45.291202 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401f96b7-b38d-43c9-92b4-6cf2fd466c6b None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:37:45.292290 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17fa78e-2d8b-4c4d-b720-8c7bc3dac008 service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:37:45.293704 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17fa78e-2d8b-4c4d-b720-8c7bc3dac008 service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:37:45.294153 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17fa78e-2d8b-4c4d-b720-8c7bc3dac008 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:37:45.296948 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb9d89c-0eeb-4625-aefc-83583e645095 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e4a5a8965e4802a9055d332179b7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:37:45.298922 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb9d89c-0eeb-4625-aefc-83583e645095 service neutron] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:37:45.299775 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb9d89c-0eeb-4625-aefc-83583e645095 service neutron] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:37:45.299991 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb9d89c-0eeb-4625-aefc-83583e645095 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:37:45.377290 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb9d89c-0eeb-4625-aefc-83583e645095 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:37:45.377695 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17fa78e-2d8b-4c4d-b720-8c7bc3dac008 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:37:45.379382 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb9d89c-0eeb-4625-aefc-83583e645095 service neutron] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:37:45.379524 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17fa78e-2d8b-4c4d-b720-8c7bc3dac008 service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:37:45.390557 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 823/1621] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:37:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:37:45.392432 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cf0b50-0c68-4a9c-820d-f5484e029c1b None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:37:45.392824 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cf0b50-0c68-4a9c-820d-f5484e029c1b None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:37:45.393754 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cf0b50-0c68-4a9c-820d-f5484e029c1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:37:45.394218 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 799/1622] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:37:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:37:45.395902 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb9d89c-0eeb-4625-aefc-83583e645095 service neutron] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:37:45.409294 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb9d89c-0eeb-4625-aefc-83583e645095 service neutron] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:37:45.415692 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f29ac1-e945-43d8-8cfc-15e64e35fb92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:37:45.416647 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f29ac1-e945-43d8-8cfc-15e64e35fb92 admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:37:45.416949 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f29ac1-e945-43d8-8cfc-15e64e35fb92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:37:45.417295 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f29ac1-e945-43d8-8cfc-15e64e35fb92 admin admin] PATH_INFO: `/v3/users` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:37:45.418025 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f29ac1-e945-43d8-8cfc-15e64e35fb92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:37:45.421137 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f29ac1-e945-43d8-8cfc-15e64e35fb92 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:37:45.441253 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-39cf0b50-0c68-4a9c-820d-f5484e029c1b None None] MFA Rules not processed for user `1f6962106dfa4c4c9af551053f8095e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:37:45.442714 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-39cf0b50-0c68-4a9c-820d-f5484e029c1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:37:45.453140 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 800/1623] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 14 09:37:45 2022] POST /identity/v3/users => generated 293 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:37:45.454668 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f29ac1-e945-43d8-8cfc-15e64e35fb92 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:37:45.467062 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 824/1624] 10.222.0.40 () {58 vars in 1009 bytes} [Thu Jul 14 09:37:45 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:37:45.468088 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cf0b50-0c68-4a9c-820d-f5484e029c1b None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:37:45.487633 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f29ac1-e945-43d8-8cfc-15e64e35fb92 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:37:45.493861 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0249a25-d1ba-4de0-9441-95f63f52fe3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:37:45.494819 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0249a25-d1ba-4de0-9441-95f63f52fe3c admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:37:45.495148 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cf0b50-0c68-4a9c-820d-f5484e029c1b None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:37:45.495412 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0249a25-d1ba-4de0-9441-95f63f52fe3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:37:45.495796 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0249a25-d1ba-4de0-9441-95f63f52fe3c admin admin] PATH_INFO: `/v3/projects` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:37:45.496900 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0249a25-d1ba-4de0-9441-95f63f52fe3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:37:45.499380 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0249a25-d1ba-4de0-9441-95f63f52fe3c admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:37:45.509784 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e595302-ba9b-4128-9beb-15c3b025455e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f6962106dfa4c4c9af551053f8095e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:37:45.512043 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e595302-ba9b-4128-9beb-15c3b025455e service nova] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:37:45.514507 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e595302-ba9b-4128-9beb-15c3b025455e service nova] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:37:45.514825 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e595302-ba9b-4128-9beb-15c3b025455e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:37:45.545636 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 801/1625] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 14 09:37:45 2022] POST /identity/v3/projects => generated 373 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:37:45.548328 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0249a25-d1ba-4de0-9441-95f63f52fe3c admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:37:45.669279 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e595302-ba9b-4128-9beb-15c3b025455e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:37:45.676857 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e595302-ba9b-4128-9beb-15c3b025455e service nova] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:37:45.692124 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0249a25-d1ba-4de0-9441-95f63f52fe3c admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:37:45.720801 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 825/1626] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:37:45 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:37:45.721904 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e595302-ba9b-4128-9beb-15c3b025455e service nova] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:37:45.726259 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7446128c-9e59-409f-a3d1-5fc80d924db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:37:45.727029 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7446128c-9e59-409f-a3d1-5fc80d924db5 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:37:45.727323 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7446128c-9e59-409f-a3d1-5fc80d924db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:37:45.727602 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7446128c-9e59-409f-a3d1-5fc80d924db5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:37:45.728959 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7446128c-9e59-409f-a3d1-5fc80d924db5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:37:45.736187 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7446128c-9e59-409f-a3d1-5fc80d924db5 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:37:45.767708 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 802/1627] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 09:37:45 2022] GET /identity/v3/roles => generated 1420 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:37:45.769721 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7446128c-9e59-409f-a3d1-5fc80d924db5 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:37:45.815722 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7446128c-9e59-409f-a3d1-5fc80d924db5 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:37:45.837205 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2301b9e8-a618-4f68-b182-910fbdd01a9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:37:45.837903 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2301b9e8-a618-4f68-b182-910fbdd01a9f admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:37:45.838208 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2301b9e8-a618-4f68-b182-910fbdd01a9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:37:45.838495 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2301b9e8-a618-4f68-b182-910fbdd01a9f admin admin] PATH_INFO: `/v3/users` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:37:45.842586 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2301b9e8-a618-4f68-b182-910fbdd01a9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:37:45.850768 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2301b9e8-a618-4f68-b182-910fbdd01a9f admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:37:45.901330 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 803/1628] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 14 09:37:45 2022] POST /identity/v3/users => generated 293 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:37:45.901330 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2301b9e8-a618-4f68-b182-910fbdd01a9f admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:37:45.903835 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e595302-ba9b-4128-9beb-15c3b025455e service nova] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:37:45.928573 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2301b9e8-a618-4f68-b182-910fbdd01a9f admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:37:45.941677 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e77781-b994-478a-860b-9bf18f3b66e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:37:45.944260 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e77781-b994-478a-860b-9bf18f3b66e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:37:45.944260 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e77781-b994-478a-860b-9bf18f3b66e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:37:45.945357 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e77781-b994-478a-860b-9bf18f3b66e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:37:45.946172 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e77781-b994-478a-860b-9bf18f3b66e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:37:45.949892 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e77781-b994-478a-860b-9bf18f3b66e7 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:37:45.989900 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 804/1629] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 09:37:45 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:37:45.990641 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e77781-b994-478a-860b-9bf18f3b66e7 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:37:45.996057 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:37:46.016120 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e77781-b994-478a-860b-9bf18f3b66e7 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:37:46.026774 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46be88cb-1ab0-4f83-8f9a-d10e72ed67e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:37:46.028986 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46be88cb-1ab0-4f83-8f9a-d10e72ed67e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:37:46.029266 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46be88cb-1ab0-4f83-8f9a-d10e72ed67e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:37:46.032266 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46be88cb-1ab0-4f83-8f9a-d10e72ed67e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:37:46.033114 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46be88cb-1ab0-4f83-8f9a-d10e72ed67e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:37:46.035860 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85d82a5-925a-49ab-a8cb-e3960f4fdb63 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25048b29787d482783ebc944f1a7df65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:37:46.037022 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85d82a5-925a-49ab-a8cb-e3960f4fdb63 service cinder] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:37:46.037022 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85d82a5-925a-49ab-a8cb-e3960f4fdb63 service cinder] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:37:46.037323 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85d82a5-925a-49ab-a8cb-e3960f4fdb63 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:37:46.038587 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46be88cb-1ab0-4f83-8f9a-d10e72ed67e6 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:37:46.068373 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 805/1630] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 09:37:45 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:37:46.068373 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46be88cb-1ab0-4f83-8f9a-d10e72ed67e6 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:37:46.092228 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46be88cb-1ab0-4f83-8f9a-d10e72ed67e6 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:37:46.105944 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ebdf32-f1c5-4c8a-867c-0bc468fc423c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:37:46.107248 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ebdf32-f1c5-4c8a-867c-0bc468fc423c admin admin] REQUEST_METHOD: `PUT` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:37:46.107669 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ebdf32-f1c5-4c8a-867c-0bc468fc423c admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:37:46.107669 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ebdf32-f1c5-4c8a-867c-0bc468fc423c admin admin] PATH_INFO: `/v3/projects/e0a3b4c8745f45e99e6a4313cf24f73c/users/c644eee5beb24eeb94e1581c10e6a711/roles/17dfac38a2e540fea229af7de99911bb` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:37:46.124220 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:37:46.129287 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ebdf32-f1c5-4c8a-867c-0bc468fc423c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0a3b4c8745f45e99e6a4313cf24f73c, user_id=c644eee5beb24eeb94e1581c10e6a711, role_id=17dfac38a2e540fea229af7de99911bb)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:37:46.136389 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ebdf32-f1c5-4c8a-867c-0bc468fc423c admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:37:46.161771 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 806/1631] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 14 09:37:46 2022] PUT /identity/v3/projects/e0a3b4c8745f45e99e6a4313cf24f73c/users/c644eee5beb24eeb94e1581c10e6a711/roles/17dfac38a2e540fea229af7de99911bb => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:37:46.163242 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ebdf32-f1c5-4c8a-867c-0bc468fc423c admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:37:46.225169 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85d82a5-925a-49ab-a8cb-e3960f4fdb63 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:37:46.226753 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85d82a5-925a-49ab-a8cb-e3960f4fdb63 service cinder] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:37:46.262484 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 826/1632] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:37:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 541 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:37:46.268082 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd68d7a-e5ab-4d4e-bf76-1c224af08d5a None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:37:46.268388 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd68d7a-e5ab-4d4e-bf76-1c224af08d5a None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:37:46.268677 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd68d7a-e5ab-4d4e-bf76-1c224af08d5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:37:46.340453 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-bcd68d7a-e5ab-4d4e-bf76-1c224af08d5a None None] MFA Rules not processed for user `c644eee5beb24eeb94e1581c10e6a711`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:37:46.341680 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-bcd68d7a-e5ab-4d4e-bf76-1c224af08d5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:37:46.403734 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ebdf32-f1c5-4c8a-867c-0bc468fc423c admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:37:46.403734 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8d99b2-2513-4184-bba0-51c3e4c13121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:37:46.403734 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8d99b2-2513-4184-bba0-51c3e4c13121 admin admin] REQUEST_METHOD: `PUT` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:37:46.403734 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8d99b2-2513-4184-bba0-51c3e4c13121 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:37:46.404761 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8d99b2-2513-4184-bba0-51c3e4c13121 admin admin] PATH_INFO: `/v3/projects/a060fcb5cc49476b87072db544fd82be/users/eb6f8567ccef4b33abbe039acf743522/roles/e3965bd0d5f1427a86a313c0c90bfef3` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:37:46.487253 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8d99b2-2513-4184-bba0-51c3e4c13121 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a060fcb5cc49476b87072db544fd82be, user_id=eb6f8567ccef4b33abbe039acf743522, role_id=e3965bd0d5f1427a86a313c0c90bfef3)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:37:46.490158 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8d99b2-2513-4184-bba0-51c3e4c13121 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:37:46.563255 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 827/1633] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:37:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:37:46.564929 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 807/1634] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 14 09:37:46 2022] PUT /identity/v3/projects/a060fcb5cc49476b87072db544fd82be/users/eb6f8567ccef4b33abbe039acf743522/roles/e3965bd0d5f1427a86a313c0c90bfef3 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:37:46.565078 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19c2632-75ed-499c-b919-270b37e7754c None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:37:46.567984 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19c2632-75ed-499c-b919-270b37e7754c None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:37:46.567984 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19c2632-75ed-499c-b919-270b37e7754c None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:37:46.571847 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8d99b2-2513-4184-bba0-51c3e4c13121 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:37:46.577771 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 828/1635] 10.222.0.40 () {54 vars in 912 bytes} [Thu Jul 14 09:37:46 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:37:46.581893 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19c2632-75ed-499c-b919-270b37e7754c None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:37:46.770553 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19c2632-75ed-499c-b919-270b37e7754c None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:37:46.786229 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8507680-d503-42a5-afcd-d6acb383cbb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:37:46.786905 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8507680-d503-42a5-afcd-d6acb383cbb8 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:37:46.787194 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8507680-d503-42a5-afcd-d6acb383cbb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:37:46.789423 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8507680-d503-42a5-afcd-d6acb383cbb8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:37:46.790155 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8507680-d503-42a5-afcd-d6acb383cbb8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:37:46.790817 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8d99b2-2513-4184-bba0-51c3e4c13121 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:37:46.795549 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8507680-d503-42a5-afcd-d6acb383cbb8 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:37:46.800046 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e9c372-1493-43ae-b045-656bbc8aff3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:37:46.801970 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e9c372-1493-43ae-b045-656bbc8aff3c admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:37:46.803439 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e9c372-1493-43ae-b045-656bbc8aff3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:37:46.803946 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e9c372-1493-43ae-b045-656bbc8aff3c admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:37:46.804714 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e9c372-1493-43ae-b045-656bbc8aff3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:37:46.807920 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e9c372-1493-43ae-b045-656bbc8aff3c admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:37:46.822859 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:37:46.838541 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 808/1636] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 09:37:46 2022] GET /identity/v3/roles => generated 1420 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:37:46.840783 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5513aa-0b6d-4175-a735-6dee1f738610 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:37:46.841196 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5513aa-0b6d-4175-a735-6dee1f738610 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:37:46.841468 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5513aa-0b6d-4175-a735-6dee1f738610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:37:46.863079 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 829/1637] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 14 09:37:46 2022] POST /identity/v3/projects => generated 387 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:37:46.864001 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8507680-d503-42a5-afcd-d6acb383cbb8 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:37:46.875984 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-de5513aa-0b6d-4175-a735-6dee1f738610 None None] MFA Rules not processed for user `1f6962106dfa4c4c9af551053f8095e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:37:46.877792 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-de5513aa-0b6d-4175-a735-6dee1f738610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:37:46.969757 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8507680-d503-42a5-afcd-d6acb383cbb8 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:37:46.981125 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0c832a-1f29-4fc8-a6fc-fc3ac6b418fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:37:46.982000 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0c832a-1f29-4fc8-a6fc-fc3ac6b418fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:37:46.982563 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0c832a-1f29-4fc8-a6fc-fc3ac6b418fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:37:46.982872 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0c832a-1f29-4fc8-a6fc-fc3ac6b418fe admin admin] PATH_INFO: `/v3/users/43d67da8d2554d6c9eb1e28eca883b87` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:37:46.984102 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0c832a-1f29-4fc8-a6fc-fc3ac6b418fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=43d67da8d2554d6c9eb1e28eca883b87)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:37:46.986739 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0c832a-1f29-4fc8-a6fc-fc3ac6b418fe admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:37:46.999272 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:37:47.031918 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 809/1638] 10.222.0.40 () {58 vars in 1009 bytes} [Thu Jul 14 09:37:46 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:37:47.033879 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5513aa-0b6d-4175-a735-6dee1f738610 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:37:47.068046 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5513aa-0b6d-4175-a735-6dee1f738610 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:37:47.079209 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2d5174-bc51-433b-ad62-10678eb1b353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:37:47.084367 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2d5174-bc51-433b-ad62-10678eb1b353 admin admin] REQUEST_METHOD: `PUT` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:37:47.084665 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2d5174-bc51-433b-ad62-10678eb1b353 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:37:47.086170 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2d5174-bc51-433b-ad62-10678eb1b353 admin admin] PATH_INFO: `/v3/projects/a060fcb5cc49476b87072db544fd82be/users/eb6f8567ccef4b33abbe039acf743522/roles/e3965bd0d5f1427a86a313c0c90bfef3` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:37:47.092696 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2d5174-bc51-433b-ad62-10678eb1b353 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a060fcb5cc49476b87072db544fd82be, user_id=eb6f8567ccef4b33abbe039acf743522, role_id=e3965bd0d5f1427a86a313c0c90bfef3)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:37:47.097385 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-3f0c832a-1f29-4fc8-a6fc-fc3ac6b418fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43d67da8d2554d6c9eb1e28eca883b87'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:37:47.102346 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2d5174-bc51-433b-ad62-10678eb1b353 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:37:47.118702 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-3f0c832a-1f29-4fc8-a6fc-fc3ac6b418fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43d67da8d2554d6c9eb1e28eca883b87'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:37:47.120807 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-3f0c832a-1f29-4fc8-a6fc-fc3ac6b418fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43d67da8d2554d6c9eb1e28eca883b87'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:37:47.130573 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 810/1639] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 14 09:37:47 2022] PUT /identity/v3/projects/a060fcb5cc49476b87072db544fd82be/users/eb6f8567ccef4b33abbe039acf743522/roles/e3965bd0d5f1427a86a313c0c90bfef3 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:37:47.132845 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2d5174-bc51-433b-ad62-10678eb1b353 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:37:47.136781 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-3f0c832a-1f29-4fc8-a6fc-fc3ac6b418fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43d67da8d2554d6c9eb1e28eca883b87'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:37:47.153293 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-3f0c832a-1f29-4fc8-a6fc-fc3ac6b418fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43d67da8d2554d6c9eb1e28eca883b87'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:37:47.179806 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 830/1640] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 14 09:37:46 2022] DELETE /identity/v3/users/43d67da8d2554d6c9eb1e28eca883b87 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:37:47.187347 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0c832a-1f29-4fc8-a6fc-fc3ac6b418fe admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:37:47.194919 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-3f0c832a-1f29-4fc8-a6fc-fc3ac6b418fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:37:47.322793 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2d5174-bc51-433b-ad62-10678eb1b353 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:37:47.361424 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0c832a-1f29-4fc8-a6fc-fc3ac6b418fe admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:37:47.373606 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4484f4-df0b-483b-8d63-666a190e7f51 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25048b29787d482783ebc944f1a7df65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:37:47.374311 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4484f4-df0b-483b-8d63-666a190e7f51 service cinder] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:37:47.374645 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4484f4-df0b-483b-8d63-666a190e7f51 service cinder] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:37:47.375315 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4484f4-df0b-483b-8d63-666a190e7f51 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:37:47.379626 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-cc4484f4-df0b-483b-8d63-666a190e7f51 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:37:47.442509 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:37:47.475156 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3204ce4-9763-46d0-a313-8883c4491abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:37:47.475938 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3204ce4-9763-46d0-a313-8883c4491abb admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:37:47.476229 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3204ce4-9763-46d0-a313-8883c4491abb admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:37:47.476505 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3204ce4-9763-46d0-a313-8883c4491abb admin admin] PATH_INFO: `/v3/users` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:37:47.477276 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3204ce4-9763-46d0-a313-8883c4491abb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:37:47.479528 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3204ce4-9763-46d0-a313-8883c4491abb admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:37:47.520230 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 811/1641] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 14 09:37:47 2022] POST /identity/v3/users => generated 300 bytes in 389 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:37:47.521788 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314863e0-c2d3-472a-922e-80b1fba8e013 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:37:47.522089 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314863e0-c2d3-472a-922e-80b1fba8e013 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:37:47.522393 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314863e0-c2d3-472a-922e-80b1fba8e013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:37:47.586425 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-314863e0-c2d3-472a-922e-80b1fba8e013 None None] MFA Rules not processed for user `eb6f8567ccef4b33abbe039acf743522`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:37:47.587746 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-314863e0-c2d3-472a-922e-80b1fba8e013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:37:47.601948 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4484f4-df0b-483b-8d63-666a190e7f51 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:37:47.605943 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4484f4-df0b-483b-8d63-666a190e7f51 service cinder] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:37:47.646849 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 831/1642] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:37:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:37:47.649444 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34a73b4-2d74-491b-8a03-3c3cd1cc1c1d None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:37:47.651279 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34a73b4-2d74-491b-8a03-3c3cd1cc1c1d None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:37:47.652452 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34a73b4-2d74-491b-8a03-3c3cd1cc1c1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:37:47.707103 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-d34a73b4-2d74-491b-8a03-3c3cd1cc1c1d None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:37:47.710496 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-d34a73b4-2d74-491b-8a03-3c3cd1cc1c1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:37:47.730903 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 832/1643] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:37:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:37:47.731746 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34a73b4-2d74-491b-8a03-3c3cd1cc1c1d None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:37:47.734763 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-d34a73b4-2d74-491b-8a03-3c3cd1cc1c1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:37:47.760978 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34a73b4-2d74-491b-8a03-3c3cd1cc1c1d None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:37:47.773686 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fef745-82f9-4c55-af35-ac091388b331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:37:47.774412 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fef745-82f9-4c55-af35-ac091388b331 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:37:47.774702 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fef745-82f9-4c55-af35-ac091388b331 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:37:47.775044 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fef745-82f9-4c55-af35-ac091388b331 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:37:47.775898 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fef745-82f9-4c55-af35-ac091388b331 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:37:47.777424 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fef745-82f9-4c55-af35-ac091388b331 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:37:47.792456 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 812/1644] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:37:47 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:37:47.805462 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314863e0-c2d3-472a-922e-80b1fba8e013 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:37:47.807136 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 833/1645] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 09:37:47 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:37:47.811107 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-314863e0-c2d3-472a-922e-80b1fba8e013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:37:47.811663 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fef745-82f9-4c55-af35-ac091388b331 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:37:47.833591 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fef745-82f9-4c55-af35-ac091388b331 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:37:47.837042 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314863e0-c2d3-472a-922e-80b1fba8e013 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:37:47.847801 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8f4bac-776b-4b52-a9b7-7fc3c29326d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:37:47.848800 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8f4bac-776b-4b52-a9b7-7fc3c29326d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:37:47.849141 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8f4bac-776b-4b52-a9b7-7fc3c29326d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:37:47.849431 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8f4bac-776b-4b52-a9b7-7fc3c29326d1 admin admin] PATH_INFO: `/v3/projects/17636184eace437c914ec860de321612/users/014036a68b144aa095ad96c4b2749d76/roles/e3965bd0d5f1427a86a313c0c90bfef3` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:37:47.849857 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b313dee-6fb1-41e7-80e1-f1471e825b26 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25048b29787d482783ebc944f1a7df65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:37:47.850873 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b313dee-6fb1-41e7-80e1-f1471e825b26 service cinder] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:37:47.851267 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b313dee-6fb1-41e7-80e1-f1471e825b26 service cinder] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:37:47.852319 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b313dee-6fb1-41e7-80e1-f1471e825b26 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:37:47.873290 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:37:47.877760 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b313dee-6fb1-41e7-80e1-f1471e825b26 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:37:47.882917 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b313dee-6fb1-41e7-80e1-f1471e825b26 service cinder] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:37:47.893688 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8f4bac-776b-4b52-a9b7-7fc3c29326d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17636184eace437c914ec860de321612, user_id=014036a68b144aa095ad96c4b2749d76, role_id=e3965bd0d5f1427a86a313c0c90bfef3)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:37:47.898686 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8f4bac-776b-4b52-a9b7-7fc3c29326d1 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:37:47.915888 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 813/1646] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:37:47 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:37:47.949148 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 834/1647] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 14 09:37:47 2022] PUT /identity/v3/projects/17636184eace437c914ec860de321612/users/014036a68b144aa095ad96c4b2749d76/roles/e3965bd0d5f1427a86a313c0c90bfef3 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:37:47.950635 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b313dee-6fb1-41e7-80e1-f1471e825b26 service cinder] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:37:47.959910 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8f4bac-776b-4b52-a9b7-7fc3c29326d1 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:37:47.963333 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-9a8f4bac-776b-4b52-a9b7-7fc3c29326d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:37:47.985055 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b313dee-6fb1-41e7-80e1-f1471e825b26 service cinder] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:37:48.100467 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8f4bac-776b-4b52-a9b7-7fc3c29326d1 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:37:48.118351 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30180617-29f5-4b42-9bc4-372269a439bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e4a5a8965e4802a9055d332179b7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:37:48.119053 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30180617-29f5-4b42-9bc4-372269a439bc service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:37:48.119343 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30180617-29f5-4b42-9bc4-372269a439bc service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:37:48.119643 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30180617-29f5-4b42-9bc4-372269a439bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:37:48.201443 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229f9597-bec1-4757-a9b9-90453805004b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:37:48.202743 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229f9597-bec1-4757-a9b9-90453805004b admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:37:48.205049 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229f9597-bec1-4757-a9b9-90453805004b admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:37:48.206017 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229f9597-bec1-4757-a9b9-90453805004b admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:37:48.212418 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229f9597-bec1-4757-a9b9-90453805004b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:37:48.218730 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229f9597-bec1-4757-a9b9-90453805004b admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:37:48.234253 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 814/1648] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 09:37:47 2022] GET /identity/v3/roles => generated 1420 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:37:48.240102 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229f9597-bec1-4757-a9b9-90453805004b admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:37:48.268282 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229f9597-bec1-4757-a9b9-90453805004b admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:37:48.277229 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30180617-29f5-4b42-9bc4-372269a439bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:37:48.278733 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30180617-29f5-4b42-9bc4-372269a439bc service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:37:48.294209 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2e1912-8d9a-402e-a777-ba1ac14ae9a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:37:48.295426 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2e1912-8d9a-402e-a777-ba1ac14ae9a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:37:48.296150 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2e1912-8d9a-402e-a777-ba1ac14ae9a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:37:48.297529 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2e1912-8d9a-402e-a777-ba1ac14ae9a5 admin admin] PATH_INFO: `/v3/projects/17636184eace437c914ec860de321612/users/014036a68b144aa095ad96c4b2749d76/roles/e3965bd0d5f1427a86a313c0c90bfef3` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:37:48.302906 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 835/1649] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:37:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 09:37:48.303940 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2e1912-8d9a-402e-a777-ba1ac14ae9a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17636184eace437c914ec860de321612, user_id=014036a68b144aa095ad96c4b2749d76, role_id=e3965bd0d5f1427a86a313c0c90bfef3)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:37:48.331098 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2e1912-8d9a-402e-a777-ba1ac14ae9a5 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:37:48.361196 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 815/1650] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 14 09:37:48 2022] PUT /identity/v3/projects/17636184eace437c914ec860de321612/users/014036a68b144aa095ad96c4b2749d76/roles/e3965bd0d5f1427a86a313c0c90bfef3 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:37:48.372015 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2faf690-e7b8-498d-85ed-eb2dd4c3fe11 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:37:48.372578 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2faf690-e7b8-498d-85ed-eb2dd4c3fe11 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:37:48.372578 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2faf690-e7b8-498d-85ed-eb2dd4c3fe11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:37:48.460099 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-c2faf690-e7b8-498d-85ed-eb2dd4c3fe11 None None] MFA Rules not processed for user `014036a68b144aa095ad96c4b2749d76`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:37:48.461362 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-c2faf690-e7b8-498d-85ed-eb2dd4c3fe11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:37:48.481140 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:37:48.661186 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 836/1651] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:37:48 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:37:48.696641 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2e1912-8d9a-402e-a777-ba1ac14ae9a5 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:37:48.908412 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2faf690-e7b8-498d-85ed-eb2dd4c3fe11 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:37:48.909840 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-c2faf690-e7b8-498d-85ed-eb2dd4c3fe11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:37:48.955136 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2e1912-8d9a-402e-a777-ba1ac14ae9a5 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:37:48.972477 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f514ab-6771-4e88-b7d4-22970a15c6a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25048b29787d482783ebc944f1a7df65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:37:48.973162 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f514ab-6771-4e88-b7d4-22970a15c6a1 service cinder] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:37:48.973445 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f514ab-6771-4e88-b7d4-22970a15c6a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:37:48.973718 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f514ab-6771-4e88-b7d4-22970a15c6a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:37:49.017171 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f514ab-6771-4e88-b7d4-22970a15c6a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:37:49.019144 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f514ab-6771-4e88-b7d4-22970a15c6a1 service cinder] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:37:49.060432 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 816/1652] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:37:48 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:37:49.108356 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2faf690-e7b8-498d-85ed-eb2dd4c3fe11 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:37:49.115451 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1851a5-5101-4764-908a-f5042eddc3fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:37:49.116675 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1851a5-5101-4764-908a-f5042eddc3fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:37:49.116974 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1851a5-5101-4764-908a-f5042eddc3fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:37:49.117467 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1851a5-5101-4764-908a-f5042eddc3fc admin admin] PATH_INFO: `/v3/users/37639dda61504653a4c74cd37e587ecf` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:37:49.118992 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1851a5-5101-4764-908a-f5042eddc3fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=37639dda61504653a4c74cd37e587ecf)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:37:49.122391 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1851a5-5101-4764-908a-f5042eddc3fc admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:37:49.246926 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-6e1851a5-5101-4764-908a-f5042eddc3fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37639dda61504653a4c74cd37e587ecf'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:37:49.282449 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-6e1851a5-5101-4764-908a-f5042eddc3fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37639dda61504653a4c74cd37e587ecf'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:37:49.283480 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-6e1851a5-5101-4764-908a-f5042eddc3fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37639dda61504653a4c74cd37e587ecf'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:37:49.306660 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-6e1851a5-5101-4764-908a-f5042eddc3fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37639dda61504653a4c74cd37e587ecf'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:37:49.319602 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-6e1851a5-5101-4764-908a-f5042eddc3fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37639dda61504653a4c74cd37e587ecf'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:37:49.337588 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 837/1653] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 14 09:37:48 2022] DELETE /identity/v3/users/37639dda61504653a4c74cd37e587ecf => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:37:49.341999 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb81f0c4-026f-4b0b-a68a-4658f90737ea None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:37:49.342390 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb81f0c4-026f-4b0b-a68a-4658f90737ea None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:37:49.342671 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb81f0c4-026f-4b0b-a68a-4658f90737ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:37:49.368105 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-bb81f0c4-026f-4b0b-a68a-4658f90737ea None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:37:49.369332 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-bb81f0c4-026f-4b0b-a68a-4658f90737ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:37:49.485384 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 817/1654] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:37:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:37:49.569612 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1851a5-5101-4764-908a-f5042eddc3fc admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:37:49.571402 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-6e1851a5-5101-4764-908a-f5042eddc3fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:37:49.639158 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:37:49.721043 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1851a5-5101-4764-908a-f5042eddc3fc admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:37:49.738085 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f025b65d-1e28-4097-b3fb-a9ddb02ee3c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e4a5a8965e4802a9055d332179b7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:37:49.738904 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f025b65d-1e28-4097-b3fb-a9ddb02ee3c4 service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:37:49.739197 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f025b65d-1e28-4097-b3fb-a9ddb02ee3c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:37:49.739483 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f025b65d-1e28-4097-b3fb-a9ddb02ee3c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:37:49.758860 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f025b65d-1e28-4097-b3fb-a9ddb02ee3c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:37:49.760339 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f025b65d-1e28-4097-b3fb-a9ddb02ee3c4 service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:37:49.782921 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 838/1655] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:37:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:37:49.867109 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb81f0c4-026f-4b0b-a68a-4658f90737ea None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:37:49.869581 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-bb81f0c4-026f-4b0b-a68a-4658f90737ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:37:49.909203 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb81f0c4-026f-4b0b-a68a-4658f90737ea None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:37:49.920379 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d09f05-a8e7-49fa-ad42-72a91a4efee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:37:49.923546 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d09f05-a8e7-49fa-ad42-72a91a4efee3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:37:49.924459 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d09f05-a8e7-49fa-ad42-72a91a4efee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:37:49.925128 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d09f05-a8e7-49fa-ad42-72a91a4efee3 admin admin] PATH_INFO: `/v3/projects/a4324e0082184371a7f886a43dcfb358` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:37:49.928001 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d09f05-a8e7-49fa-ad42-72a91a4efee3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4324e0082184371a7f886a43dcfb358)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:37:49.935495 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d09f05-a8e7-49fa-ad42-72a91a4efee3 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:37:50.005387 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:37:50.069492 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-f7d09f05-a8e7-49fa-ad42-72a91a4efee3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4324e0082184371a7f886a43dcfb358', 'request_id': 'req-f7d09f05-a8e7-49fa-ad42-72a91a4efee3'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:37:50.090213 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-f7d09f05-a8e7-49fa-ad42-72a91a4efee3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4324e0082184371a7f886a43dcfb358', 'request_id': 'req-f7d09f05-a8e7-49fa-ad42-72a91a4efee3'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:37:50.097585 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-f7d09f05-a8e7-49fa-ad42-72a91a4efee3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4324e0082184371a7f886a43dcfb358', 'request_id': 'req-f7d09f05-a8e7-49fa-ad42-72a91a4efee3'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:37:50.132038 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-f7d09f05-a8e7-49fa-ad42-72a91a4efee3 admin admin] The token cache is being invalidate because project a4324e0082184371a7f886a43dcfb358 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 09:37:50.132337 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-f7d09f05-a8e7-49fa-ad42-72a91a4efee3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:37:50.133574 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-f7d09f05-a8e7-49fa-ad42-72a91a4efee3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:37:50.135233 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 818/1656] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 14 09:37:49 2022] DELETE /identity/v3/projects/a4324e0082184371a7f886a43dcfb358 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:37:50.141556 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0732fe-1fb2-4c21-8ae2-17672654df78 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:37:50.142129 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0732fe-1fb2-4c21-8ae2-17672654df78 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:37:50.143190 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0732fe-1fb2-4c21-8ae2-17672654df78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:37:50.179692 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d09f05-a8e7-49fa-ad42-72a91a4efee3 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:37:50.182303 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-f7d09f05-a8e7-49fa-ad42-72a91a4efee3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:37:50.195437 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-9a0732fe-1fb2-4c21-8ae2-17672654df78 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:37:50.197747 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-9a0732fe-1fb2-4c21-8ae2-17672654df78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:37:50.318798 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d09f05-a8e7-49fa-ad42-72a91a4efee3 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:37:50.328312 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d3b6aa-7e72-44e3-a473-4a5957265bb7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25048b29787d482783ebc944f1a7df65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:37:50.329053 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d3b6aa-7e72-44e3-a473-4a5957265bb7 service cinder] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:37:50.329288 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d3b6aa-7e72-44e3-a473-4a5957265bb7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:37:50.329569 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d3b6aa-7e72-44e3-a473-4a5957265bb7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:37:50.340012 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-64d3b6aa-7e72-44e3-a473-4a5957265bb7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:37:50.395250 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 839/1657] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:37:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:37:50.404463 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4944ccf-ac9b-427a-9847-3593b0f8e217 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:37:50.405821 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4944ccf-ac9b-427a-9847-3593b0f8e217 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:37:50.408016 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4944ccf-ac9b-427a-9847-3593b0f8e217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:37:50.417920 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d3b6aa-7e72-44e3-a473-4a5957265bb7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:37:50.419604 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d3b6aa-7e72-44e3-a473-4a5957265bb7 service cinder] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:37:50.435200 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 819/1658] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:37:50 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 09:37:50.439852 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-b4944ccf-ac9b-427a-9847-3593b0f8e217 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:37:50.441136 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-b4944ccf-ac9b-427a-9847-3593b0f8e217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:37:50.450264 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 840/1659] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:37:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:37:50.454103 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d3b6aa-7e72-44e3-a473-4a5957265bb7 service cinder] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:37:50.469815 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d3b6aa-7e72-44e3-a473-4a5957265bb7 service cinder] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:37:50.474703 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c25954-e2b4-42ee-8490-77d8ef6acb1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:37:50.475527 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c25954-e2b4-42ee-8490-77d8ef6acb1e admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:37:50.475829 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c25954-e2b4-42ee-8490-77d8ef6acb1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:37:50.476109 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c25954-e2b4-42ee-8490-77d8ef6acb1e admin admin] PATH_INFO: `/v3/domains` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:37:50.477030 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c25954-e2b4-42ee-8490-77d8ef6acb1e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:37:50.477351 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c25954-e2b4-42ee-8490-77d8ef6acb1e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:37:50.479309 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c25954-e2b4-42ee-8490-77d8ef6acb1e admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:37:50.497738 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 820/1660] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jul 14 09:37:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:37:50.502827 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4944ccf-ac9b-427a-9847-3593b0f8e217 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:37:50.512286 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4944ccf-ac9b-427a-9847-3593b0f8e217 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:37:50.518453 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc962c83-8e7c-4cd5-9036-c12e7a242b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:37:50.519158 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc962c83-8e7c-4cd5-9036-c12e7a242b1c admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:37:50.519452 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc962c83-8e7c-4cd5-9036-c12e7a242b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:37:50.519734 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc962c83-8e7c-4cd5-9036-c12e7a242b1c admin admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:37:50.520633 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc962c83-8e7c-4cd5-9036-c12e7a242b1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:37:50.526564 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc962c83-8e7c-4cd5-9036-c12e7a242b1c admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:37:50.643978 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 841/1661] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 14 09:37:50 2022] POST /identity/v3/projects => generated 403 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 09:37:50.649619 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c25954-e2b4-42ee-8490-77d8ef6acb1e admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:37:50.673205 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c25954-e2b4-42ee-8490-77d8ef6acb1e admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:37:50.741690 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc962c83-8e7c-4cd5-9036-c12e7a242b1c admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:37:50.744204 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-fc962c83-8e7c-4cd5-9036-c12e7a242b1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:37:50.787002 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:37:50.829774 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfac0c60-6150-4f36-96ca-2d677653c65b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:37:50.830681 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfac0c60-6150-4f36-96ca-2d677653c65b admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:37:50.832991 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfac0c60-6150-4f36-96ca-2d677653c65b admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:37:50.833418 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfac0c60-6150-4f36-96ca-2d677653c65b admin admin] PATH_INFO: `/v3/users` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:37:50.836065 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfac0c60-6150-4f36-96ca-2d677653c65b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:37:50.838165 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfac0c60-6150-4f36-96ca-2d677653c65b admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:37:50.903681 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 821/1662] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 14 09:37:50 2022] POST /identity/v3/users => generated 302 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:37:50.905437 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfac0c60-6150-4f36-96ca-2d677653c65b admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:37:50.909788 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc962c83-8e7c-4cd5-9036-c12e7a242b1c admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:37:50.916379 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51280759-f610-4b09-a161-f139d626e0cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:37:50.917843 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51280759-f610-4b09-a161-f139d626e0cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:37:50.918545 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51280759-f610-4b09-a161-f139d626e0cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:37:50.919798 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51280759-f610-4b09-a161-f139d626e0cb admin admin] PATH_INFO: `/v3/projects/6548d25383e940f7bd6885b4b0fb6dbf` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:37:50.921533 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51280759-f610-4b09-a161-f139d626e0cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=6548d25383e940f7bd6885b4b0fb6dbf)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:37:50.923191 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: WARNING py.warnings [None req-51280759-f610-4b09-a161-f139d626e0cb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 09:37:50.923191 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: warnings.warn(msg) Jul 14 09:37:50.923191 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: Jul 14 09:37:50.925443 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51280759-f610-4b09-a161-f139d626e0cb admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:37:50.951944 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfac0c60-6150-4f36-96ca-2d677653c65b admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:37:50.971130 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72b1aee-2c32-4647-a9d3-8acc44a4b692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:37:50.974105 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72b1aee-2c32-4647-a9d3-8acc44a4b692 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:37:50.977146 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72b1aee-2c32-4647-a9d3-8acc44a4b692 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:37:50.981134 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72b1aee-2c32-4647-a9d3-8acc44a4b692 admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:37:50.981134 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72b1aee-2c32-4647-a9d3-8acc44a4b692 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:37:50.981134 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72b1aee-2c32-4647-a9d3-8acc44a4b692 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:37:51.013342 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 822/1663] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 09:37:50 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:37:51.018014 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72b1aee-2c32-4647-a9d3-8acc44a4b692 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:37:51.030378 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:37:51.054945 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-51280759-f610-4b09-a161-f139d626e0cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6548d25383e940f7bd6885b4b0fb6dbf', 'request_id': 'req-51280759-f610-4b09-a161-f139d626e0cb'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:37:51.082379 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72b1aee-2c32-4647-a9d3-8acc44a4b692 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:37:51.110973 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-51280759-f610-4b09-a161-f139d626e0cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6548d25383e940f7bd6885b4b0fb6dbf', 'request_id': 'req-51280759-f610-4b09-a161-f139d626e0cb'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:37:51.142969 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-51280759-f610-4b09-a161-f139d626e0cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6548d25383e940f7bd6885b4b0fb6dbf', 'request_id': 'req-51280759-f610-4b09-a161-f139d626e0cb'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:37:51.186291 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-51280759-f610-4b09-a161-f139d626e0cb admin admin] The token cache is being invalidate because project 6548d25383e940f7bd6885b4b0fb6dbf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 09:37:51.186636 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-51280759-f610-4b09-a161-f139d626e0cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:37:51.190708 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-51280759-f610-4b09-a161-f139d626e0cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:37:51.198540 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 842/1664] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 14 09:37:50 2022] DELETE /identity/v3/projects/6548d25383e940f7bd6885b4b0fb6dbf => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 09:37:51.204022 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51280759-f610-4b09-a161-f139d626e0cb admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:37:51.209439 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-51280759-f610-4b09-a161-f139d626e0cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:37:51.322034 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61657f3-c457-4fa6-99d2-d1dad7fb6e0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:37:51.322918 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61657f3-c457-4fa6-99d2-d1dad7fb6e0a admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:37:51.323510 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61657f3-c457-4fa6-99d2-d1dad7fb6e0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:37:51.324003 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61657f3-c457-4fa6-99d2-d1dad7fb6e0a admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:37:51.325148 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61657f3-c457-4fa6-99d2-d1dad7fb6e0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:37:51.327099 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61657f3-c457-4fa6-99d2-d1dad7fb6e0a admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:37:51.345623 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 823/1665] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 09:37:51 2022] GET /identity/v3/roles => generated 1420 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:37:51.348960 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61657f3-c457-4fa6-99d2-d1dad7fb6e0a admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:37:51.351605 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-d61657f3-c457-4fa6-99d2-d1dad7fb6e0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:37:51.401846 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61657f3-c457-4fa6-99d2-d1dad7fb6e0a admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:37:51.411626 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4a44fe-c61e-4f78-a2e8-de3b9a1fef14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:37:51.414148 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4a44fe-c61e-4f78-a2e8-de3b9a1fef14 admin admin] REQUEST_METHOD: `PUT` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:37:51.414489 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4a44fe-c61e-4f78-a2e8-de3b9a1fef14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:37:51.415137 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4a44fe-c61e-4f78-a2e8-de3b9a1fef14 admin admin] PATH_INFO: `/v3/projects/a151dc1a715748d0914da7af4f250aba/users/eb9b0b37f81c4dd7b23eab14ae3f475f/roles/17dfac38a2e540fea229af7de99911bb` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:37:51.448008 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4a44fe-c61e-4f78-a2e8-de3b9a1fef14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a151dc1a715748d0914da7af4f250aba, user_id=eb9b0b37f81c4dd7b23eab14ae3f475f, role_id=17dfac38a2e540fea229af7de99911bb)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:37:51.454660 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4a44fe-c61e-4f78-a2e8-de3b9a1fef14 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:37:51.491550 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 824/1666] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 14 09:37:51 2022] PUT /identity/v3/projects/a151dc1a715748d0914da7af4f250aba/users/eb9b0b37f81c4dd7b23eab14ae3f475f/roles/17dfac38a2e540fea229af7de99911bb => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:37:51.503809 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a18e0d7-2517-4805-9b5b-6586e62d1934 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:37:51.504236 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a18e0d7-2517-4805-9b5b-6586e62d1934 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:37:51.504643 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a18e0d7-2517-4805-9b5b-6586e62d1934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:37:51.536067 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51280759-f610-4b09-a161-f139d626e0cb admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:37:51.568386 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-7a18e0d7-2517-4805-9b5b-6586e62d1934 None None] MFA Rules not processed for user `eb9b0b37f81c4dd7b23eab14ae3f475f`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:37:51.573439 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-7a18e0d7-2517-4805-9b5b-6586e62d1934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:37:51.668331 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ac1b7d-5fd9-4532-8722-83088475c211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:37:51.673343 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ac1b7d-5fd9-4532-8722-83088475c211 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:37:51.673563 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ac1b7d-5fd9-4532-8722-83088475c211 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:37:51.674523 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ac1b7d-5fd9-4532-8722-83088475c211 admin admin] PATH_INFO: `/v3/users/eb6f8567ccef4b33abbe039acf743522` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:37:51.676697 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ac1b7d-5fd9-4532-8722-83088475c211 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb6f8567ccef4b33abbe039acf743522)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:37:51.678820 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ac1b7d-5fd9-4532-8722-83088475c211 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:37:51.749220 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 825/1667] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:37:51 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:37:51.751175 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a18e0d7-2517-4805-9b5b-6586e62d1934 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:37:51.790613 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a18e0d7-2517-4805-9b5b-6586e62d1934 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:37:51.807234 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac440d14-ed61-48db-9b3f-b281964c44b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:37:51.808195 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac440d14-ed61-48db-9b3f-b281964c44b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:37:51.808600 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac440d14-ed61-48db-9b3f-b281964c44b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:37:51.809034 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac440d14-ed61-48db-9b3f-b281964c44b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:37:51.810028 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac440d14-ed61-48db-9b3f-b281964c44b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:37:51.812064 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac440d14-ed61-48db-9b3f-b281964c44b5 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:37:51.865381 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 826/1668] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 14 09:37:51 2022] POST /identity/v3/projects => generated 403 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:37:51.887557 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac440d14-ed61-48db-9b3f-b281964c44b5 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:37:51.927086 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:37:51.954386 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-c7ac1b7d-5fd9-4532-8722-83088475c211 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb6f8567ccef4b33abbe039acf743522'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:37:52.012704 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-c7ac1b7d-5fd9-4532-8722-83088475c211 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb6f8567ccef4b33abbe039acf743522'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:37:52.015956 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-c7ac1b7d-5fd9-4532-8722-83088475c211 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb6f8567ccef4b33abbe039acf743522'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:37:52.035176 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-c7ac1b7d-5fd9-4532-8722-83088475c211 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb6f8567ccef4b33abbe039acf743522'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:37:52.044855 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:37:52.054069 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-c7ac1b7d-5fd9-4532-8722-83088475c211 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb6f8567ccef4b33abbe039acf743522'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:37:52.065036 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 843/1669] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 14 09:37:51 2022] DELETE /identity/v3/users/eb6f8567ccef4b33abbe039acf743522 => generated 0 bytes in 863 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:37:52.166496 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac440d14-ed61-48db-9b3f-b281964c44b5 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:37:52.295062 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ba06f2-eb1f-4ba4-ac1b-ef67d5018d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:37:52.296245 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ba06f2-eb1f-4ba4-ac1b-ef67d5018d89 admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:37:52.296634 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ba06f2-eb1f-4ba4-ac1b-ef67d5018d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:37:52.297062 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ba06f2-eb1f-4ba4-ac1b-ef67d5018d89 admin admin] PATH_INFO: `/v3/users` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:37:52.297885 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ba06f2-eb1f-4ba4-ac1b-ef67d5018d89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:37:52.302533 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ba06f2-eb1f-4ba4-ac1b-ef67d5018d89 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:37:52.359032 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 827/1670] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 14 09:37:51 2022] POST /identity/v3/users => generated 308 bytes in 490 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:37:52.360051 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ac1b7d-5fd9-4532-8722-83088475c211 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:37:52.362105 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-c7ac1b7d-5fd9-4532-8722-83088475c211 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:37:52.398460 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ac1b7d-5fd9-4532-8722-83088475c211 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:37:52.422748 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd97355-e59c-4d4e-9ce2-992f0a33cce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:37:52.423459 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd97355-e59c-4d4e-9ce2-992f0a33cce1 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:37:52.423748 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd97355-e59c-4d4e-9ce2-992f0a33cce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:37:52.424032 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd97355-e59c-4d4e-9ce2-992f0a33cce1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:37:52.424791 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd97355-e59c-4d4e-9ce2-992f0a33cce1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:37:52.426535 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd97355-e59c-4d4e-9ce2-992f0a33cce1 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:37:52.470023 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 844/1671] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 09:37:52 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 09:37:52.471393 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ba06f2-eb1f-4ba4-ac1b-ef67d5018d89 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:37:52.486539 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ba06f2-eb1f-4ba4-ac1b-ef67d5018d89 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:37:52.502898 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f50a58-9e12-4e30-a013-d7b8028080e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:37:52.507716 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f50a58-9e12-4e30-a013-d7b8028080e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:37:52.510230 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f50a58-9e12-4e30-a013-d7b8028080e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:37:52.512823 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f50a58-9e12-4e30-a013-d7b8028080e7 admin admin] PATH_INFO: `/v3/projects/4b191029c8f848d3b4d772f16b915158/users/e8ef6643066042029e7ff6cd9d88100b/roles/e3965bd0d5f1427a86a313c0c90bfef3` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:37:52.572198 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f50a58-9e12-4e30-a013-d7b8028080e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b191029c8f848d3b4d772f16b915158, user_id=e8ef6643066042029e7ff6cd9d88100b, role_id=e3965bd0d5f1427a86a313c0c90bfef3)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:37:52.578659 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f50a58-9e12-4e30-a013-d7b8028080e7 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:37:52.622544 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 828/1672] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 14 09:37:52 2022] PUT /identity/v3/projects/4b191029c8f848d3b4d772f16b915158/users/e8ef6643066042029e7ff6cd9d88100b/roles/e3965bd0d5f1427a86a313c0c90bfef3 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:37:52.627066 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd97355-e59c-4d4e-9ce2-992f0a33cce1 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:37:52.663090 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd97355-e59c-4d4e-9ce2-992f0a33cce1 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:37:52.872687 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274a4951-ec8e-4ad6-ac3b-ce0845368fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:37:52.873697 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274a4951-ec8e-4ad6-ac3b-ce0845368fc0 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:37:52.874080 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274a4951-ec8e-4ad6-ac3b-ce0845368fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:37:52.874431 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274a4951-ec8e-4ad6-ac3b-ce0845368fc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:37:52.881105 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274a4951-ec8e-4ad6-ac3b-ce0845368fc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:37:52.882783 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274a4951-ec8e-4ad6-ac3b-ce0845368fc0 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:37:52.909830 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 845/1673] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 09:37:52 2022] GET /identity/v3/roles => generated 1420 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:37:52.913795 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f50a58-9e12-4e30-a013-d7b8028080e7 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:37:52.939591 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f50a58-9e12-4e30-a013-d7b8028080e7 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:37:52.980123 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cddc5f4-5995-4713-84a8-20217d44f432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:37:52.981637 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cddc5f4-5995-4713-84a8-20217d44f432 admin admin] REQUEST_METHOD: `PUT` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:37:52.982118 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cddc5f4-5995-4713-84a8-20217d44f432 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:37:52.983009 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cddc5f4-5995-4713-84a8-20217d44f432 admin admin] PATH_INFO: `/v3/projects/4b191029c8f848d3b4d772f16b915158/users/e8ef6643066042029e7ff6cd9d88100b/roles/e3965bd0d5f1427a86a313c0c90bfef3` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:37:52.986058 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cddc5f4-5995-4713-84a8-20217d44f432 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b191029c8f848d3b4d772f16b915158, user_id=e8ef6643066042029e7ff6cd9d88100b, role_id=e3965bd0d5f1427a86a313c0c90bfef3)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:37:52.989594 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cddc5f4-5995-4713-84a8-20217d44f432 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:37:53.026230 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 829/1674] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 14 09:37:52 2022] PUT /identity/v3/projects/4b191029c8f848d3b4d772f16b915158/users/e8ef6643066042029e7ff6cd9d88100b/roles/e3965bd0d5f1427a86a313c0c90bfef3 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:37:53.036879 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d11da3-ef82-4f95-980d-e2bebc009394 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:37:53.037193 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d11da3-ef82-4f95-980d-e2bebc009394 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:37:53.037457 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d11da3-ef82-4f95-980d-e2bebc009394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:37:53.110296 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-c9d11da3-ef82-4f95-980d-e2bebc009394 None None] MFA Rules not processed for user `e8ef6643066042029e7ff6cd9d88100b`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:37:53.110296 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-c9d11da3-ef82-4f95-980d-e2bebc009394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:37:53.242710 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 846/1675] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:37:53 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:37:53.259268 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cddc5f4-5995-4713-84a8-20217d44f432 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:37:53.261737 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-0cddc5f4-5995-4713-84a8-20217d44f432 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:37:53.398366 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cddc5f4-5995-4713-84a8-20217d44f432 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:37:53.410348 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f56dbf-b372-404b-805f-dccdd931464b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25048b29787d482783ebc944f1a7df65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:37:53.411328 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f56dbf-b372-404b-805f-dccdd931464b service cinder] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:37:53.411724 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f56dbf-b372-404b-805f-dccdd931464b service cinder] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:37:53.412107 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f56dbf-b372-404b-805f-dccdd931464b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:37:53.436005 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f56dbf-b372-404b-805f-dccdd931464b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:37:53.438006 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f56dbf-b372-404b-805f-dccdd931464b service cinder] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:37:53.461932 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 830/1676] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:37:53 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:37:54.433369 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d11da3-ef82-4f95-980d-e2bebc009394 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:37:54.435055 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-c9d11da3-ef82-4f95-980d-e2bebc009394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:37:54.587738 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d11da3-ef82-4f95-980d-e2bebc009394 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:37:54.598686 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68be5e5-1e35-4247-8dfe-bb2535e4a065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:37:54.599591 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68be5e5-1e35-4247-8dfe-bb2535e4a065 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:37:54.600302 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68be5e5-1e35-4247-8dfe-bb2535e4a065 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:37:54.602449 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68be5e5-1e35-4247-8dfe-bb2535e4a065 admin admin] PATH_INFO: `/v3/projects/a060fcb5cc49476b87072db544fd82be` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:37:54.606582 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68be5e5-1e35-4247-8dfe-bb2535e4a065 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a060fcb5cc49476b87072db544fd82be)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:37:54.611737 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68be5e5-1e35-4247-8dfe-bb2535e4a065 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:37:54.677012 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:37:54.847034 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-d68be5e5-1e35-4247-8dfe-bb2535e4a065 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a060fcb5cc49476b87072db544fd82be', 'request_id': 'req-d68be5e5-1e35-4247-8dfe-bb2535e4a065'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:37:54.863913 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-d68be5e5-1e35-4247-8dfe-bb2535e4a065 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a060fcb5cc49476b87072db544fd82be', 'request_id': 'req-d68be5e5-1e35-4247-8dfe-bb2535e4a065'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:37:54.899699 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-d68be5e5-1e35-4247-8dfe-bb2535e4a065 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a060fcb5cc49476b87072db544fd82be', 'request_id': 'req-d68be5e5-1e35-4247-8dfe-bb2535e4a065'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:37:54.946980 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-d68be5e5-1e35-4247-8dfe-bb2535e4a065 admin admin] The token cache is being invalidate because project a060fcb5cc49476b87072db544fd82be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 09:37:54.947264 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-d68be5e5-1e35-4247-8dfe-bb2535e4a065 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:37:54.948393 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-d68be5e5-1e35-4247-8dfe-bb2535e4a065 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:37:54.959822 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 847/1677] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 14 09:37:54 2022] DELETE /identity/v3/projects/a060fcb5cc49476b87072db544fd82be => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:37:54.967708 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c9868d-d051-4fb7-ac37-cd14bdf6da36 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:37:54.968322 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c9868d-d051-4fb7-ac37-cd14bdf6da36 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:37:54.968322 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c9868d-d051-4fb7-ac37-cd14bdf6da36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:37:54.995756 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:37:55.009882 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-d3c9868d-d051-4fb7-ac37-cd14bdf6da36 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:37:55.013620 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-d3c9868d-d051-4fb7-ac37-cd14bdf6da36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:37:55.232000 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 831/1678] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:37:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:37:55.240197 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c8f50e-bad6-471c-bbc6-93cc436bc4a0 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:37:55.240490 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c8f50e-bad6-471c-bbc6-93cc436bc4a0 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:37:55.240772 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c8f50e-bad6-471c-bbc6-93cc436bc4a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:37:55.283809 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-26c8f50e-bad6-471c-bbc6-93cc436bc4a0 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:37:55.285061 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-26c8f50e-bad6-471c-bbc6-93cc436bc4a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:37:55.313439 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 848/1679] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:37:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:37:55.317967 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c9868d-d051-4fb7-ac37-cd14bdf6da36 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:37:55.342039 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c9868d-d051-4fb7-ac37-cd14bdf6da36 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:37:55.357701 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4d4ff4-fff2-4c18-aa50-0da7c16bbc27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:37:55.358906 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4d4ff4-fff2-4c18-aa50-0da7c16bbc27 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:37:55.361258 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4d4ff4-fff2-4c18-aa50-0da7c16bbc27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:37:55.361569 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4d4ff4-fff2-4c18-aa50-0da7c16bbc27 admin admin] PATH_INFO: `/v3/domains` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:37:55.362415 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4d4ff4-fff2-4c18-aa50-0da7c16bbc27 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:37:55.362742 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4d4ff4-fff2-4c18-aa50-0da7c16bbc27 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:37:55.370304 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4d4ff4-fff2-4c18-aa50-0da7c16bbc27 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:37:55.437642 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 832/1680] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jul 14 09:37:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:37:55.438827 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c8f50e-bad6-471c-bbc6-93cc436bc4a0 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:37:55.453939 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c8f50e-bad6-471c-bbc6-93cc436bc4a0 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:37:55.473673 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121fd678-e25c-44fc-9a9b-c42b74b9d3f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:37:55.474405 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121fd678-e25c-44fc-9a9b-c42b74b9d3f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:37:55.474693 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121fd678-e25c-44fc-9a9b-c42b74b9d3f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:37:55.474971 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121fd678-e25c-44fc-9a9b-c42b74b9d3f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:37:55.476633 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121fd678-e25c-44fc-9a9b-c42b74b9d3f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:37:55.478712 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121fd678-e25c-44fc-9a9b-c42b74b9d3f7 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:37:55.569784 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 849/1681] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 14 09:37:55 2022] POST /identity/v3/projects => generated 371 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:37:55.573643 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4d4ff4-fff2-4c18-aa50-0da7c16bbc27 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:37:55.591628 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4d4ff4-fff2-4c18-aa50-0da7c16bbc27 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:37:55.781008 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa01ee23-a08e-48d9-9e01-ed2dda29a4af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:37:55.783118 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa01ee23-a08e-48d9-9e01-ed2dda29a4af admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:37:55.783422 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa01ee23-a08e-48d9-9e01-ed2dda29a4af admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:37:55.783768 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa01ee23-a08e-48d9-9e01-ed2dda29a4af admin admin] PATH_INFO: `/v3/users` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:37:55.785043 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa01ee23-a08e-48d9-9e01-ed2dda29a4af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:37:55.792613 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa01ee23-a08e-48d9-9e01-ed2dda29a4af admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:37:55.828621 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 833/1682] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 14 09:37:55 2022] POST /identity/v3/users => generated 286 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:37:55.833060 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121fd678-e25c-44fc-9a9b-c42b74b9d3f7 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:37:55.848030 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121fd678-e25c-44fc-9a9b-c42b74b9d3f7 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:37:55.858997 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1449c1-5244-4f1d-82c6-9057506c7fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:37:55.859705 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1449c1-5244-4f1d-82c6-9057506c7fa4 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:37:55.860485 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1449c1-5244-4f1d-82c6-9057506c7fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:37:55.860485 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1449c1-5244-4f1d-82c6-9057506c7fa4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:37:55.861097 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1449c1-5244-4f1d-82c6-9057506c7fa4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:37:55.866453 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1449c1-5244-4f1d-82c6-9057506c7fa4 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:37:55.886392 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 850/1683] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 09:37:55 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:37:55.892377 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa01ee23-a08e-48d9-9e01-ed2dda29a4af admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:37:55.918785 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa01ee23-a08e-48d9-9e01-ed2dda29a4af admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:37:55.927621 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3662c33e-f0d4-4200-9873-420a7e9c1fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:37:55.928863 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3662c33e-f0d4-4200-9873-420a7e9c1fe1 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:37:55.929207 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3662c33e-f0d4-4200-9873-420a7e9c1fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:37:55.929500 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3662c33e-f0d4-4200-9873-420a7e9c1fe1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:37:55.931339 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3662c33e-f0d4-4200-9873-420a7e9c1fe1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:37:55.932993 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3662c33e-f0d4-4200-9873-420a7e9c1fe1 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:37:55.951813 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 834/1684] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 09:37:55 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:37:55.959794 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1449c1-5244-4f1d-82c6-9057506c7fa4 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:37:55.978297 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1449c1-5244-4f1d-82c6-9057506c7fa4 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:37:55.989892 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb188426-94ec-424f-9d3f-8da2aac0a085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:37:55.990801 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb188426-94ec-424f-9d3f-8da2aac0a085 admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:37:55.991425 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb188426-94ec-424f-9d3f-8da2aac0a085 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:37:55.991425 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb188426-94ec-424f-9d3f-8da2aac0a085 admin admin] PATH_INFO: `/v3/projects/16696d3f552f4171899069d13b3e2110/users/a752cac9bdb74283a9e9208f55cfb02f/roles/17dfac38a2e540fea229af7de99911bb` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:37:56.026801 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb188426-94ec-424f-9d3f-8da2aac0a085 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16696d3f552f4171899069d13b3e2110, user_id=a752cac9bdb74283a9e9208f55cfb02f, role_id=17dfac38a2e540fea229af7de99911bb)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:37:56.029503 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb188426-94ec-424f-9d3f-8da2aac0a085 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:37:56.062921 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 851/1685] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 14 09:37:55 2022] PUT /identity/v3/projects/16696d3f552f4171899069d13b3e2110/users/a752cac9bdb74283a9e9208f55cfb02f/roles/17dfac38a2e540fea229af7de99911bb => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:37:56.076311 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122563ff-22c3-469c-9064-1b5bbe6a162f None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:37:56.076772 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122563ff-22c3-469c-9064-1b5bbe6a162f None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:37:56.077049 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122563ff-22c3-469c-9064-1b5bbe6a162f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:37:56.143099 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-122563ff-22c3-469c-9064-1b5bbe6a162f None None] MFA Rules not processed for user `a752cac9bdb74283a9e9208f55cfb02f`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:37:56.144584 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-122563ff-22c3-469c-9064-1b5bbe6a162f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:37:56.353658 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 835/1686] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:37:56 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:37:56.412322 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb188426-94ec-424f-9d3f-8da2aac0a085 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:37:56.414105 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-fb188426-94ec-424f-9d3f-8da2aac0a085 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:37:56.584099 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb188426-94ec-424f-9d3f-8da2aac0a085 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:37:56.594341 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2037f81-ec5b-4f17-b1f8-f3c596948818 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25048b29787d482783ebc944f1a7df65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:37:56.595317 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2037f81-ec5b-4f17-b1f8-f3c596948818 service cinder] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:37:56.601654 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2037f81-ec5b-4f17-b1f8-f3c596948818 service cinder] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:37:56.602269 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2037f81-ec5b-4f17-b1f8-f3c596948818 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:37:56.625423 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2037f81-ec5b-4f17-b1f8-f3c596948818 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:37:56.627263 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2037f81-ec5b-4f17-b1f8-f3c596948818 service cinder] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:37:56.646135 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 852/1687] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:37:56 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:37:56.668653 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122563ff-22c3-469c-9064-1b5bbe6a162f None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:37:56.674667 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:37:56.797610 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122563ff-22c3-469c-9064-1b5bbe6a162f None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:37:56.803527 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6e0dca-73ed-4a9f-bd09-9f22502352e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:37:56.804572 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6e0dca-73ed-4a9f-bd09-9f22502352e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:37:56.804960 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6e0dca-73ed-4a9f-bd09-9f22502352e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:37:56.805340 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6e0dca-73ed-4a9f-bd09-9f22502352e6 admin admin] PATH_INFO: `/v3/users/a752cac9bdb74283a9e9208f55cfb02f` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:37:56.806712 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6e0dca-73ed-4a9f-bd09-9f22502352e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a752cac9bdb74283a9e9208f55cfb02f)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:37:56.807849 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: WARNING py.warnings [None req-ec6e0dca-73ed-4a9f-bd09-9f22502352e6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 09:37:56.807849 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: warnings.warn(msg) Jul 14 09:37:56.807849 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: Jul 14 09:37:56.809929 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6e0dca-73ed-4a9f-bd09-9f22502352e6 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:37:57.025339 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-ec6e0dca-73ed-4a9f-bd09-9f22502352e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a752cac9bdb74283a9e9208f55cfb02f'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:37:57.056945 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-ec6e0dca-73ed-4a9f-bd09-9f22502352e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a752cac9bdb74283a9e9208f55cfb02f'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:37:57.058352 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-ec6e0dca-73ed-4a9f-bd09-9f22502352e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a752cac9bdb74283a9e9208f55cfb02f'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:37:57.087224 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-ec6e0dca-73ed-4a9f-bd09-9f22502352e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a752cac9bdb74283a9e9208f55cfb02f'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:37:57.088968 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-ec6e0dca-73ed-4a9f-bd09-9f22502352e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a752cac9bdb74283a9e9208f55cfb02f'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:37:57.140182 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1c0dc9-b3e2-4c39-9061-22ab10c3f539 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:37:57.140472 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1c0dc9-b3e2-4c39-9061-22ab10c3f539 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:37:57.140908 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1c0dc9-b3e2-4c39-9061-22ab10c3f539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:37:57.141143 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 836/1688] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 14 09:37:56 2022] DELETE /identity/v3/users/a752cac9bdb74283a9e9208f55cfb02f => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:37:57.177623 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5811ba24-1a04-4737-b7c9-c724500bb56c None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:37:57.181578 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5811ba24-1a04-4737-b7c9-c724500bb56c None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:37:57.182144 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5811ba24-1a04-4737-b7c9-c724500bb56c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:37:57.198239 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-cb1c0dc9-b3e2-4c39-9061-22ab10c3f539 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:37:57.199560 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-cb1c0dc9-b3e2-4c39-9061-22ab10c3f539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:37:57.325716 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-5811ba24-1a04-4737-b7c9-c724500bb56c None None] MFA Rules not processed for user `688f473972144fb6b7a398c1f775a5c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:37:57.329883 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-5811ba24-1a04-4737-b7c9-c724500bb56c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:37:57.354052 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:37:57.475502 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 853/1689] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:37:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 09:37:57.558100 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1c0dc9-b3e2-4c39-9061-22ab10c3f539 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:37:57.560666 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-cb1c0dc9-b3e2-4c39-9061-22ab10c3f539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:37:57.682169 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 837/1690] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:37:57 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 504 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:37:57.686221 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5811ba24-1a04-4737-b7c9-c724500bb56c None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:37:57.687861 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-5811ba24-1a04-4737-b7c9-c724500bb56c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:37:57.724520 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:37:57.804035 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1c0dc9-b3e2-4c39-9061-22ab10c3f539 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:37:57.816580 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f769be-1e85-4408-b2de-3fdbf2e7dede service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e4a5a8965e4802a9055d332179b7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:37:57.817713 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f769be-1e85-4408-b2de-3fdbf2e7dede service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:37:57.822073 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f769be-1e85-4408-b2de-3fdbf2e7dede service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:37:57.822816 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f769be-1e85-4408-b2de-3fdbf2e7dede service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:37:57.856506 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f769be-1e85-4408-b2de-3fdbf2e7dede service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:37:57.859108 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f769be-1e85-4408-b2de-3fdbf2e7dede service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:37:57.888249 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 854/1691] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:37:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:37:57.890150 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142d1982-b3ae-4c4f-878e-feb4ce7c199d None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:37:57.891935 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142d1982-b3ae-4c4f-878e-feb4ce7c199d None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:37:57.892429 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142d1982-b3ae-4c4f-878e-feb4ce7c199d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:37:57.918225 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5811ba24-1a04-4737-b7c9-c724500bb56c None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:37:57.935138 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852d935c-606e-4284-b768-ff46ad9cf393 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f6962106dfa4c4c9af551053f8095e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:37:57.937904 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852d935c-606e-4284-b768-ff46ad9cf393 service nova] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:37:57.938231 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852d935c-606e-4284-b768-ff46ad9cf393 service nova] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:37:57.938532 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852d935c-606e-4284-b768-ff46ad9cf393 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:37:57.972759 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852d935c-606e-4284-b768-ff46ad9cf393 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:37:57.976100 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-142d1982-b3ae-4c4f-878e-feb4ce7c199d None None] MFA Rules not processed for user `9b6ae4ed064a44c882b44b07d5595665`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:37:57.977433 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-142d1982-b3ae-4c4f-878e-feb4ce7c199d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:37:57.982573 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852d935c-606e-4284-b768-ff46ad9cf393 service nova] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:37:58.006619 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 838/1692] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:37:57 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:37:58.194303 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 855/1693] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:37:57 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:37:58.205396 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d549685b-0262-4f87-ac48-63ec3104ac80 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:37:58.205977 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d549685b-0262-4f87-ac48-63ec3104ac80 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:37:58.205977 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d549685b-0262-4f87-ac48-63ec3104ac80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:37:58.249169 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-d549685b-0262-4f87-ac48-63ec3104ac80 None None] MFA Rules not processed for user `9b6ae4ed064a44c882b44b07d5595665`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:37:58.251127 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-d549685b-0262-4f87-ac48-63ec3104ac80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:37:58.276697 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 839/1694] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:37:58 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:37:58.283476 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142d1982-b3ae-4c4f-878e-feb4ce7c199d None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:37:58.296140 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-142d1982-b3ae-4c4f-878e-feb4ce7c199d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:37:58.364172 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142d1982-b3ae-4c4f-878e-feb4ce7c199d None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:37:58.381360 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8310d3-81df-46f5-883d-e4c11f9c6e31 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f6962106dfa4c4c9af551053f8095e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:37:58.383703 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8310d3-81df-46f5-883d-e4c11f9c6e31 service nova] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:37:58.385094 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8310d3-81df-46f5-883d-e4c11f9c6e31 service nova] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:37:58.385404 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8310d3-81df-46f5-883d-e4c11f9c6e31 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:37:58.416095 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8310d3-81df-46f5-883d-e4c11f9c6e31 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:37:58.426230 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8310d3-81df-46f5-883d-e4c11f9c6e31 service nova] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:37:58.457541 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 856/1695] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:37:58 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:37:58.535699 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d549685b-0262-4f87-ac48-63ec3104ac80 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:37:58.554045 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-d549685b-0262-4f87-ac48-63ec3104ac80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:37:58.599331 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d549685b-0262-4f87-ac48-63ec3104ac80 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:37:58.646647 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75d1ad6-fbf0-41d1-897b-9a4be8906222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:37:58.647868 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75d1ad6-fbf0-41d1-897b-9a4be8906222 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:37:58.648307 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75d1ad6-fbf0-41d1-897b-9a4be8906222 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:37:58.651826 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75d1ad6-fbf0-41d1-897b-9a4be8906222 admin admin] PATH_INFO: `/v3/users/eb9b0b37f81c4dd7b23eab14ae3f475f` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:37:58.654180 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75d1ad6-fbf0-41d1-897b-9a4be8906222 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb9b0b37f81c4dd7b23eab14ae3f475f)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:37:58.658495 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75d1ad6-fbf0-41d1-897b-9a4be8906222 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:37:58.865195 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-c75d1ad6-fbf0-41d1-897b-9a4be8906222 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb9b0b37f81c4dd7b23eab14ae3f475f'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:37:58.878037 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-c75d1ad6-fbf0-41d1-897b-9a4be8906222 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb9b0b37f81c4dd7b23eab14ae3f475f'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:37:58.881157 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-c75d1ad6-fbf0-41d1-897b-9a4be8906222 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb9b0b37f81c4dd7b23eab14ae3f475f'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:37:58.895808 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-c75d1ad6-fbf0-41d1-897b-9a4be8906222 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb9b0b37f81c4dd7b23eab14ae3f475f'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:37:58.896935 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-c75d1ad6-fbf0-41d1-897b-9a4be8906222 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb9b0b37f81c4dd7b23eab14ae3f475f'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:37:58.933230 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 840/1696] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 14 09:37:58 2022] DELETE /identity/v3/users/eb9b0b37f81c4dd7b23eab14ae3f475f => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:37:58.937682 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57321388-28ec-427e-a7b7-53689cf2e196 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:37:58.938171 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57321388-28ec-427e-a7b7-53689cf2e196 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:37:58.938516 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57321388-28ec-427e-a7b7-53689cf2e196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:37:58.979667 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-57321388-28ec-427e-a7b7-53689cf2e196 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:37:58.983876 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-57321388-28ec-427e-a7b7-53689cf2e196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:37:59.158313 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:37:59.200408 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 857/1697] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:37:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:37:59.286730 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75d1ad6-fbf0-41d1-897b-9a4be8906222 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:37:59.288460 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-c75d1ad6-fbf0-41d1-897b-9a4be8906222 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:37:59.456302 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75d1ad6-fbf0-41d1-897b-9a4be8906222 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:37:59.469697 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ba06f5-2e64-4d5a-a191-f42a85a10f7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e4a5a8965e4802a9055d332179b7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:37:59.470152 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ba06f5-2e64-4d5a-a191-f42a85a10f7e service neutron] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:37:59.470492 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ba06f5-2e64-4d5a-a191-f42a85a10f7e service neutron] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:37:59.470772 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ba06f5-2e64-4d5a-a191-f42a85a10f7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:37:59.492184 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ba06f5-2e64-4d5a-a191-f42a85a10f7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:37:59.493675 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ba06f5-2e64-4d5a-a191-f42a85a10f7e service neutron] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:37:59.523286 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 841/1698] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:37:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:38:00.320415 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e16cb7-46dd-4e73-a7ec-da680bf01e2d None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:00.321088 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e16cb7-46dd-4e73-a7ec-da680bf01e2d None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:00.321500 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e16cb7-46dd-4e73-a7ec-da680bf01e2d None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:00.323506 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 858/1699] 10.222.0.40 () {54 vars in 912 bytes} [Thu Jul 14 09:38:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:38:00.330226 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a11179-3e92-49d7-9905-406f73cbe2e0 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:00.330688 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a11179-3e92-49d7-9905-406f73cbe2e0 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:00.330911 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a11179-3e92-49d7-9905-406f73cbe2e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:00.350789 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:38:00.483547 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-67a11179-3e92-49d7-9905-406f73cbe2e0 None None] MFA Rules not processed for user `65e4a5a8965e4802a9055d332179b7a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:38:00.487148 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-67a11179-3e92-49d7-9905-406f73cbe2e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:00.520875 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 842/1700] 10.222.0.40 () {58 vars in 1009 bytes} [Thu Jul 14 09:38:00 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 09:38:00.599282 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e16cb7-46dd-4e73-a7ec-da680bf01e2d None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:00.632849 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e16cb7-46dd-4e73-a7ec-da680bf01e2d None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:00.656420 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1447358b-94e7-4e31-9f6f-52115cdf3894 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e4a5a8965e4802a9055d332179b7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:00.657144 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1447358b-94e7-4e31-9f6f-52115cdf3894 service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:00.657435 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1447358b-94e7-4e31-9f6f-52115cdf3894 service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:00.657719 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1447358b-94e7-4e31-9f6f-52115cdf3894 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:00.703126 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1447358b-94e7-4e31-9f6f-52115cdf3894 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:00.715077 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1447358b-94e7-4e31-9f6f-52115cdf3894 service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:00.756901 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 859/1701] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:38:00 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:38:01.078549 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a11179-3e92-49d7-9905-406f73cbe2e0 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:01.081006 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-67a11179-3e92-49d7-9905-406f73cbe2e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:01.100077 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ea5916-8b21-41fc-8dcf-d23c8b8c6887 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:01.116367 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ea5916-8b21-41fc-8dcf-d23c8b8c6887 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:01.116955 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ea5916-8b21-41fc-8dcf-d23c8b8c6887 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:01.120951 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a11179-3e92-49d7-9905-406f73cbe2e0 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:01.145360 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae9de82-6dd6-4a69-9940-8a80fc1de9e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:01.146439 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae9de82-6dd6-4a69-9940-8a80fc1de9e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:01.146832 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae9de82-6dd6-4a69-9940-8a80fc1de9e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:01.147216 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae9de82-6dd6-4a69-9940-8a80fc1de9e6 admin admin] PATH_INFO: `/v3/projects/16696d3f552f4171899069d13b3e2110` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:01.149257 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae9de82-6dd6-4a69-9940-8a80fc1de9e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=16696d3f552f4171899069d13b3e2110)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:01.151494 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae9de82-6dd6-4a69-9940-8a80fc1de9e6 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:01.154765 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-c2ea5916-8b21-41fc-8dcf-d23c8b8c6887 None None] MFA Rules not processed for user `f50c3855aa764c2fb86c48c90eb9e15c`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:38:01.156209 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-c2ea5916-8b21-41fc-8dcf-d23c8b8c6887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:01.270813 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-aae9de82-6dd6-4a69-9940-8a80fc1de9e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16696d3f552f4171899069d13b3e2110', 'request_id': 'req-aae9de82-6dd6-4a69-9940-8a80fc1de9e6'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:01.281302 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-aae9de82-6dd6-4a69-9940-8a80fc1de9e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16696d3f552f4171899069d13b3e2110', 'request_id': 'req-aae9de82-6dd6-4a69-9940-8a80fc1de9e6'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:01.290248 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-aae9de82-6dd6-4a69-9940-8a80fc1de9e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16696d3f552f4171899069d13b3e2110', 'request_id': 'req-aae9de82-6dd6-4a69-9940-8a80fc1de9e6'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:01.324709 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-aae9de82-6dd6-4a69-9940-8a80fc1de9e6 admin admin] The token cache is being invalidate because project 16696d3f552f4171899069d13b3e2110 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 09:38:01.325030 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-aae9de82-6dd6-4a69-9940-8a80fc1de9e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:01.327642 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-aae9de82-6dd6-4a69-9940-8a80fc1de9e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:01.330630 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 843/1702] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 14 09:38:01 2022] DELETE /identity/v3/projects/16696d3f552f4171899069d13b3e2110 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:38:01.336050 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f23621-fdfb-4059-8c2d-71cba094a9ff None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:01.336050 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f23621-fdfb-4059-8c2d-71cba094a9ff None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:01.336050 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f23621-fdfb-4059-8c2d-71cba094a9ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:01.365124 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 860/1703] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:38:01 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:38:01.367313 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24b6eae-65d8-4aa1-a2bd-44f269424120 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:01.367764 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24b6eae-65d8-4aa1-a2bd-44f269424120 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:01.368389 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24b6eae-65d8-4aa1-a2bd-44f269424120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:01.416707 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-a6f23621-fdfb-4059-8c2d-71cba094a9ff None None] MFA Rules not processed for user `f1d0b9390f474de79828a675d4e0646a`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:38:01.418457 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-a6f23621-fdfb-4059-8c2d-71cba094a9ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:01.428822 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-c24b6eae-65d8-4aa1-a2bd-44f269424120 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:38:01.433512 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-c24b6eae-65d8-4aa1-a2bd-44f269424120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:01.631158 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 844/1704] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:38:01 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:38:01.632109 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f23621-fdfb-4059-8c2d-71cba094a9ff None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:01.633479 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-a6f23621-fdfb-4059-8c2d-71cba094a9ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:01.658903 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 861/1705] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:38:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:38:01.662769 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1933d7d-48a9-42c1-9ec7-97cfca3bf93d None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:01.664175 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1933d7d-48a9-42c1-9ec7-97cfca3bf93d None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:01.664538 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1933d7d-48a9-42c1-9ec7-97cfca3bf93d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:01.711270 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-d1933d7d-48a9-42c1-9ec7-97cfca3bf93d None None] MFA Rules not processed for user `f1d0b9390f474de79828a675d4e0646a`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:38:01.712504 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-d1933d7d-48a9-42c1-9ec7-97cfca3bf93d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:01.736159 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 862/1706] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:38:01 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:38:01.741406 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9ed9de-5759-4953-9efb-bca5790dd04e None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:01.741726 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9ed9de-5759-4953-9efb-bca5790dd04e None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:01.742365 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9ed9de-5759-4953-9efb-bca5790dd04e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:01.808569 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-fa9ed9de-5759-4953-9efb-bca5790dd04e None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:38:01.809849 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-fa9ed9de-5759-4953-9efb-bca5790dd04e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:01.821546 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:38:01.834750 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 863/1707] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:38:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:38:01.840536 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9ed9de-5759-4953-9efb-bca5790dd04e None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:01.861712 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9ed9de-5759-4953-9efb-bca5790dd04e None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:01.868213 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f23621-fdfb-4059-8c2d-71cba094a9ff None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:01.875168 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1672c44-fc7c-488e-878d-c40176795935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:01.875861 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1672c44-fc7c-488e-878d-c40176795935 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:01.876146 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1672c44-fc7c-488e-878d-c40176795935 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:01.876427 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1672c44-fc7c-488e-878d-c40176795935 admin admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:01.877245 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1672c44-fc7c-488e-878d-c40176795935 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:38:01.877471 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1672c44-fc7c-488e-878d-c40176795935 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:01.879128 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1672c44-fc7c-488e-878d-c40176795935 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:01.884357 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19a5f8c-c7fd-4881-b1b7-05eeea7fcc8d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f6962106dfa4c4c9af551053f8095e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:01.885063 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19a5f8c-c7fd-4881-b1b7-05eeea7fcc8d service nova] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:01.885346 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19a5f8c-c7fd-4881-b1b7-05eeea7fcc8d service nova] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:01.885620 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19a5f8c-c7fd-4881-b1b7-05eeea7fcc8d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:01.888905 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-c19a5f8c-c7fd-4881-b1b7-05eeea7fcc8d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:01.910480 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 864/1708] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jul 14 09:38:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:38:01.917760 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1672c44-fc7c-488e-878d-c40176795935 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:01.942560 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1672c44-fc7c-488e-878d-c40176795935 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:01.966817 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a413c8-6ba6-4fcb-825f-e36325d2f22e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:01.973584 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a413c8-6ba6-4fcb-825f-e36325d2f22e admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:01.974171 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a413c8-6ba6-4fcb-825f-e36325d2f22e admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:01.974650 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a413c8-6ba6-4fcb-825f-e36325d2f22e admin admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:01.975542 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a413c8-6ba6-4fcb-825f-e36325d2f22e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:01.978781 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a413c8-6ba6-4fcb-825f-e36325d2f22e admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:02.052214 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19a5f8c-c7fd-4881-b1b7-05eeea7fcc8d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:02.053859 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19a5f8c-c7fd-4881-b1b7-05eeea7fcc8d service nova] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:02.068787 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 865/1709] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 14 09:38:01 2022] POST /identity/v3/projects => generated 377 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:38:02.069878 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a413c8-6ba6-4fcb-825f-e36325d2f22e admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:02.072819 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-81a413c8-6ba6-4fcb-825f-e36325d2f22e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:02.078382 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 845/1710] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:38:01 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:38:02.083361 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19a5f8c-c7fd-4881-b1b7-05eeea7fcc8d service nova] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:02.083862 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-c19a5f8c-c7fd-4881-b1b7-05eeea7fcc8d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:02.113637 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19a5f8c-c7fd-4881-b1b7-05eeea7fcc8d service nova] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:02.166918 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:38:02.228253 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3635bf6-ce3a-4be8-a5c1-4fb56111ccdf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f6962106dfa4c4c9af551053f8095e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:02.229014 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3635bf6-ce3a-4be8-a5c1-4fb56111ccdf service nova] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:02.229717 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3635bf6-ce3a-4be8-a5c1-4fb56111ccdf service nova] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:02.229910 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3635bf6-ce3a-4be8-a5c1-4fb56111ccdf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:02.237784 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a413c8-6ba6-4fcb-825f-e36325d2f22e admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:02.244036 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cc5ad2-027f-419a-a591-93742f4902d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25048b29787d482783ebc944f1a7df65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:02.244866 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cc5ad2-027f-419a-a591-93742f4902d2 service cinder] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:02.245671 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cc5ad2-027f-419a-a591-93742f4902d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:02.246057 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cc5ad2-027f-419a-a591-93742f4902d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:02.248582 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-c5cc5ad2-027f-419a-a591-93742f4902d2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:02.325838 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3635bf6-ce3a-4be8-a5c1-4fb56111ccdf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:02.328110 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3635bf6-ce3a-4be8-a5c1-4fb56111ccdf service nova] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:02.340655 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 846/1711] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:38:02 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:38:02.345094 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f18f799-56fb-48e2-9be9-2b4a70bae538 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:02.346560 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f18f799-56fb-48e2-9be9-2b4a70bae538 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:02.346560 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f18f799-56fb-48e2-9be9-2b4a70bae538 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:02.348502 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 847/1712] 10.222.0.40 () {54 vars in 960 bytes} [Thu Jul 14 09:38:02 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:38:02.355885 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f18f799-56fb-48e2-9be9-2b4a70bae538 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:02.399674 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cc5ad2-027f-419a-a591-93742f4902d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:02.403366 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cc5ad2-027f-419a-a591-93742f4902d2 service cinder] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:02.445500 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 866/1713] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:38:02 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:38:02.446488 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cc5ad2-027f-419a-a591-93742f4902d2 service cinder] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:02.451915 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-c5cc5ad2-027f-419a-a591-93742f4902d2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:02.455876 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:38:02.558917 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f18f799-56fb-48e2-9be9-2b4a70bae538 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:02.581842 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590bfd84-bfa9-449f-94c9-c5fdbf4487f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:02.582671 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590bfd84-bfa9-449f-94c9-c5fdbf4487f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:02.585362 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590bfd84-bfa9-449f-94c9-c5fdbf4487f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:02.585753 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590bfd84-bfa9-449f-94c9-c5fdbf4487f4 admin admin] PATH_INFO: `/v3/users` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:02.586597 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590bfd84-bfa9-449f-94c9-c5fdbf4487f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:02.588858 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590bfd84-bfa9-449f-94c9-c5fdbf4487f4 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:02.667038 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 848/1714] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 14 09:38:02 2022] POST /identity/v3/users => generated 289 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:38:02.669884 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93cf463-4564-43b8-9468-74d9a8193e3a None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:02.670413 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93cf463-4564-43b8-9468-74d9a8193e3a None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:02.670929 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93cf463-4564-43b8-9468-74d9a8193e3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:02.681087 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cc5ad2-027f-419a-a591-93742f4902d2 service cinder] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:02.694862 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e9fe24-b66e-44e0-884c-3ab67a0fba7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:02.696839 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e9fe24-b66e-44e0-884c-3ab67a0fba7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:02.701405 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e9fe24-b66e-44e0-884c-3ab67a0fba7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:02.702089 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e9fe24-b66e-44e0-884c-3ab67a0fba7c admin admin] PATH_INFO: `/v3/projects/a151dc1a715748d0914da7af4f250aba` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:02.704684 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e9fe24-b66e-44e0-884c-3ab67a0fba7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=a151dc1a715748d0914da7af4f250aba)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:02.708928 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e9fe24-b66e-44e0-884c-3ab67a0fba7c admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:02.720621 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-b93cf463-4564-43b8-9468-74d9a8193e3a None None] MFA Rules not processed for user `6fc5a80144b84c609944a51a84fd5e6e`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:38:02.722005 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-b93cf463-4564-43b8-9468-74d9a8193e3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:02.918140 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-41e9fe24-b66e-44e0-884c-3ab67a0fba7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a151dc1a715748d0914da7af4f250aba', 'request_id': 'req-41e9fe24-b66e-44e0-884c-3ab67a0fba7c'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:02.930385 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 849/1715] 10.222.0.40 () {58 vars in 1057 bytes} [Thu Jul 14 09:38:02 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:38:02.960918 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-41e9fe24-b66e-44e0-884c-3ab67a0fba7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a151dc1a715748d0914da7af4f250aba', 'request_id': 'req-41e9fe24-b66e-44e0-884c-3ab67a0fba7c'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:02.970384 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93cf463-4564-43b8-9468-74d9a8193e3a None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:02.992329 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-41e9fe24-b66e-44e0-884c-3ab67a0fba7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a151dc1a715748d0914da7af4f250aba', 'request_id': 'req-41e9fe24-b66e-44e0-884c-3ab67a0fba7c'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:03.014174 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93cf463-4564-43b8-9468-74d9a8193e3a None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:03.027609 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-41e9fe24-b66e-44e0-884c-3ab67a0fba7c admin admin] The token cache is being invalidate because project a151dc1a715748d0914da7af4f250aba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 09:38:03.027609 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-41e9fe24-b66e-44e0-884c-3ab67a0fba7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:03.028763 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-41e9fe24-b66e-44e0-884c-3ab67a0fba7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:03.031693 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 867/1716] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 14 09:38:02 2022] DELETE /identity/v3/projects/a151dc1a715748d0914da7af4f250aba => generated 0 bytes in 586 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:38:03.039527 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e9fe24-b66e-44e0-884c-3ab67a0fba7c admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:03.046633 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-41e9fe24-b66e-44e0-884c-3ab67a0fba7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:03.071975 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:38:03.166798 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad87d20-422a-4723-9c33-3d9b7b91960d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:03.167523 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad87d20-422a-4723-9c33-3d9b7b91960d admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:03.167860 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad87d20-422a-4723-9c33-3d9b7b91960d admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:03.169002 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad87d20-422a-4723-9c33-3d9b7b91960d admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:03.169002 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad87d20-422a-4723-9c33-3d9b7b91960d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:03.170825 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad87d20-422a-4723-9c33-3d9b7b91960d admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:03.195767 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 850/1717] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 09:38:02 2022] GET /identity/v3/roles => generated 1420 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:38:03.196710 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad87d20-422a-4723-9c33-3d9b7b91960d admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:03.203250 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-4ad87d20-422a-4723-9c33-3d9b7b91960d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:03.216986 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e9fe24-b66e-44e0-884c-3ab67a0fba7c admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:03.228684 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91fbc25-0a47-4419-971b-9914bb37720d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc5a80144b84c609944a51a84fd5e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:03.231569 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91fbc25-0a47-4419-971b-9914bb37720d service placement] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:03.231989 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91fbc25-0a47-4419-971b-9914bb37720d service placement] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:03.232422 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91fbc25-0a47-4419-971b-9914bb37720d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:03.243360 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad87d20-422a-4723-9c33-3d9b7b91960d admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:03.243730 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-a91fbc25-0a47-4419-971b-9914bb37720d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:03.255334 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279b2360-6bfb-40f2-8b67-62d1cc982179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:03.257115 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279b2360-6bfb-40f2-8b67-62d1cc982179 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:03.258766 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279b2360-6bfb-40f2-8b67-62d1cc982179 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:03.259078 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279b2360-6bfb-40f2-8b67-62d1cc982179 admin admin] PATH_INFO: `/v3/users/e8ef6643066042029e7ff6cd9d88100b` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:03.262506 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279b2360-6bfb-40f2-8b67-62d1cc982179 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8ef6643066042029e7ff6cd9d88100b)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:03.264520 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279b2360-6bfb-40f2-8b67-62d1cc982179 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:03.281660 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91fbc25-0a47-4419-971b-9914bb37720d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:03.284723 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91fbc25-0a47-4419-971b-9914bb37720d service placement] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:03.343888 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 868/1718] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:38:03 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:38:03.349602 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91fbc25-0a47-4419-971b-9914bb37720d service placement] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:03.353870 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-a91fbc25-0a47-4419-971b-9914bb37720d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:03.370823 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-279b2360-6bfb-40f2-8b67-62d1cc982179 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8ef6643066042029e7ff6cd9d88100b'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:03.372230 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:38:03.390668 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-279b2360-6bfb-40f2-8b67-62d1cc982179 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8ef6643066042029e7ff6cd9d88100b'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:03.394691 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-279b2360-6bfb-40f2-8b67-62d1cc982179 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8ef6643066042029e7ff6cd9d88100b'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:03.408680 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91fbc25-0a47-4419-971b-9914bb37720d service placement] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:03.422703 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-279b2360-6bfb-40f2-8b67-62d1cc982179 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8ef6643066042029e7ff6cd9d88100b'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:03.423299 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-279b2360-6bfb-40f2-8b67-62d1cc982179 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8ef6643066042029e7ff6cd9d88100b'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:03.430906 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2449bb6a-fc54-41b8-aa63-f0d39d844d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:03.437489 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2449bb6a-fc54-41b8-aa63-f0d39d844d17 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:03.438046 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2449bb6a-fc54-41b8-aa63-f0d39d844d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:03.438904 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2449bb6a-fc54-41b8-aa63-f0d39d844d17 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:03.440016 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2449bb6a-fc54-41b8-aa63-f0d39d844d17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:03.444397 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2449bb6a-fc54-41b8-aa63-f0d39d844d17 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:03.463266 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 851/1719] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 14 09:38:03 2022] DELETE /identity/v3/users/e8ef6643066042029e7ff6cd9d88100b => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:38:03.498703 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 869/1720] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 09:38:03 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:38:03.502047 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279b2360-6bfb-40f2-8b67-62d1cc982179 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:03.502862 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-279b2360-6bfb-40f2-8b67-62d1cc982179 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:03.657498 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279b2360-6bfb-40f2-8b67-62d1cc982179 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:03.674815 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ea55a1-b546-4ecb-a000-d9c712bc5144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:03.676522 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ea55a1-b546-4ecb-a000-d9c712bc5144 admin admin] REQUEST_METHOD: `PUT` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:03.676854 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ea55a1-b546-4ecb-a000-d9c712bc5144 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:03.677051 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ea55a1-b546-4ecb-a000-d9c712bc5144 admin admin] PATH_INFO: `/v3/projects/762b9b8f24924f6e89d2bbfefd8feb2b/users/68dca1110e0d491a81bd6bc5a8dc7581/roles/17dfac38a2e540fea229af7de99911bb` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:03.715358 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51aba8c-0589-4785-95d3-699cec2d64f8 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:03.715814 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51aba8c-0589-4785-95d3-699cec2d64f8 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:03.716166 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51aba8c-0589-4785-95d3-699cec2d64f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:03.742278 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ea55a1-b546-4ecb-a000-d9c712bc5144 admin admin] RBAC: Authorizing `identity:create_grant(project_id=762b9b8f24924f6e89d2bbfefd8feb2b, user_id=68dca1110e0d491a81bd6bc5a8dc7581, role_id=17dfac38a2e540fea229af7de99911bb)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:03.745123 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ea55a1-b546-4ecb-a000-d9c712bc5144 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:03.765186 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-f51aba8c-0589-4785-95d3-699cec2d64f8 None None] MFA Rules not processed for user `688f473972144fb6b7a398c1f775a5c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:38:03.766667 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-f51aba8c-0589-4785-95d3-699cec2d64f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:03.796022 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 852/1721] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 14 09:38:03 2022] PUT /identity/v3/projects/762b9b8f24924f6e89d2bbfefd8feb2b/users/68dca1110e0d491a81bd6bc5a8dc7581/roles/17dfac38a2e540fea229af7de99911bb => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:38:03.803574 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e3b358-1265-4e5e-a696-c96ad8f95c3c None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:03.804175 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e3b358-1265-4e5e-a696-c96ad8f95c3c None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:03.804673 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e3b358-1265-4e5e-a696-c96ad8f95c3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:03.866854 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-34e3b358-1265-4e5e-a696-c96ad8f95c3c None None] MFA Rules not processed for user `68dca1110e0d491a81bd6bc5a8dc7581`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:38:03.868165 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-34e3b358-1265-4e5e-a696-c96ad8f95c3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:04.005868 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 870/1722] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:38:03 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 09:38:04.136932 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 853/1723] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:38:03 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 09:38:04.147879 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51aba8c-0589-4785-95d3-699cec2d64f8 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:04.149511 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-f51aba8c-0589-4785-95d3-699cec2d64f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:04.280521 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34406245-4408-4b37-87bd-c58ae8d3bbf0 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:04.280819 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34406245-4408-4b37-87bd-c58ae8d3bbf0 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:04.281105 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34406245-4408-4b37-87bd-c58ae8d3bbf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:04.320639 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-34406245-4408-4b37-87bd-c58ae8d3bbf0 None None] MFA Rules not processed for user `f1d0b9390f474de79828a675d4e0646a`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:38:04.322132 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-34406245-4408-4b37-87bd-c58ae8d3bbf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:04.366099 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51aba8c-0589-4785-95d3-699cec2d64f8 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:04.448080 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:38:04.522851 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 854/1724] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:38:04 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:38:04.523786 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34406245-4408-4b37-87bd-c58ae8d3bbf0 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:04.540793 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-34406245-4408-4b37-87bd-c58ae8d3bbf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:04.587760 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:38:04.596905 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5dbd5c-4a7c-49e9-ba73-87cdb73a90dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25048b29787d482783ebc944f1a7df65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:04.597772 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5dbd5c-4a7c-49e9-ba73-87cdb73a90dc service cinder] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:04.597863 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5dbd5c-4a7c-49e9-ba73-87cdb73a90dc service cinder] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:04.598124 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5dbd5c-4a7c-49e9-ba73-87cdb73a90dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:04.618930 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5dbd5c-4a7c-49e9-ba73-87cdb73a90dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:04.621174 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5dbd5c-4a7c-49e9-ba73-87cdb73a90dc service cinder] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:04.673904 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 871/1725] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:38:04 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 526 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:38:04.766389 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5dbd5c-4a7c-49e9-ba73-87cdb73a90dc service cinder] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:04.768261 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-2f5dbd5c-4a7c-49e9-ba73-87cdb73a90dc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:04.814778 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34406245-4408-4b37-87bd-c58ae8d3bbf0 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:04.832256 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d091a1-ee47-48ca-b261-bb4c67fddf5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:04.833164 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d091a1-ee47-48ca-b261-bb4c67fddf5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:04.837862 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d091a1-ee47-48ca-b261-bb4c67fddf5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:04.839519 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d091a1-ee47-48ca-b261-bb4c67fddf5a admin admin] PATH_INFO: `/v3/projects/4b191029c8f848d3b4d772f16b915158` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:04.847281 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d091a1-ee47-48ca-b261-bb4c67fddf5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b191029c8f848d3b4d772f16b915158)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:04.857949 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d091a1-ee47-48ca-b261-bb4c67fddf5a admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:04.979737 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5dbd5c-4a7c-49e9-ba73-87cdb73a90dc service cinder] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:04.997596 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38bdf55-42a4-4fbf-aad0-3d781d14e45d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:04.998546 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38bdf55-42a4-4fbf-aad0-3d781d14e45d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:04.999044 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38bdf55-42a4-4fbf-aad0-3d781d14e45d admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:04.999477 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38bdf55-42a4-4fbf-aad0-3d781d14e45d admin admin] PATH_INFO: `/v3/users/9cb02e863d1f4da6b29fd29674d92e33` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:05.001019 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38bdf55-42a4-4fbf-aad0-3d781d14e45d admin admin] RBAC: Authorizing `identity:delete_user(user_id=9cb02e863d1f4da6b29fd29674d92e33)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:05.004251 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38bdf55-42a4-4fbf-aad0-3d781d14e45d admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:05.115437 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-f38bdf55-42a4-4fbf-aad0-3d781d14e45d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9cb02e863d1f4da6b29fd29674d92e33'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:05.142957 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-b9d091a1-ee47-48ca-b261-bb4c67fddf5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b191029c8f848d3b4d772f16b915158', 'request_id': 'req-b9d091a1-ee47-48ca-b261-bb4c67fddf5a'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:05.147320 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-f38bdf55-42a4-4fbf-aad0-3d781d14e45d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9cb02e863d1f4da6b29fd29674d92e33'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:05.149006 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-f38bdf55-42a4-4fbf-aad0-3d781d14e45d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9cb02e863d1f4da6b29fd29674d92e33'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:05.180943 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-f38bdf55-42a4-4fbf-aad0-3d781d14e45d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9cb02e863d1f4da6b29fd29674d92e33'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:05.192598 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-f38bdf55-42a4-4fbf-aad0-3d781d14e45d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9cb02e863d1f4da6b29fd29674d92e33'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:05.198885 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-b9d091a1-ee47-48ca-b261-bb4c67fddf5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b191029c8f848d3b4d772f16b915158', 'request_id': 'req-b9d091a1-ee47-48ca-b261-bb4c67fddf5a'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:05.213305 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-b9d091a1-ee47-48ca-b261-bb4c67fddf5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b191029c8f848d3b4d772f16b915158', 'request_id': 'req-b9d091a1-ee47-48ca-b261-bb4c67fddf5a'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:05.214590 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 872/1726] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 14 09:38:04 2022] DELETE /identity/v3/users/9cb02e863d1f4da6b29fd29674d92e33 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 09:38:05.226764 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e76461-642c-4f3d-a069-bfd6b8b0c7e8 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:05.227397 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e76461-642c-4f3d-a069-bfd6b8b0c7e8 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:05.228118 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e76461-642c-4f3d-a069-bfd6b8b0c7e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:05.253158 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-b9d091a1-ee47-48ca-b261-bb4c67fddf5a admin admin] The token cache is being invalidate because project 4b191029c8f848d3b4d772f16b915158 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 09:38:05.253463 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-b9d091a1-ee47-48ca-b261-bb4c67fddf5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:05.268548 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-b9d091a1-ee47-48ca-b261-bb4c67fddf5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:05.278801 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 855/1727] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 14 09:38:04 2022] DELETE /identity/v3/projects/4b191029c8f848d3b4d772f16b915158 => generated 0 bytes in 755 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:38:05.282999 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-86e76461-642c-4f3d-a069-bfd6b8b0c7e8 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:38:05.285014 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45fc5d0-ddd5-4aa7-8346-ea4bccf0e049 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:05.286402 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-86e76461-642c-4f3d-a069-bfd6b8b0c7e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:05.286870 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45fc5d0-ddd5-4aa7-8346-ea4bccf0e049 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:05.287302 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45fc5d0-ddd5-4aa7-8346-ea4bccf0e049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:05.372983 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-c45fc5d0-ddd5-4aa7-8346-ea4bccf0e049 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:38:05.377738 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-c45fc5d0-ddd5-4aa7-8346-ea4bccf0e049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:05.547574 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 856/1728] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:38:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:38:05.557803 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36342595-c62f-4db2-b46d-b67a68152671 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:05.557803 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36342595-c62f-4db2-b46d-b67a68152671 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:05.557803 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36342595-c62f-4db2-b46d-b67a68152671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:05.625212 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 873/1729] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:38:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 400 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:38:05.635120 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-36342595-c62f-4db2-b46d-b67a68152671 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:38:05.636618 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-36342595-c62f-4db2-b46d-b67a68152671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:05.673152 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e76461-642c-4f3d-a069-bfd6b8b0c7e8 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:05.673639 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 857/1730] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:38:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:38:05.690058 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36342595-c62f-4db2-b46d-b67a68152671 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:05.692363 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-36342595-c62f-4db2-b46d-b67a68152671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:05.705395 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e76461-642c-4f3d-a069-bfd6b8b0c7e8 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:05.712778 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:38:05.721117 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebec623-8b9f-48a2-945e-b5266bde471f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:05.722172 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebec623-8b9f-48a2-945e-b5266bde471f admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:05.722715 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebec623-8b9f-48a2-945e-b5266bde471f admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:05.723215 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebec623-8b9f-48a2-945e-b5266bde471f admin admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:05.724204 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebec623-8b9f-48a2-945e-b5266bde471f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:38:05.724763 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebec623-8b9f-48a2-945e-b5266bde471f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:05.726685 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebec623-8b9f-48a2-945e-b5266bde471f admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:05.769801 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:38:05.799189 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 874/1731] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jul 14 09:38:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:38:05.800396 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebec623-8b9f-48a2-945e-b5266bde471f admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:05.827156 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebec623-8b9f-48a2-945e-b5266bde471f admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:05.843054 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905925d5-75d5-448f-bd5f-8febf4476ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:05.845409 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905925d5-75d5-448f-bd5f-8febf4476ebf admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:05.848066 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905925d5-75d5-448f-bd5f-8febf4476ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:05.848583 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905925d5-75d5-448f-bd5f-8febf4476ebf admin admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:05.849535 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905925d5-75d5-448f-bd5f-8febf4476ebf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:05.854142 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905925d5-75d5-448f-bd5f-8febf4476ebf admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:05.943044 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 875/1732] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 14 09:38:05 2022] POST /identity/v3/projects => generated 403 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:38:05.947423 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905925d5-75d5-448f-bd5f-8febf4476ebf admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:05.981274 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36342595-c62f-4db2-b46d-b67a68152671 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:06.199296 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aa1e2c-9444-447e-a838-96adfab93449 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e4a5a8965e4802a9055d332179b7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:06.202086 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aa1e2c-9444-447e-a838-96adfab93449 service neutron] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:06.202441 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aa1e2c-9444-447e-a838-96adfab93449 service neutron] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:06.202828 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aa1e2c-9444-447e-a838-96adfab93449 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:06.229512 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905925d5-75d5-448f-bd5f-8febf4476ebf admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:06.241871 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87aa1e2c-9444-447e-a838-96adfab93449 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:06.249050 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87aa1e2c-9444-447e-a838-96adfab93449 service neutron] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:06.250339 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaf56fd-1c96-494a-be8f-f3149656dbd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:06.251095 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaf56fd-1c96-494a-be8f-f3149656dbd9 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:06.251399 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaf56fd-1c96-494a-be8f-f3149656dbd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:06.253961 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaf56fd-1c96-494a-be8f-f3149656dbd9 admin admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:06.254992 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaf56fd-1c96-494a-be8f-f3149656dbd9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:06.259253 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaf56fd-1c96-494a-be8f-f3149656dbd9 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:06.273513 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 858/1733] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:38:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 585 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:38:06.277242 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff0c5b4-f901-4b9e-88ed-b9cfaf6f91db None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:06.277914 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff0c5b4-f901-4b9e-88ed-b9cfaf6f91db None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:06.277914 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff0c5b4-f901-4b9e-88ed-b9cfaf6f91db None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:06.285457 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 859/1734] 10.222.0.40 () {54 vars in 912 bytes} [Thu Jul 14 09:38:06 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:38:06.292554 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed52e69-af8f-47b9-91b2-b1beab6c6fa8 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:06.293937 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed52e69-af8f-47b9-91b2-b1beab6c6fa8 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:06.294393 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed52e69-af8f-47b9-91b2-b1beab6c6fa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:06.310985 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 876/1735] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 14 09:38:05 2022] POST /identity/v3/users => generated 302 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:38:06.317584 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaf56fd-1c96-494a-be8f-f3149656dbd9 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:06.353491 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaf56fd-1c96-494a-be8f-f3149656dbd9 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:06.356766 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-9ed52e69-af8f-47b9-91b2-b1beab6c6fa8 None None] MFA Rules not processed for user `65e4a5a8965e4802a9055d332179b7a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:38:06.363010 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-9ed52e69-af8f-47b9-91b2-b1beab6c6fa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:06.379552 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fe9185-c867-412b-adee-86fc94266f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:06.381591 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fe9185-c867-412b-adee-86fc94266f86 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:06.384725 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fe9185-c867-412b-adee-86fc94266f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:06.387177 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fe9185-c867-412b-adee-86fc94266f86 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:06.389179 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fe9185-c867-412b-adee-86fc94266f86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:06.394057 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fe9185-c867-412b-adee-86fc94266f86 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:06.403700 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 860/1736] 10.222.0.40 () {58 vars in 1009 bytes} [Thu Jul 14 09:38:06 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:38:06.433420 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed52e69-af8f-47b9-91b2-b1beab6c6fa8 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:06.446240 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 877/1737] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 09:38:06 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:38:06.469574 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed52e69-af8f-47b9-91b2-b1beab6c6fa8 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:06.480802 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed10246a-48cd-4b4f-a26c-25c1d73d2dd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:06.481553 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed10246a-48cd-4b4f-a26c-25c1d73d2dd1 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:06.481842 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed10246a-48cd-4b4f-a26c-25c1d73d2dd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:06.482225 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed10246a-48cd-4b4f-a26c-25c1d73d2dd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:06.483058 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed10246a-48cd-4b4f-a26c-25c1d73d2dd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:06.492392 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed10246a-48cd-4b4f-a26c-25c1d73d2dd1 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:06.512827 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fe9185-c867-412b-adee-86fc94266f86 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:06.525320 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 861/1738] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 09:38:06 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 09:38:06.527593 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fe9185-c867-412b-adee-86fc94266f86 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:06.537554 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234228d8-4e76-4d32-bb93-755693d164e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:06.540482 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234228d8-4e76-4d32-bb93-755693d164e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:06.540966 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234228d8-4e76-4d32-bb93-755693d164e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:06.541561 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234228d8-4e76-4d32-bb93-755693d164e7 admin admin] PATH_INFO: `/v3/projects/2b0d9d86f7c347489b062789cbc2c9bf/users/131852d242d8426cb2b942d88900ba91/roles/17dfac38a2e540fea229af7de99911bb` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:06.549946 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed10246a-48cd-4b4f-a26c-25c1d73d2dd1 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:06.552805 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-ed10246a-48cd-4b4f-a26c-25c1d73d2dd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:06.579285 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed10246a-48cd-4b4f-a26c-25c1d73d2dd1 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:06.594152 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca966f0-816f-48d6-b9c0-31b39a5da87f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e4a5a8965e4802a9055d332179b7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:06.595520 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca966f0-816f-48d6-b9c0-31b39a5da87f service neutron] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:06.598288 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca966f0-816f-48d6-b9c0-31b39a5da87f service neutron] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:06.598861 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca966f0-816f-48d6-b9c0-31b39a5da87f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:06.599892 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234228d8-4e76-4d32-bb93-755693d164e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b0d9d86f7c347489b062789cbc2c9bf, user_id=131852d242d8426cb2b942d88900ba91, role_id=17dfac38a2e540fea229af7de99911bb)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:06.609575 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234228d8-4e76-4d32-bb93-755693d164e7 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:06.619873 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca966f0-816f-48d6-b9c0-31b39a5da87f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:06.622642 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca966f0-816f-48d6-b9c0-31b39a5da87f service neutron] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:06.640318 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 878/1739] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 14 09:38:06 2022] PUT /identity/v3/projects/2b0d9d86f7c347489b062789cbc2c9bf/users/131852d242d8426cb2b942d88900ba91/roles/17dfac38a2e540fea229af7de99911bb => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:38:06.647531 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15d6f63-3095-460e-a449-649444c1a15b None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:06.648547 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15d6f63-3095-460e-a449-649444c1a15b None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:06.649557 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15d6f63-3095-460e-a449-649444c1a15b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:06.657592 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 862/1740] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:38:06 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:38:06.679074 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-d15d6f63-3095-460e-a449-649444c1a15b None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:38:06.681127 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-d15d6f63-3095-460e-a449-649444c1a15b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:06.793191 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 879/1741] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:38:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:38:06.901525 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca966f0-816f-48d6-b9c0-31b39a5da87f service neutron] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:06.912547 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca966f0-816f-48d6-b9c0-31b39a5da87f service neutron] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:07.026496 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15d6f63-3095-460e-a449-649444c1a15b None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:07.029742 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-d15d6f63-3095-460e-a449-649444c1a15b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:07.064848 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15d6f63-3095-460e-a449-649444c1a15b None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:07.086754 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74645dba-9c70-4b31-adb5-056622b5dfb6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e4a5a8965e4802a9055d332179b7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:07.087569 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9e2868-c906-4138-9028-f0138b07d9f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:07.089916 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9e2868-c906-4138-9028-f0138b07d9f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:07.090053 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9e2868-c906-4138-9028-f0138b07d9f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:07.090667 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74645dba-9c70-4b31-adb5-056622b5dfb6 service neutron] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:07.090956 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74645dba-9c70-4b31-adb5-056622b5dfb6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:07.091233 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74645dba-9c70-4b31-adb5-056622b5dfb6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:07.091692 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9e2868-c906-4138-9028-f0138b07d9f5 admin admin] PATH_INFO: `/v3/users/c88c49bba312444b951141c266107e00` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:07.096414 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9e2868-c906-4138-9028-f0138b07d9f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c88c49bba312444b951141c266107e00)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:07.103194 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9e2868-c906-4138-9028-f0138b07d9f5 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:07.132641 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74645dba-9c70-4b31-adb5-056622b5dfb6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:07.134459 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74645dba-9c70-4b31-adb5-056622b5dfb6 service neutron] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:07.157254 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 863/1742] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:38:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:38:07.204846 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=4 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:38:07.244050 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-3f9e2868-c906-4138-9028-f0138b07d9f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c88c49bba312444b951141c266107e00'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:07.272875 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-3f9e2868-c906-4138-9028-f0138b07d9f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c88c49bba312444b951141c266107e00'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:07.274025 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-3f9e2868-c906-4138-9028-f0138b07d9f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c88c49bba312444b951141c266107e00'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:07.293097 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-3f9e2868-c906-4138-9028-f0138b07d9f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c88c49bba312444b951141c266107e00'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:07.303141 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-3f9e2868-c906-4138-9028-f0138b07d9f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c88c49bba312444b951141c266107e00'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:07.322768 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 880/1743] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 14 09:38:07 2022] DELETE /identity/v3/users/c88c49bba312444b951141c266107e00 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:38:07.324832 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c84b67-3007-4199-a59e-93ce33cde508 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:07.325356 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c84b67-3007-4199-a59e-93ce33cde508 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:07.326001 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c84b67-3007-4199-a59e-93ce33cde508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:07.365535 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-77c84b67-3007-4199-a59e-93ce33cde508 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:38:07.368072 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-77c84b67-3007-4199-a59e-93ce33cde508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:07.469869 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:38:07.638877 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 864/1744] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:38:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:38:07.949936 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9e2868-c906-4138-9028-f0138b07d9f5 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:07.951640 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-3f9e2868-c906-4138-9028-f0138b07d9f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:07.963808 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a00ec1-9cd4-420c-a9de-2243feaa29c9 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:07.964886 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a00ec1-9cd4-420c-a9de-2243feaa29c9 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:07.965555 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a00ec1-9cd4-420c-a9de-2243feaa29c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:08.086007 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-64a00ec1-9cd4-420c-a9de-2243feaa29c9 None None] MFA Rules not processed for user `6cf35868f9ff46e2835a6cc023641da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:38:08.087294 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-64a00ec1-9cd4-420c-a9de-2243feaa29c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:08.108134 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9e2868-c906-4138-9028-f0138b07d9f5 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:08.122783 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8625ed30-cd71-44a1-b70f-63e7f641e8db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e4a5a8965e4802a9055d332179b7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:08.125072 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8625ed30-cd71-44a1-b70f-63e7f641e8db service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:08.125994 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8625ed30-cd71-44a1-b70f-63e7f641e8db service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:08.127488 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8625ed30-cd71-44a1-b70f-63e7f641e8db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:08.152217 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8625ed30-cd71-44a1-b70f-63e7f641e8db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:08.154390 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8625ed30-cd71-44a1-b70f-63e7f641e8db service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:08.179424 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 881/1745] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:38:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:38:08.253146 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 865/1746] 10.222.0.40 () {58 vars in 1009 bytes} [Thu Jul 14 09:38:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 09:38:08.476716 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8625ed30-cd71-44a1-b70f-63e7f641e8db service neutron] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:08.478713 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-8625ed30-cd71-44a1-b70f-63e7f641e8db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:08.693149 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a00ec1-9cd4-420c-a9de-2243feaa29c9 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:08.694632 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-64a00ec1-9cd4-420c-a9de-2243feaa29c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:08.716266 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a00ec1-9cd4-420c-a9de-2243feaa29c9 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:08.728288 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469aa21d-0880-406f-af3e-f586713569ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:08.729185 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469aa21d-0880-406f-af3e-f586713569ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:08.731840 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469aa21d-0880-406f-af3e-f586713569ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:08.732117 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469aa21d-0880-406f-af3e-f586713569ca admin admin] PATH_INFO: `/v3/projects/0dde10631582463ab587bc4c275c856d` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:08.735441 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469aa21d-0880-406f-af3e-f586713569ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=0dde10631582463ab587bc4c275c856d)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:08.738672 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469aa21d-0880-406f-af3e-f586713569ca admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:08.775902 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8625ed30-cd71-44a1-b70f-63e7f641e8db service neutron] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:08.787408 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1149e1e4-1c0e-4305-98f7-7282a5a58efc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '302c0f7dd3bf4829aad0b29bd0c091a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:08.788095 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1149e1e4-1c0e-4305-98f7-7282a5a58efc service swift] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:08.788385 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1149e1e4-1c0e-4305-98f7-7282a5a58efc service swift] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:08.788669 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1149e1e4-1c0e-4305-98f7-7282a5a58efc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:08.803708 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1149e1e4-1c0e-4305-98f7-7282a5a58efc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:08.805870 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1149e1e4-1c0e-4305-98f7-7282a5a58efc service swift] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:08.843643 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 882/1747] 10.222.0.40 () {60 vars in 1384 bytes} [Thu Jul 14 09:38:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 09:38:08.849740 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-469aa21d-0880-406f-af3e-f586713569ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0dde10631582463ab587bc4c275c856d', 'request_id': 'req-469aa21d-0880-406f-af3e-f586713569ca'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:08.881337 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-469aa21d-0880-406f-af3e-f586713569ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0dde10631582463ab587bc4c275c856d', 'request_id': 'req-469aa21d-0880-406f-af3e-f586713569ca'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:08.901844 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-469aa21d-0880-406f-af3e-f586713569ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0dde10631582463ab587bc4c275c856d', 'request_id': 'req-469aa21d-0880-406f-af3e-f586713569ca'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:08.958113 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-469aa21d-0880-406f-af3e-f586713569ca admin admin] The token cache is being invalidate because project 0dde10631582463ab587bc4c275c856d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 09:38:08.960596 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-469aa21d-0880-406f-af3e-f586713569ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:08.961602 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-469aa21d-0880-406f-af3e-f586713569ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:08.971025 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 866/1748] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 14 09:38:08 2022] DELETE /identity/v3/projects/0dde10631582463ab587bc4c275c856d => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:38:08.976790 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd248a2-1ba6-442c-9914-fc055f2492a0 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:08.977701 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd248a2-1ba6-442c-9914-fc055f2492a0 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:08.977892 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd248a2-1ba6-442c-9914-fc055f2492a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:09.019222 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-2cd248a2-1ba6-442c-9914-fc055f2492a0 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:38:09.020440 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-2cd248a2-1ba6-442c-9914-fc055f2492a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:09.047365 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:38:09.125822 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 883/1749] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:38:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 09:38:09.133573 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d801b8c0-4b39-4b78-83fe-aeebb9f186e9 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:09.133938 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d801b8c0-4b39-4b78-83fe-aeebb9f186e9 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:09.134131 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d801b8c0-4b39-4b78-83fe-aeebb9f186e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:09.162693 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e60e1f2-80d2-4343-9eec-389a1e45a83a None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:09.162983 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e60e1f2-80d2-4343-9eec-389a1e45a83a None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:09.163279 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e60e1f2-80d2-4343-9eec-389a1e45a83a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:09.182766 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-d801b8c0-4b39-4b78-83fe-aeebb9f186e9 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:38:09.184013 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-d801b8c0-4b39-4b78-83fe-aeebb9f186e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:09.209863 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-8e60e1f2-80d2-4343-9eec-389a1e45a83a None None] MFA Rules not processed for user `f50c3855aa764c2fb86c48c90eb9e15c`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:38:09.211548 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 867/1750] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:38:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:38:09.213537 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-8e60e1f2-80d2-4343-9eec-389a1e45a83a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:09.216829 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d801b8c0-4b39-4b78-83fe-aeebb9f186e9 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:09.236878 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d801b8c0-4b39-4b78-83fe-aeebb9f186e9 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:09.250589 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e779bb0f-7a8a-4e99-89c9-544b6d615dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:09.251339 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e779bb0f-7a8a-4e99-89c9-544b6d615dae admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:09.251549 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e779bb0f-7a8a-4e99-89c9-544b6d615dae admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:09.253631 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e779bb0f-7a8a-4e99-89c9-544b6d615dae admin admin] PATH_INFO: `/v3/domains` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:09.256288 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e779bb0f-7a8a-4e99-89c9-544b6d615dae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:38:09.259246 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e779bb0f-7a8a-4e99-89c9-544b6d615dae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:09.264343 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e779bb0f-7a8a-4e99-89c9-544b6d615dae admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:09.304796 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 868/1751] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jul 14 09:38:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:38:09.316272 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e779bb0f-7a8a-4e99-89c9-544b6d615dae admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:09.349453 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e779bb0f-7a8a-4e99-89c9-544b6d615dae admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:09.355921 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89107c3-a525-4269-899d-f7998f5121ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:09.356672 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89107c3-a525-4269-899d-f7998f5121ba admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:09.356965 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89107c3-a525-4269-899d-f7998f5121ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:09.357285 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89107c3-a525-4269-899d-f7998f5121ba admin admin] PATH_INFO: `/v3/projects` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:09.357998 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89107c3-a525-4269-899d-f7998f5121ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:09.361835 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89107c3-a525-4269-899d-f7998f5121ba admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:09.377273 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:38:09.407651 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 884/1752] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:38:09 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:38:09.407651 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e60e1f2-80d2-4343-9eec-389a1e45a83a None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:09.409319 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-8e60e1f2-80d2-4343-9eec-389a1e45a83a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:09.435438 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 869/1753] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 14 09:38:09 2022] POST /identity/v3/projects => generated 373 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:38:09.442544 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89107c3-a525-4269-899d-f7998f5121ba admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:09.446041 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e60e1f2-80d2-4343-9eec-389a1e45a83a None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:09.580185 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89107c3-a525-4269-899d-f7998f5121ba admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:09.587487 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707f2905-d19a-4db0-bee8-02fbfcc68493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:09.588454 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707f2905-d19a-4db0-bee8-02fbfcc68493 admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:09.589004 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707f2905-d19a-4db0-bee8-02fbfcc68493 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:09.589735 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707f2905-d19a-4db0-bee8-02fbfcc68493 admin admin] PATH_INFO: `/v3/users` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:09.590559 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707f2905-d19a-4db0-bee8-02fbfcc68493 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:09.593103 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707f2905-d19a-4db0-bee8-02fbfcc68493 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:09.595185 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f5848c-e91d-4276-bff3-50bef482f2ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:09.596256 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f5848c-e91d-4276-bff3-50bef482f2ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:09.596702 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f5848c-e91d-4276-bff3-50bef482f2ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:09.597128 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f5848c-e91d-4276-bff3-50bef482f2ac admin admin] PATH_INFO: `/v3/projects/52e6dceb3bb948dba52cdc9c4c1eab5e` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:09.604954 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f5848c-e91d-4276-bff3-50bef482f2ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=52e6dceb3bb948dba52cdc9c4c1eab5e)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:09.607678 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f5848c-e91d-4276-bff3-50bef482f2ac admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:09.629971 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 870/1754] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 14 09:38:09 2022] POST /identity/v3/users => generated 287 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:38:09.629971 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707f2905-d19a-4db0-bee8-02fbfcc68493 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:09.643110 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707f2905-d19a-4db0-bee8-02fbfcc68493 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:09.649211 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc498d9-b933-4ee4-854f-0926a4dd1271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:09.649998 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc498d9-b933-4ee4-854f-0926a4dd1271 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:09.650394 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc498d9-b933-4ee4-854f-0926a4dd1271 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:09.651709 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc498d9-b933-4ee4-854f-0926a4dd1271 admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:09.652594 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc498d9-b933-4ee4-854f-0926a4dd1271 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:09.655900 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc498d9-b933-4ee4-854f-0926a4dd1271 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:09.673302 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 871/1755] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 09:38:09 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:38:09.674453 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc498d9-b933-4ee4-854f-0926a4dd1271 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:09.688618 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc498d9-b933-4ee4-854f-0926a4dd1271 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:09.741290 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-49f5848c-e91d-4276-bff3-50bef482f2ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52e6dceb3bb948dba52cdc9c4c1eab5e', 'request_id': 'req-49f5848c-e91d-4276-bff3-50bef482f2ac'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:09.763155 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-49f5848c-e91d-4276-bff3-50bef482f2ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52e6dceb3bb948dba52cdc9c4c1eab5e', 'request_id': 'req-49f5848c-e91d-4276-bff3-50bef482f2ac'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:09.770888 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-49f5848c-e91d-4276-bff3-50bef482f2ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52e6dceb3bb948dba52cdc9c4c1eab5e', 'request_id': 'req-49f5848c-e91d-4276-bff3-50bef482f2ac'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:09.773276 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:38:09.782917 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab794b73-74a5-45ec-86ac-c824587e0d82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:09.783907 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab794b73-74a5-45ec-86ac-c824587e0d82 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:09.784406 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab794b73-74a5-45ec-86ac-c824587e0d82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:09.784996 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab794b73-74a5-45ec-86ac-c824587e0d82 admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:09.786420 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab794b73-74a5-45ec-86ac-c824587e0d82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:09.790337 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab794b73-74a5-45ec-86ac-c824587e0d82 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:09.795934 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-49f5848c-e91d-4276-bff3-50bef482f2ac admin admin] The token cache is being invalidate because project 52e6dceb3bb948dba52cdc9c4c1eab5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 09:38:09.796567 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-49f5848c-e91d-4276-bff3-50bef482f2ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:09.797590 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-49f5848c-e91d-4276-bff3-50bef482f2ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:09.799954 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 885/1756] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 14 09:38:09 2022] DELETE /identity/v3/projects/52e6dceb3bb948dba52cdc9c4c1eab5e => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:38:09.804894 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 872/1757] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 09:38:09 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:38:09.806130 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f5848c-e91d-4276-bff3-50bef482f2ac admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:09.808966 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-49f5848c-e91d-4276-bff3-50bef482f2ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:09.809188 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab794b73-74a5-45ec-86ac-c824587e0d82 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:09.819212 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-ab794b73-74a5-45ec-86ac-c824587e0d82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:09.823822 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f5848c-e91d-4276-bff3-50bef482f2ac admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:09.829229 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c3e189-1572-4925-bfb7-ebf2ff062160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:09.830121 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c3e189-1572-4925-bfb7-ebf2ff062160 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:09.830495 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c3e189-1572-4925-bfb7-ebf2ff062160 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:09.830866 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c3e189-1572-4925-bfb7-ebf2ff062160 admin admin] PATH_INFO: `/v3/users/c644eee5beb24eeb94e1581c10e6a711` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:09.834637 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c3e189-1572-4925-bfb7-ebf2ff062160 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c644eee5beb24eeb94e1581c10e6a711)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:09.836430 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c3e189-1572-4925-bfb7-ebf2ff062160 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:09.840585 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab794b73-74a5-45ec-86ac-c824587e0d82 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:09.849153 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574115c1-87ef-476a-a600-d32b7fd8efd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:09.850322 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574115c1-87ef-476a-a600-d32b7fd8efd8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:09.850890 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574115c1-87ef-476a-a600-d32b7fd8efd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:09.851369 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574115c1-87ef-476a-a600-d32b7fd8efd8 admin admin] PATH_INFO: `/v3/projects/e93b54fa3c984ebda354d3d6b872b083/users/bf275fc1ec8440bba63681b548f159fe/roles/17dfac38a2e540fea229af7de99911bb` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:09.901300 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574115c1-87ef-476a-a600-d32b7fd8efd8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e93b54fa3c984ebda354d3d6b872b083, user_id=bf275fc1ec8440bba63681b548f159fe, role_id=17dfac38a2e540fea229af7de99911bb)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:09.906250 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574115c1-87ef-476a-a600-d32b7fd8efd8 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:09.959347 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 873/1758] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 14 09:38:09 2022] PUT /identity/v3/projects/e93b54fa3c984ebda354d3d6b872b083/users/bf275fc1ec8440bba63681b548f159fe/roles/17dfac38a2e540fea229af7de99911bb => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 09:38:09.969360 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-97c3e189-1572-4925-bfb7-ebf2ff062160 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c644eee5beb24eeb94e1581c10e6a711'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:09.984414 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4304c608-e6f5-4c18-9b7f-7b6e4302e229 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:10.004391 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4304c608-e6f5-4c18-9b7f-7b6e4302e229 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:10.004905 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4304c608-e6f5-4c18-9b7f-7b6e4302e229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:10.033993 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-97c3e189-1572-4925-bfb7-ebf2ff062160 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c644eee5beb24eeb94e1581c10e6a711'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:10.037855 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-97c3e189-1572-4925-bfb7-ebf2ff062160 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c644eee5beb24eeb94e1581c10e6a711'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:10.058637 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-97c3e189-1572-4925-bfb7-ebf2ff062160 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c644eee5beb24eeb94e1581c10e6a711'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:10.060200 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-4304c608-e6f5-4c18-9b7f-7b6e4302e229 None None] MFA Rules not processed for user `bf275fc1ec8440bba63681b548f159fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:38:10.063382 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-4304c608-e6f5-4c18-9b7f-7b6e4302e229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:10.095935 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-97c3e189-1572-4925-bfb7-ebf2ff062160 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c644eee5beb24eeb94e1581c10e6a711'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:10.109251 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 886/1759] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 14 09:38:09 2022] DELETE /identity/v3/users/c644eee5beb24eeb94e1581c10e6a711 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:38:10.111569 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7230809-ad27-47e3-a45c-bd42705790e7 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:10.111921 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7230809-ad27-47e3-a45c-bd42705790e7 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:10.112212 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7230809-ad27-47e3-a45c-bd42705790e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:10.171799 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-a7230809-ad27-47e3-a45c-bd42705790e7 None None] MFA Rules not processed for user `131852d242d8426cb2b942d88900ba91`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:38:10.173327 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-a7230809-ad27-47e3-a45c-bd42705790e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:10.174678 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:38:10.259538 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 874/1760] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:38:09 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:38:10.270756 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4304c608-e6f5-4c18-9b7f-7b6e4302e229 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:10.272031 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-4304c608-e6f5-4c18-9b7f-7b6e4302e229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:10.360801 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 887/1761] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:38:10 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:38:10.362215 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7230809-ad27-47e3-a45c-bd42705790e7 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:10.363380 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-a7230809-ad27-47e3-a45c-bd42705790e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:10.435445 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4304c608-e6f5-4c18-9b7f-7b6e4302e229 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:10.464649 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:38:10.483571 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7230809-ad27-47e3-a45c-bd42705790e7 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:10.494492 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8335cd5d-4933-4bf9-bfac-e77f333569aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:10.496415 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8335cd5d-4933-4bf9-bfac-e77f333569aa admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:10.497419 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8335cd5d-4933-4bf9-bfac-e77f333569aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:10.498056 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8335cd5d-4933-4bf9-bfac-e77f333569aa admin admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:10.498793 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8335cd5d-4933-4bf9-bfac-e77f333569aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:10.501300 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8335cd5d-4933-4bf9-bfac-e77f333569aa admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:10.546462 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 888/1762] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 14 09:38:10 2022] POST /identity/v3/projects => generated 403 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:38:10.548176 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8335cd5d-4933-4bf9-bfac-e77f333569aa admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:10.584195 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43030a20-95f5-46cb-a01a-daa0133ab197 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f6962106dfa4c4c9af551053f8095e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:10.584879 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43030a20-95f5-46cb-a01a-daa0133ab197 service nova] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:10.585166 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43030a20-95f5-46cb-a01a-daa0133ab197 service nova] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:10.585445 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43030a20-95f5-46cb-a01a-daa0133ab197 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:10.674678 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8335cd5d-4933-4bf9-bfac-e77f333569aa admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:10.684008 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43030a20-95f5-46cb-a01a-daa0133ab197 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:10.687190 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43030a20-95f5-46cb-a01a-daa0133ab197 service nova] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:10.688084 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1730e31f-5e4e-4954-a3c6-3be6fbe573b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:10.689099 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1730e31f-5e4e-4954-a3c6-3be6fbe573b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:10.689545 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1730e31f-5e4e-4954-a3c6-3be6fbe573b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:10.690120 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1730e31f-5e4e-4954-a3c6-3be6fbe573b2 admin admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:10.691030 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1730e31f-5e4e-4954-a3c6-3be6fbe573b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:10.695131 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1730e31f-5e4e-4954-a3c6-3be6fbe573b2 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:10.699073 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 875/1763] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:38:10 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:38:10.734066 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 889/1764] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 14 09:38:10 2022] POST /identity/v3/users => generated 308 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:38:10.737735 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43030a20-95f5-46cb-a01a-daa0133ab197 service nova] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:10.749931 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43030a20-95f5-46cb-a01a-daa0133ab197 service nova] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:10.754870 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1e634d-81b9-4440-a8ed-2966797a27d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:10.755563 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1e634d-81b9-4440-a8ed-2966797a27d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:10.755856 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1e634d-81b9-4440-a8ed-2966797a27d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:10.756198 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1e634d-81b9-4440-a8ed-2966797a27d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:10.757234 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1e634d-81b9-4440-a8ed-2966797a27d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:10.759542 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1e634d-81b9-4440-a8ed-2966797a27d3 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:10.761530 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:38:10.786678 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 876/1765] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 09:38:10 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:38:10.787926 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1730e31f-5e4e-4954-a3c6-3be6fbe573b2 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:10.805748 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1730e31f-5e4e-4954-a3c6-3be6fbe573b2 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:10.815584 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b201a4e-782a-48fc-9d21-2d71f09e2ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:10.816517 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b201a4e-782a-48fc-9d21-2d71f09e2ab9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:10.816809 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b201a4e-782a-48fc-9d21-2d71f09e2ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:10.817091 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b201a4e-782a-48fc-9d21-2d71f09e2ab9 admin admin] PATH_INFO: `/v3/projects/bcf51b81b0244f559c46424cb182edcd/users/3eefc8d8171140f9b0ab630da644f0ae/roles/e3965bd0d5f1427a86a313c0c90bfef3` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:10.849993 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b201a4e-782a-48fc-9d21-2d71f09e2ab9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcf51b81b0244f559c46424cb182edcd, user_id=3eefc8d8171140f9b0ab630da644f0ae, role_id=e3965bd0d5f1427a86a313c0c90bfef3)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:10.854313 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1e634d-81b9-4440-a8ed-2966797a27d3 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:10.854482 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b201a4e-782a-48fc-9d21-2d71f09e2ab9 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:10.856874 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-fa1e634d-81b9-4440-a8ed-2966797a27d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:10.886739 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 890/1766] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 14 09:38:10 2022] PUT /identity/v3/projects/bcf51b81b0244f559c46424cb182edcd/users/3eefc8d8171140f9b0ab630da644f0ae/roles/e3965bd0d5f1427a86a313c0c90bfef3 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:38:10.887236 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1e634d-81b9-4440-a8ed-2966797a27d3 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:10.891446 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b201a4e-782a-48fc-9d21-2d71f09e2ab9 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:10.975763 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b201a4e-782a-48fc-9d21-2d71f09e2ab9 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:10.980893 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c37dec3-f3f0-465c-a083-992c44346e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:10.981707 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c37dec3-f3f0-465c-a083-992c44346e2b admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:10.982313 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c37dec3-f3f0-465c-a083-992c44346e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:10.982489 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c37dec3-f3f0-465c-a083-992c44346e2b admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:10.983909 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c37dec3-f3f0-465c-a083-992c44346e2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:10.986033 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c37dec3-f3f0-465c-a083-992c44346e2b admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:11.006911 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 891/1767] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 09:38:10 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:38:11.012699 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c37dec3-f3f0-465c-a083-992c44346e2b admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:11.033539 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c37dec3-f3f0-465c-a083-992c44346e2b admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:11.049151 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee437ca-34b0-4303-82d3-3a19e0f8b0c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:11.050281 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee437ca-34b0-4303-82d3-3a19e0f8b0c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:11.050679 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee437ca-34b0-4303-82d3-3a19e0f8b0c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:11.051030 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee437ca-34b0-4303-82d3-3a19e0f8b0c2 admin admin] PATH_INFO: `/v3/projects/bcf51b81b0244f559c46424cb182edcd/users/3eefc8d8171140f9b0ab630da644f0ae/roles/e3965bd0d5f1427a86a313c0c90bfef3` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:11.055210 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee437ca-34b0-4303-82d3-3a19e0f8b0c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcf51b81b0244f559c46424cb182edcd, user_id=3eefc8d8171140f9b0ab630da644f0ae, role_id=e3965bd0d5f1427a86a313c0c90bfef3)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:11.065111 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee437ca-34b0-4303-82d3-3a19e0f8b0c2 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:11.067348 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcad0e2f-507d-45b8-bbda-4474e15ec595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:11.071526 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcad0e2f-507d-45b8-bbda-4474e15ec595 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:11.071822 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcad0e2f-507d-45b8-bbda-4474e15ec595 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:11.072202 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcad0e2f-507d-45b8-bbda-4474e15ec595 admin admin] PATH_INFO: `/v3/projects/e0a3b4c8745f45e99e6a4313cf24f73c` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:11.075412 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcad0e2f-507d-45b8-bbda-4474e15ec595 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0a3b4c8745f45e99e6a4313cf24f73c)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:11.082018 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcad0e2f-507d-45b8-bbda-4474e15ec595 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:11.094452 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 892/1768] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 14 09:38:11 2022] PUT /identity/v3/projects/bcf51b81b0244f559c46424cb182edcd/users/3eefc8d8171140f9b0ab630da644f0ae/roles/e3965bd0d5f1427a86a313c0c90bfef3 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:38:11.249628 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-fcad0e2f-507d-45b8-bbda-4474e15ec595 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0a3b4c8745f45e99e6a4313cf24f73c', 'request_id': 'req-fcad0e2f-507d-45b8-bbda-4474e15ec595'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:11.265140 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-fcad0e2f-507d-45b8-bbda-4474e15ec595 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0a3b4c8745f45e99e6a4313cf24f73c', 'request_id': 'req-fcad0e2f-507d-45b8-bbda-4474e15ec595'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:11.281858 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-fcad0e2f-507d-45b8-bbda-4474e15ec595 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0a3b4c8745f45e99e6a4313cf24f73c', 'request_id': 'req-fcad0e2f-507d-45b8-bbda-4474e15ec595'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:11.324210 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-fcad0e2f-507d-45b8-bbda-4474e15ec595 admin admin] The token cache is being invalidate because project e0a3b4c8745f45e99e6a4313cf24f73c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 09:38:11.324726 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-fcad0e2f-507d-45b8-bbda-4474e15ec595 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:11.327967 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-fcad0e2f-507d-45b8-bbda-4474e15ec595 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:11.332235 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 877/1769] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 14 09:38:10 2022] DELETE /identity/v3/projects/e0a3b4c8745f45e99e6a4313cf24f73c => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 09:38:11.337380 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee437ca-34b0-4303-82d3-3a19e0f8b0c2 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:11.340287 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-8ee437ca-34b0-4303-82d3-3a19e0f8b0c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:11.459378 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:38:11.581630 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee437ca-34b0-4303-82d3-3a19e0f8b0c2 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:11.783645 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d336f5e-7e20-4088-9dfe-07abecab7359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:11.784838 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d336f5e-7e20-4088-9dfe-07abecab7359 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:11.785151 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d336f5e-7e20-4088-9dfe-07abecab7359 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:11.785462 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d336f5e-7e20-4088-9dfe-07abecab7359 admin admin] PATH_INFO: `/v3/users/014036a68b144aa095ad96c4b2749d76` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:11.787084 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d336f5e-7e20-4088-9dfe-07abecab7359 admin admin] RBAC: Authorizing `identity:delete_user(user_id=014036a68b144aa095ad96c4b2749d76)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:11.794502 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d336f5e-7e20-4088-9dfe-07abecab7359 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:11.923125 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-3d336f5e-7e20-4088-9dfe-07abecab7359 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '014036a68b144aa095ad96c4b2749d76'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:11.982749 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-3d336f5e-7e20-4088-9dfe-07abecab7359 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '014036a68b144aa095ad96c4b2749d76'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:11.985075 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-3d336f5e-7e20-4088-9dfe-07abecab7359 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '014036a68b144aa095ad96c4b2749d76'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:12.007798 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-3d336f5e-7e20-4088-9dfe-07abecab7359 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '014036a68b144aa095ad96c4b2749d76'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:12.022338 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-3d336f5e-7e20-4088-9dfe-07abecab7359 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '014036a68b144aa095ad96c4b2749d76'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:12.039282 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 893/1770] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 14 09:38:11 2022] DELETE /identity/v3/users/014036a68b144aa095ad96c4b2749d76 => generated 0 bytes in 701 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:38:12.992003 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecd1e99-f1c6-4a38-9b27-c7901eaf98ac None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:12.992606 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecd1e99-f1c6-4a38-9b27-c7901eaf98ac None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:12.992688 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecd1e99-f1c6-4a38-9b27-c7901eaf98ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:13.057053 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-3ecd1e99-f1c6-4a38-9b27-c7901eaf98ac None None] MFA Rules not processed for user `3eefc8d8171140f9b0ab630da644f0ae`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:38:13.069146 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-3ecd1e99-f1c6-4a38-9b27-c7901eaf98ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:13.346653 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 878/1771] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:38:12 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 356 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:38:14.085766 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d336f5e-7e20-4088-9dfe-07abecab7359 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:14.089492 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-3d336f5e-7e20-4088-9dfe-07abecab7359 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:14.175749 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:38:14.193984 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d336f5e-7e20-4088-9dfe-07abecab7359 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:14.200649 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9752c87-6761-44a4-8411-a08143b8d106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:14.201717 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9752c87-6761-44a4-8411-a08143b8d106 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:14.202148 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9752c87-6761-44a4-8411-a08143b8d106 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:14.202598 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9752c87-6761-44a4-8411-a08143b8d106 admin admin] PATH_INFO: `/v3/projects/17636184eace437c914ec860de321612` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:14.204259 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9752c87-6761-44a4-8411-a08143b8d106 admin admin] RBAC: Authorizing `identity:delete_project(project_id=17636184eace437c914ec860de321612)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:14.206718 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9752c87-6761-44a4-8411-a08143b8d106 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:14.307433 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-e9752c87-6761-44a4-8411-a08143b8d106 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17636184eace437c914ec860de321612', 'request_id': 'req-e9752c87-6761-44a4-8411-a08143b8d106'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:14.322806 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-e9752c87-6761-44a4-8411-a08143b8d106 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17636184eace437c914ec860de321612', 'request_id': 'req-e9752c87-6761-44a4-8411-a08143b8d106'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:14.351137 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-e9752c87-6761-44a4-8411-a08143b8d106 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17636184eace437c914ec860de321612', 'request_id': 'req-e9752c87-6761-44a4-8411-a08143b8d106'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:14.372475 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-e9752c87-6761-44a4-8411-a08143b8d106 admin admin] The token cache is being invalidate because project 17636184eace437c914ec860de321612 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 09:38:14.373043 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-e9752c87-6761-44a4-8411-a08143b8d106 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:14.374037 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-e9752c87-6761-44a4-8411-a08143b8d106 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:14.377104 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 894/1772] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 14 09:38:14 2022] DELETE /identity/v3/projects/17636184eace437c914ec860de321612 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:38:14.383058 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fb0a53-7909-4531-ba32-5c890a1a5828 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:14.383766 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fb0a53-7909-4531-ba32-5c890a1a5828 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:14.383766 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fb0a53-7909-4531-ba32-5c890a1a5828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:14.402895 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-e0fb0a53-7909-4531-ba32-5c890a1a5828 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:38:14.404145 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-e0fb0a53-7909-4531-ba32-5c890a1a5828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:14.411479 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:38:14.495446 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 879/1773] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:38:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:38:14.502621 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f8daab-1257-477e-8e63-ab85e287a911 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:14.503555 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f8daab-1257-477e-8e63-ab85e287a911 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:14.503555 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f8daab-1257-477e-8e63-ab85e287a911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:14.523531 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-08f8daab-1257-477e-8e63-ab85e287a911 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:38:14.525408 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-08f8daab-1257-477e-8e63-ab85e287a911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:14.535280 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 895/1774] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:38:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:38:14.539266 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fb0a53-7909-4531-ba32-5c890a1a5828 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:14.551089 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fb0a53-7909-4531-ba32-5c890a1a5828 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:14.560691 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02da1ad8-3024-413a-9b63-186f40f2fe53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:14.561643 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02da1ad8-3024-413a-9b63-186f40f2fe53 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:14.562033 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02da1ad8-3024-413a-9b63-186f40f2fe53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:14.562519 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02da1ad8-3024-413a-9b63-186f40f2fe53 admin admin] PATH_INFO: `/v3/domains` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:14.563704 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02da1ad8-3024-413a-9b63-186f40f2fe53 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:38:14.564174 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02da1ad8-3024-413a-9b63-186f40f2fe53 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:14.567320 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02da1ad8-3024-413a-9b63-186f40f2fe53 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:14.588848 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 880/1775] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jul 14 09:38:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:38:14.589233 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f8daab-1257-477e-8e63-ab85e287a911 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:14.600140 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f8daab-1257-477e-8e63-ab85e287a911 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:14.605983 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c593e882-03e0-4ff8-8cbe-a6e778b10e73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:14.606294 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c593e882-03e0-4ff8-8cbe-a6e778b10e73 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:14.606632 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c593e882-03e0-4ff8-8cbe-a6e778b10e73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:14.606914 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c593e882-03e0-4ff8-8cbe-a6e778b10e73 admin admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:14.607683 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c593e882-03e0-4ff8-8cbe-a6e778b10e73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:14.610358 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c593e882-03e0-4ff8-8cbe-a6e778b10e73 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:14.651747 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 896/1776] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 14 09:38:14 2022] POST /identity/v3/projects => generated 407 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:38:14.653355 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02da1ad8-3024-413a-9b63-186f40f2fe53 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:14.666492 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02da1ad8-3024-413a-9b63-186f40f2fe53 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:14.866090 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55402a6c-6cd5-4123-92db-b8de4658e266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:14.866917 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55402a6c-6cd5-4123-92db-b8de4658e266 admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:14.867321 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55402a6c-6cd5-4123-92db-b8de4658e266 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:14.867682 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55402a6c-6cd5-4123-92db-b8de4658e266 admin admin] PATH_INFO: `/v3/users` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:14.871982 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55402a6c-6cd5-4123-92db-b8de4658e266 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:14.874341 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55402a6c-6cd5-4123-92db-b8de4658e266 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:14.878564 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26328323-fe20-432a-bfe3-fdcecd0241bb None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:14.879163 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26328323-fe20-432a-bfe3-fdcecd0241bb None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:14.879603 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26328323-fe20-432a-bfe3-fdcecd0241bb None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:14.881529 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 897/1777] 10.222.0.40 () {54 vars in 921 bytes} [Thu Jul 14 09:38:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:38:14.915277 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734a9637-1003-48b2-96a2-8943ad95084f None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:14.918045 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734a9637-1003-48b2-96a2-8943ad95084f None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:14.919440 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734a9637-1003-48b2-96a2-8943ad95084f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:14.926900 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 881/1778] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 14 09:38:14 2022] POST /identity/v3/users => generated 304 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:38:14.928007 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55402a6c-6cd5-4123-92db-b8de4658e266 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:14.949000 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55402a6c-6cd5-4123-92db-b8de4658e266 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:14.968243 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-734a9637-1003-48b2-96a2-8943ad95084f None None] MFA Rules not processed for user `6fc5a80144b84c609944a51a84fd5e6e`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:38:14.969112 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-734a9637-1003-48b2-96a2-8943ad95084f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:14.972156 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48266b64-0fda-44f2-a3bd-6d627089f2fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:14.976728 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48266b64-0fda-44f2-a3bd-6d627089f2fc admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:14.977036 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48266b64-0fda-44f2-a3bd-6d627089f2fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:14.977319 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48266b64-0fda-44f2-a3bd-6d627089f2fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:14.978071 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48266b64-0fda-44f2-a3bd-6d627089f2fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:14.979755 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48266b64-0fda-44f2-a3bd-6d627089f2fc admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:15.024549 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 882/1779] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 09:38:14 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:38:15.025343 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48266b64-0fda-44f2-a3bd-6d627089f2fc admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:15.062762 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48266b64-0fda-44f2-a3bd-6d627089f2fc admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:15.078506 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d980f36b-f84a-49aa-abcc-425c4b442e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:15.079222 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d980f36b-f84a-49aa-abcc-425c4b442e96 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:15.079543 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d980f36b-f84a-49aa-abcc-425c4b442e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:15.082970 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d980f36b-f84a-49aa-abcc-425c4b442e96 admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:15.083806 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d980f36b-f84a-49aa-abcc-425c4b442e96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:15.086230 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d980f36b-f84a-49aa-abcc-425c4b442e96 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:15.137147 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 883/1780] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 09:38:15 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:38:15.142574 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d980f36b-f84a-49aa-abcc-425c4b442e96 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:15.149705 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 898/1781] 10.222.0.40 () {58 vars in 1018 bytes} [Thu Jul 14 09:38:14 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 09:38:15.165279 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d980f36b-f84a-49aa-abcc-425c4b442e96 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:15.183285 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222242e5-2546-49c4-8a16-0fb643fe5e19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:15.184383 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222242e5-2546-49c4-8a16-0fb643fe5e19 admin admin] REQUEST_METHOD: `PUT` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:15.184679 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222242e5-2546-49c4-8a16-0fb643fe5e19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:15.185120 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222242e5-2546-49c4-8a16-0fb643fe5e19 admin admin] PATH_INFO: `/v3/projects/79edec4f0e884188bf8e7bf379b6e457/users/a65edfbc56e2478fa9441c7ef43f7cc7/roles/17dfac38a2e540fea229af7de99911bb` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:15.220020 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222242e5-2546-49c4-8a16-0fb643fe5e19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79edec4f0e884188bf8e7bf379b6e457, user_id=a65edfbc56e2478fa9441c7ef43f7cc7, role_id=17dfac38a2e540fea229af7de99911bb)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:15.225821 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222242e5-2546-49c4-8a16-0fb643fe5e19 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:15.240008 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734a9637-1003-48b2-96a2-8943ad95084f None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:15.244732 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-734a9637-1003-48b2-96a2-8943ad95084f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:15.255620 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 884/1782] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 14 09:38:15 2022] PUT /identity/v3/projects/79edec4f0e884188bf8e7bf379b6e457/users/a65edfbc56e2478fa9441c7ef43f7cc7/roles/17dfac38a2e540fea229af7de99911bb => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:38:15.266621 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3adb26-c03c-400a-8f5d-3b1a1f90d348 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:15.266934 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3adb26-c03c-400a-8f5d-3b1a1f90d348 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:15.267216 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3adb26-c03c-400a-8f5d-3b1a1f90d348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:15.302919 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734a9637-1003-48b2-96a2-8943ad95084f None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:15.362352 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-5c3adb26-c03c-400a-8f5d-3b1a1f90d348 None None] MFA Rules not processed for user `a65edfbc56e2478fa9441c7ef43f7cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:38:15.368015 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-5c3adb26-c03c-400a-8f5d-3b1a1f90d348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:15.433522 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:38:15.467981 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:38:15.471491 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d51a0c2-642a-4033-9183-2025bf538fd5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc5a80144b84c609944a51a84fd5e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:15.473329 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d51a0c2-642a-4033-9183-2025bf538fd5 service placement] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:15.473329 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d51a0c2-642a-4033-9183-2025bf538fd5 service placement] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:15.473329 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d51a0c2-642a-4033-9183-2025bf538fd5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:15.499605 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d51a0c2-642a-4033-9183-2025bf538fd5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:15.501838 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d51a0c2-642a-4033-9183-2025bf538fd5 service placement] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:15.540679 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 899/1783] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:38:15 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:38:15.542308 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 885/1784] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:38:15 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:38:15.546558 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d51a0c2-642a-4033-9183-2025bf538fd5 service placement] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:15.654155 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d51a0c2-642a-4033-9183-2025bf538fd5 service placement] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:15.660455 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c3d68e-69a4-456a-8300-a7f41baed4d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:15.661279 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c3d68e-69a4-456a-8300-a7f41baed4d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:15.661666 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c3d68e-69a4-456a-8300-a7f41baed4d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:15.662071 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c3d68e-69a4-456a-8300-a7f41baed4d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:15.662902 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c3d68e-69a4-456a-8300-a7f41baed4d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:15.668245 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c3d68e-69a4-456a-8300-a7f41baed4d4 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:15.721895 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 900/1785] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 14 09:38:15 2022] POST /identity/v3/projects => generated 409 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:38:15.726652 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3adb26-c03c-400a-8f5d-3b1a1f90d348 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:15.741419 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3adb26-c03c-400a-8f5d-3b1a1f90d348 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:15.872614 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86c5bab-8f47-4a75-8eee-0f5bbaf50e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:15.873622 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86c5bab-8f47-4a75-8eee-0f5bbaf50e0f admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:15.874056 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86c5bab-8f47-4a75-8eee-0f5bbaf50e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:15.874495 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86c5bab-8f47-4a75-8eee-0f5bbaf50e0f admin admin] PATH_INFO: `/v3/users` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:15.875382 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86c5bab-8f47-4a75-8eee-0f5bbaf50e0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:15.878084 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86c5bab-8f47-4a75-8eee-0f5bbaf50e0f admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:15.906036 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 886/1786] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 14 09:38:15 2022] POST /identity/v3/users => generated 311 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 09:38:15.909793 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c3d68e-69a4-456a-8300-a7f41baed4d4 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:15.920983 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c3d68e-69a4-456a-8300-a7f41baed4d4 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:15.925754 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be3661f-c4b8-4b1c-934e-101c5a99c91f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:15.926500 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be3661f-c4b8-4b1c-934e-101c5a99c91f admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:15.926788 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be3661f-c4b8-4b1c-934e-101c5a99c91f admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:15.927068 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be3661f-c4b8-4b1c-934e-101c5a99c91f admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:15.927993 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be3661f-c4b8-4b1c-934e-101c5a99c91f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:15.930764 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be3661f-c4b8-4b1c-934e-101c5a99c91f admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:15.960200 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 901/1787] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 09:38:15 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:38:15.960496 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86c5bab-8f47-4a75-8eee-0f5bbaf50e0f admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:15.971986 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86c5bab-8f47-4a75-8eee-0f5bbaf50e0f admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:15.978303 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed1756d-2376-4d5f-86ec-1175a07557f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:15.979232 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed1756d-2376-4d5f-86ec-1175a07557f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:15.979516 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed1756d-2376-4d5f-86ec-1175a07557f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:15.979922 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed1756d-2376-4d5f-86ec-1175a07557f2 admin admin] PATH_INFO: `/v3/projects/9355ded790b748e8b2143ff09725007c/users/0c1dc07a53b845e98a53fe6b9e1706a5/roles/e3965bd0d5f1427a86a313c0c90bfef3` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:16.000324 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed1756d-2376-4d5f-86ec-1175a07557f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9355ded790b748e8b2143ff09725007c, user_id=0c1dc07a53b845e98a53fe6b9e1706a5, role_id=e3965bd0d5f1427a86a313c0c90bfef3)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:16.003298 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed1756d-2376-4d5f-86ec-1175a07557f2 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:16.025989 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 887/1788] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 14 09:38:15 2022] PUT /identity/v3/projects/9355ded790b748e8b2143ff09725007c/users/0c1dc07a53b845e98a53fe6b9e1706a5/roles/e3965bd0d5f1427a86a313c0c90bfef3 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:38:16.030693 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be3661f-c4b8-4b1c-934e-101c5a99c91f admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:16.044733 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be3661f-c4b8-4b1c-934e-101c5a99c91f admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:16.115625 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca7e36d-477a-413b-94ee-6a4881bdfd42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:16.116429 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca7e36d-477a-413b-94ee-6a4881bdfd42 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:16.116789 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca7e36d-477a-413b-94ee-6a4881bdfd42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:16.117142 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca7e36d-477a-413b-94ee-6a4881bdfd42 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:16.118002 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca7e36d-477a-413b-94ee-6a4881bdfd42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:16.119840 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca7e36d-477a-413b-94ee-6a4881bdfd42 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:16.131748 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 902/1789] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 09:38:16 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:38:16.135914 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed1756d-2376-4d5f-86ec-1175a07557f2 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:16.147735 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed1756d-2376-4d5f-86ec-1175a07557f2 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:16.152931 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525b45d6-cce3-419d-8df1-fd879ccdc919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:16.153834 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525b45d6-cce3-419d-8df1-fd879ccdc919 admin admin] REQUEST_METHOD: `PUT` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:16.154124 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525b45d6-cce3-419d-8df1-fd879ccdc919 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:16.154484 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525b45d6-cce3-419d-8df1-fd879ccdc919 admin admin] PATH_INFO: `/v3/projects/9355ded790b748e8b2143ff09725007c/users/0c1dc07a53b845e98a53fe6b9e1706a5/roles/e3965bd0d5f1427a86a313c0c90bfef3` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:16.156465 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525b45d6-cce3-419d-8df1-fd879ccdc919 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9355ded790b748e8b2143ff09725007c, user_id=0c1dc07a53b845e98a53fe6b9e1706a5, role_id=e3965bd0d5f1427a86a313c0c90bfef3)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:16.159164 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525b45d6-cce3-419d-8df1-fd879ccdc919 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:16.169958 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 888/1790] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 14 09:38:16 2022] PUT /identity/v3/projects/9355ded790b748e8b2143ff09725007c/users/0c1dc07a53b845e98a53fe6b9e1706a5/roles/e3965bd0d5f1427a86a313c0c90bfef3 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 09:38:16.182774 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccdb6a6-2eba-4f65-8df9-e52700d6d5d8 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:16.183256 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccdb6a6-2eba-4f65-8df9-e52700d6d5d8 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:16.183458 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccdb6a6-2eba-4f65-8df9-e52700d6d5d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:16.195486 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525b45d6-cce3-419d-8df1-fd879ccdc919 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:16.197485 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-525b45d6-cce3-419d-8df1-fd879ccdc919 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:16.212914 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-0ccdb6a6-2eba-4f65-8df9-e52700d6d5d8 None None] MFA Rules not processed for user `0c1dc07a53b845e98a53fe6b9e1706a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:38:16.214436 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-0ccdb6a6-2eba-4f65-8df9-e52700d6d5d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:16.267112 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:38:16.278049 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525b45d6-cce3-419d-8df1-fd879ccdc919 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:16.287480 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9941fd8-ab22-456c-93f1-e3ee61fffe1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:16.288499 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9941fd8-ab22-456c-93f1-e3ee61fffe1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:16.288787 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9941fd8-ab22-456c-93f1-e3ee61fffe1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:16.289067 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9941fd8-ab22-456c-93f1-e3ee61fffe1b admin admin] PATH_INFO: `/v3/users/131852d242d8426cb2b942d88900ba91` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:16.290434 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9941fd8-ab22-456c-93f1-e3ee61fffe1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=131852d242d8426cb2b942d88900ba91)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:16.293535 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9941fd8-ab22-456c-93f1-e3ee61fffe1b admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:16.303840 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 903/1791] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:38:16 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:38:16.317217 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccdb6a6-2eba-4f65-8df9-e52700d6d5d8 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:16.318797 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-0ccdb6a6-2eba-4f65-8df9-e52700d6d5d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:16.333648 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=4 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:38:16.360608 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-b9941fd8-ab22-456c-93f1-e3ee61fffe1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '131852d242d8426cb2b942d88900ba91'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:16.369773 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-b9941fd8-ab22-456c-93f1-e3ee61fffe1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '131852d242d8426cb2b942d88900ba91'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:16.370590 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-b9941fd8-ab22-456c-93f1-e3ee61fffe1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '131852d242d8426cb2b942d88900ba91'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:16.381068 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-b9941fd8-ab22-456c-93f1-e3ee61fffe1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '131852d242d8426cb2b942d88900ba91'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:16.382454 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-b9941fd8-ab22-456c-93f1-e3ee61fffe1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '131852d242d8426cb2b942d88900ba91'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:16.397412 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccdb6a6-2eba-4f65-8df9-e52700d6d5d8 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:16.401534 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de17a644-e367-48eb-8470-2c35565ccae4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25048b29787d482783ebc944f1a7df65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:16.402240 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de17a644-e367-48eb-8470-2c35565ccae4 service cinder] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:16.402534 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de17a644-e367-48eb-8470-2c35565ccae4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:16.402816 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de17a644-e367-48eb-8470-2c35565ccae4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:16.404381 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 889/1792] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 14 09:38:16 2022] DELETE /identity/v3/users/131852d242d8426cb2b942d88900ba91 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:38:16.404867 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-de17a644-e367-48eb-8470-2c35565ccae4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:16.423205 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de17a644-e367-48eb-8470-2c35565ccae4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:16.424684 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de17a644-e367-48eb-8470-2c35565ccae4 service cinder] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:16.440405 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 904/1793] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:38:16 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:38:16.624154 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9941fd8-ab22-456c-93f1-e3ee61fffe1b admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:16.625703 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-b9941fd8-ab22-456c-93f1-e3ee61fffe1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:16.629440 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de17a644-e367-48eb-8470-2c35565ccae4 service cinder] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:16.631357 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-de17a644-e367-48eb-8470-2c35565ccae4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:16.648777 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de17a644-e367-48eb-8470-2c35565ccae4 service cinder] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:16.718598 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9941fd8-ab22-456c-93f1-e3ee61fffe1b admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:16.724729 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2b0683-0f12-4720-b3c2-ce476b22d9d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:16.726504 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2b0683-0f12-4720-b3c2-ce476b22d9d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:16.726504 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2b0683-0f12-4720-b3c2-ce476b22d9d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:16.726504 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2b0683-0f12-4720-b3c2-ce476b22d9d5 admin admin] PATH_INFO: `/v3/projects/2b0d9d86f7c347489b062789cbc2c9bf` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:16.727466 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2b0683-0f12-4720-b3c2-ce476b22d9d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b0d9d86f7c347489b062789cbc2c9bf)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:16.729679 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2b0683-0f12-4720-b3c2-ce476b22d9d5 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:16.753293 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2c05ba-3b9a-44c1-b1da-b9909984f443 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25048b29787d482783ebc944f1a7df65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:16.756452 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2c05ba-3b9a-44c1-b1da-b9909984f443 service cinder] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:16.756452 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2c05ba-3b9a-44c1-b1da-b9909984f443 service cinder] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:16.756452 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2c05ba-3b9a-44c1-b1da-b9909984f443 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:16.756922 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-1e2c05ba-3b9a-44c1-b1da-b9909984f443 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:16.792681 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-3a2b0683-0f12-4720-b3c2-ce476b22d9d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b0d9d86f7c347489b062789cbc2c9bf', 'request_id': 'req-3a2b0683-0f12-4720-b3c2-ce476b22d9d5'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:16.803021 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-3a2b0683-0f12-4720-b3c2-ce476b22d9d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b0d9d86f7c347489b062789cbc2c9bf', 'request_id': 'req-3a2b0683-0f12-4720-b3c2-ce476b22d9d5'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:16.818309 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-3a2b0683-0f12-4720-b3c2-ce476b22d9d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b0d9d86f7c347489b062789cbc2c9bf', 'request_id': 'req-3a2b0683-0f12-4720-b3c2-ce476b22d9d5'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:16.832720 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2c05ba-3b9a-44c1-b1da-b9909984f443 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:16.833949 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-3a2b0683-0f12-4720-b3c2-ce476b22d9d5 admin admin] The token cache is being invalidate because project 2b0d9d86f7c347489b062789cbc2c9bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 09:38:16.834281 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-3a2b0683-0f12-4720-b3c2-ce476b22d9d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:16.834680 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2c05ba-3b9a-44c1-b1da-b9909984f443 service cinder] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:16.835021 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-3a2b0683-0f12-4720-b3c2-ce476b22d9d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:16.836881 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 890/1794] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 14 09:38:16 2022] DELETE /identity/v3/projects/2b0d9d86f7c347489b062789cbc2c9bf => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:38:16.842096 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2b0683-0f12-4720-b3c2-ce476b22d9d5 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:16.843650 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-3a2b0683-0f12-4720-b3c2-ce476b22d9d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:16.847855 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 905/1795] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:38:16 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 09:38:16.887181 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:38:16.932879 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2b0683-0f12-4720-b3c2-ce476b22d9d5 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:16.939853 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097a65c4-e599-417d-b970-d91d8dcc8bdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:16.940885 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097a65c4-e599-417d-b970-d91d8dcc8bdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:16.941259 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097a65c4-e599-417d-b970-d91d8dcc8bdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:16.941608 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097a65c4-e599-417d-b970-d91d8dcc8bdf admin admin] PATH_INFO: `/v3/users/3eefc8d8171140f9b0ab630da644f0ae` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:16.943347 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097a65c4-e599-417d-b970-d91d8dcc8bdf admin admin] RBAC: Authorizing `identity:delete_user(user_id=3eefc8d8171140f9b0ab630da644f0ae)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:16.946154 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097a65c4-e599-417d-b970-d91d8dcc8bdf admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:16.996046 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-097a65c4-e599-417d-b970-d91d8dcc8bdf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3eefc8d8171140f9b0ab630da644f0ae'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:17.004036 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-097a65c4-e599-417d-b970-d91d8dcc8bdf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3eefc8d8171140f9b0ab630da644f0ae'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:17.004743 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-097a65c4-e599-417d-b970-d91d8dcc8bdf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3eefc8d8171140f9b0ab630da644f0ae'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:17.012269 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-097a65c4-e599-417d-b970-d91d8dcc8bdf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3eefc8d8171140f9b0ab630da644f0ae'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:17.013127 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-097a65c4-e599-417d-b970-d91d8dcc8bdf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3eefc8d8171140f9b0ab630da644f0ae'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:17.032225 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 891/1796] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 14 09:38:16 2022] DELETE /identity/v3/users/3eefc8d8171140f9b0ab630da644f0ae => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:38:17.265752 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2c05ba-3b9a-44c1-b1da-b9909984f443 service cinder] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:17.289591 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2c05ba-3b9a-44c1-b1da-b9909984f443 service cinder] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:17.366632 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:38:17.411451 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1129d3a-cbad-476c-bfa0-622aa9def842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:17.412467 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1129d3a-cbad-476c-bfa0-622aa9def842 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:17.412828 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1129d3a-cbad-476c-bfa0-622aa9def842 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:17.413175 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1129d3a-cbad-476c-bfa0-622aa9def842 admin admin] PATH_INFO: `/v3/projects/bcf51b81b0244f559c46424cb182edcd` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:17.414859 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1129d3a-cbad-476c-bfa0-622aa9def842 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bcf51b81b0244f559c46424cb182edcd)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:17.416983 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1129d3a-cbad-476c-bfa0-622aa9def842 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:17.489219 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-e1129d3a-cbad-476c-bfa0-622aa9def842 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bcf51b81b0244f559c46424cb182edcd', 'request_id': 'req-e1129d3a-cbad-476c-bfa0-622aa9def842'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:17.495673 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-e1129d3a-cbad-476c-bfa0-622aa9def842 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bcf51b81b0244f559c46424cb182edcd', 'request_id': 'req-e1129d3a-cbad-476c-bfa0-622aa9def842'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:17.502063 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-e1129d3a-cbad-476c-bfa0-622aa9def842 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bcf51b81b0244f559c46424cb182edcd', 'request_id': 'req-e1129d3a-cbad-476c-bfa0-622aa9def842'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:17.516191 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-e1129d3a-cbad-476c-bfa0-622aa9def842 admin admin] The token cache is being invalidate because project bcf51b81b0244f559c46424cb182edcd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 09:38:17.516467 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-e1129d3a-cbad-476c-bfa0-622aa9def842 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:17.517167 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-e1129d3a-cbad-476c-bfa0-622aa9def842 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:17.518815 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 906/1797] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 14 09:38:17 2022] DELETE /identity/v3/projects/bcf51b81b0244f559c46424cb182edcd => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:38:17.528104 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d8577a-fc12-4836-b4ed-289979a84bbf None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:17.528416 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d8577a-fc12-4836-b4ed-289979a84bbf None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:17.528705 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d8577a-fc12-4836-b4ed-289979a84bbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:17.549594 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-a9d8577a-fc12-4836-b4ed-289979a84bbf None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:38:17.550964 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-a9d8577a-fc12-4836-b4ed-289979a84bbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:17.630129 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 892/1798] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:38:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:38:17.637887 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140da511-dc9f-4ccc-8742-8f8b72c26ad2 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:17.638200 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140da511-dc9f-4ccc-8742-8f8b72c26ad2 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:17.638494 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140da511-dc9f-4ccc-8742-8f8b72c26ad2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:17.658102 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-140da511-dc9f-4ccc-8742-8f8b72c26ad2 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:38:17.659348 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-140da511-dc9f-4ccc-8742-8f8b72c26ad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:17.667317 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 907/1799] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:38:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:38:17.672300 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d8577a-fc12-4836-b4ed-289979a84bbf None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:17.682207 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d8577a-fc12-4836-b4ed-289979a84bbf None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:17.687262 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16373c50-8c41-4a2d-803e-145feea2a6d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:17.687940 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16373c50-8c41-4a2d-803e-145feea2a6d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:17.688221 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16373c50-8c41-4a2d-803e-145feea2a6d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:17.688620 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16373c50-8c41-4a2d-803e-145feea2a6d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:17.689220 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16373c50-8c41-4a2d-803e-145feea2a6d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:38:17.689526 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16373c50-8c41-4a2d-803e-145feea2a6d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:17.691222 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16373c50-8c41-4a2d-803e-145feea2a6d5 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:17.703927 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 893/1800] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jul 14 09:38:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:38:17.708208 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140da511-dc9f-4ccc-8742-8f8b72c26ad2 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:17.718333 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140da511-dc9f-4ccc-8742-8f8b72c26ad2 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:17.722936 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1a0e3c-e63f-4883-a0b6-b4b3e9e97e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:17.724187 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1a0e3c-e63f-4883-a0b6-b4b3e9e97e13 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:17.724477 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1a0e3c-e63f-4883-a0b6-b4b3e9e97e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:17.724753 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1a0e3c-e63f-4883-a0b6-b4b3e9e97e13 admin admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:17.725461 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1a0e3c-e63f-4883-a0b6-b4b3e9e97e13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:17.727386 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1a0e3c-e63f-4883-a0b6-b4b3e9e97e13 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:17.768954 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 908/1801] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 14 09:38:17 2022] POST /identity/v3/projects => generated 389 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 09:38:17.770034 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16373c50-8c41-4a2d-803e-145feea2a6d5 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:17.786390 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16373c50-8c41-4a2d-803e-145feea2a6d5 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:17.835777 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:38:17.873915 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453e3285-3b83-43db-a609-69afab2c79f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:17.875974 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453e3285-3b83-43db-a609-69afab2c79f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:17.880358 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453e3285-3b83-43db-a609-69afab2c79f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:17.882275 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453e3285-3b83-43db-a609-69afab2c79f9 admin admin] PATH_INFO: `/v3/users` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:17.883327 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453e3285-3b83-43db-a609-69afab2c79f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:17.886385 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453e3285-3b83-43db-a609-69afab2c79f9 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:17.922701 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 894/1802] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 14 09:38:17 2022] POST /identity/v3/users => generated 295 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 09:38:17.924478 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1a0e3c-e63f-4883-a0b6-b4b3e9e97e13 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:17.956633 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1a0e3c-e63f-4883-a0b6-b4b3e9e97e13 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:17.970380 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fa7aa7-b43d-4e1c-8047-7c1ad745769d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:17.972150 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fa7aa7-b43d-4e1c-8047-7c1ad745769d admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:17.972811 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fa7aa7-b43d-4e1c-8047-7c1ad745769d admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:17.973338 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fa7aa7-b43d-4e1c-8047-7c1ad745769d admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:17.974402 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fa7aa7-b43d-4e1c-8047-7c1ad745769d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:17.976325 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fa7aa7-b43d-4e1c-8047-7c1ad745769d admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:17.998268 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 909/1803] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 09:38:17 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:38:18.002504 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453e3285-3b83-43db-a609-69afab2c79f9 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:18.013504 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453e3285-3b83-43db-a609-69afab2c79f9 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:18.020026 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b926195-38c0-4643-b4f5-0af0ae99d902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:18.020735 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b926195-38c0-4643-b4f5-0af0ae99d902 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:18.021071 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b926195-38c0-4643-b4f5-0af0ae99d902 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:18.021369 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b926195-38c0-4643-b4f5-0af0ae99d902 admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:18.022164 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b926195-38c0-4643-b4f5-0af0ae99d902 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:18.023853 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b926195-38c0-4643-b4f5-0af0ae99d902 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:18.036187 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 895/1804] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 09:38:18 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:38:18.040303 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fa7aa7-b43d-4e1c-8047-7c1ad745769d admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:18.052115 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fa7aa7-b43d-4e1c-8047-7c1ad745769d admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:18.057719 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47debe94-0b36-41ec-b061-5bc89b3fcf3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:18.062906 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47debe94-0b36-41ec-b061-5bc89b3fcf3b admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:18.063241 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47debe94-0b36-41ec-b061-5bc89b3fcf3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:18.063535 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47debe94-0b36-41ec-b061-5bc89b3fcf3b admin admin] PATH_INFO: `/v3/projects/6a9c30f05e784f61b95c80c5ae7de32e/users/19e095b67d0e43fcaa11da4749b0bf80/roles/17dfac38a2e540fea229af7de99911bb` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:18.083217 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47debe94-0b36-41ec-b061-5bc89b3fcf3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a9c30f05e784f61b95c80c5ae7de32e, user_id=19e095b67d0e43fcaa11da4749b0bf80, role_id=17dfac38a2e540fea229af7de99911bb)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:18.085821 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47debe94-0b36-41ec-b061-5bc89b3fcf3b admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:18.102262 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 910/1805] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 14 09:38:18 2022] PUT /identity/v3/projects/6a9c30f05e784f61b95c80c5ae7de32e/users/19e095b67d0e43fcaa11da4749b0bf80/roles/17dfac38a2e540fea229af7de99911bb => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 09:38:18.113984 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2572213f-f92f-42fe-abd8-42b23e4f7273 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:18.114315 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2572213f-f92f-42fe-abd8-42b23e4f7273 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:18.114624 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2572213f-f92f-42fe-abd8-42b23e4f7273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:18.144346 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-2572213f-f92f-42fe-abd8-42b23e4f7273 None None] MFA Rules not processed for user `19e095b67d0e43fcaa11da4749b0bf80`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:38:18.146316 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-2572213f-f92f-42fe-abd8-42b23e4f7273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:18.223789 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 896/1806] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:38:18 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 09:38:18.228116 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47debe94-0b36-41ec-b061-5bc89b3fcf3b admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:18.301402 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47debe94-0b36-41ec-b061-5bc89b3fcf3b admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:18.306258 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b87a46-5696-49b2-95e9-9a2fe77efe2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:18.306936 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b87a46-5696-49b2-95e9-9a2fe77efe2d admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:18.307226 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b87a46-5696-49b2-95e9-9a2fe77efe2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:18.307534 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b87a46-5696-49b2-95e9-9a2fe77efe2d admin admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:18.308234 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b87a46-5696-49b2-95e9-9a2fe77efe2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:18.310165 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b87a46-5696-49b2-95e9-9a2fe77efe2d admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:18.313900 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:38:18.346105 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 911/1807] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 14 09:38:18 2022] POST /identity/v3/projects => generated 393 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:38:18.349996 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2572213f-f92f-42fe-abd8-42b23e4f7273 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:18.361989 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2572213f-f92f-42fe-abd8-42b23e4f7273 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:18.434808 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b58212d-adf0-43d7-a98c-d777d4728775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:18.435541 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b58212d-adf0-43d7-a98c-d777d4728775 admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:18.436370 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b58212d-adf0-43d7-a98c-d777d4728775 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:18.436658 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b58212d-adf0-43d7-a98c-d777d4728775 admin admin] PATH_INFO: `/v3/users` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:18.437380 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b58212d-adf0-43d7-a98c-d777d4728775 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:18.439378 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b58212d-adf0-43d7-a98c-d777d4728775 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:18.459661 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 897/1808] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 14 09:38:18 2022] POST /identity/v3/users => generated 303 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:38:18.463966 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b87a46-5696-49b2-95e9-9a2fe77efe2d admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:18.474592 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b87a46-5696-49b2-95e9-9a2fe77efe2d admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:18.479481 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8b74df-cb83-45cd-ba34-cf253212c417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:18.480210 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8b74df-cb83-45cd-ba34-cf253212c417 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:18.480441 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8b74df-cb83-45cd-ba34-cf253212c417 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:18.480724 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8b74df-cb83-45cd-ba34-cf253212c417 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:18.481458 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8b74df-cb83-45cd-ba34-cf253212c417 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:18.483682 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8b74df-cb83-45cd-ba34-cf253212c417 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:18.507477 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 912/1809] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 09:38:18 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:38:18.511433 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b58212d-adf0-43d7-a98c-d777d4728775 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:18.525276 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b58212d-adf0-43d7-a98c-d777d4728775 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:18.532739 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99033e3-f7d2-450e-96d3-68d0ea7526e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:18.533731 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99033e3-f7d2-450e-96d3-68d0ea7526e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:18.534018 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99033e3-f7d2-450e-96d3-68d0ea7526e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:18.534345 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99033e3-f7d2-450e-96d3-68d0ea7526e4 admin admin] PATH_INFO: `/v3/projects/a4e8ee4cf62a44b48172988468ab30d4/users/e35ee2996a224e759908592ffb0d305a/roles/e3965bd0d5f1427a86a313c0c90bfef3` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:18.560466 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99033e3-f7d2-450e-96d3-68d0ea7526e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4e8ee4cf62a44b48172988468ab30d4, user_id=e35ee2996a224e759908592ffb0d305a, role_id=e3965bd0d5f1427a86a313c0c90bfef3)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:18.564165 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99033e3-f7d2-450e-96d3-68d0ea7526e4 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:18.585820 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 898/1810] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 14 09:38:18 2022] PUT /identity/v3/projects/a4e8ee4cf62a44b48172988468ab30d4/users/e35ee2996a224e759908592ffb0d305a/roles/e3965bd0d5f1427a86a313c0c90bfef3 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:38:18.590308 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8b74df-cb83-45cd-ba34-cf253212c417 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:18.612993 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8b74df-cb83-45cd-ba34-cf253212c417 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:18.694975 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8960dfd-4118-46ae-b109-0f70e3a295ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:18.695732 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8960dfd-4118-46ae-b109-0f70e3a295ce admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:18.696030 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8960dfd-4118-46ae-b109-0f70e3a295ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:18.697021 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8960dfd-4118-46ae-b109-0f70e3a295ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:18.697476 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8960dfd-4118-46ae-b109-0f70e3a295ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:18.699977 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8960dfd-4118-46ae-b109-0f70e3a295ce admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:18.715697 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 913/1811] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 09:38:18 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:38:18.720669 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99033e3-f7d2-450e-96d3-68d0ea7526e4 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:18.734596 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99033e3-f7d2-450e-96d3-68d0ea7526e4 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:18.739739 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195e42c1-89d3-443b-b1f9-82b66c7e8a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:18.740793 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195e42c1-89d3-443b-b1f9-82b66c7e8a45 admin admin] REQUEST_METHOD: `PUT` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:18.741087 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195e42c1-89d3-443b-b1f9-82b66c7e8a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:18.741422 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195e42c1-89d3-443b-b1f9-82b66c7e8a45 admin admin] PATH_INFO: `/v3/projects/a4e8ee4cf62a44b48172988468ab30d4/users/e35ee2996a224e759908592ffb0d305a/roles/e3965bd0d5f1427a86a313c0c90bfef3` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:18.744004 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195e42c1-89d3-443b-b1f9-82b66c7e8a45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4e8ee4cf62a44b48172988468ab30d4, user_id=e35ee2996a224e759908592ffb0d305a, role_id=e3965bd0d5f1427a86a313c0c90bfef3)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:18.748451 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195e42c1-89d3-443b-b1f9-82b66c7e8a45 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:18.759674 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:38:18.766430 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 899/1812] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 14 09:38:18 2022] PUT /identity/v3/projects/a4e8ee4cf62a44b48172988468ab30d4/users/e35ee2996a224e759908592ffb0d305a/roles/e3965bd0d5f1427a86a313c0c90bfef3 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:38:18.784084 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf093b4-745e-43b6-b6c6-5387ac1f1624 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:18.785156 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf093b4-745e-43b6-b6c6-5387ac1f1624 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:18.785641 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf093b4-745e-43b6-b6c6-5387ac1f1624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:18.837053 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-7bf093b4-745e-43b6-b6c6-5387ac1f1624 None None] MFA Rules not processed for user `e35ee2996a224e759908592ffb0d305a`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:38:18.838689 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-7bf093b4-745e-43b6-b6c6-5387ac1f1624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:18.985945 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 914/1813] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:38:18 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:38:18.997725 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195e42c1-89d3-443b-b1f9-82b66c7e8a45 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:19.000482 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-195e42c1-89d3-443b-b1f9-82b66c7e8a45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:19.135754 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195e42c1-89d3-443b-b1f9-82b66c7e8a45 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:19.141961 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d1e5b2-f320-4ad9-8544-0f459639d9d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25048b29787d482783ebc944f1a7df65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:19.142837 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d1e5b2-f320-4ad9-8544-0f459639d9d8 service cinder] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:19.143222 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d1e5b2-f320-4ad9-8544-0f459639d9d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:19.144602 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d1e5b2-f320-4ad9-8544-0f459639d9d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:19.187895 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d1e5b2-f320-4ad9-8544-0f459639d9d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:19.188661 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf093b4-745e-43b6-b6c6-5387ac1f1624 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:19.189872 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d1e5b2-f320-4ad9-8544-0f459639d9d8 service cinder] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:19.190311 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-7bf093b4-745e-43b6-b6c6-5387ac1f1624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:19.203217 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 900/1814] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:38:18 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:38:19.289098 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:38:19.293698 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d1e5b2-f320-4ad9-8544-0f459639d9d8 service cinder] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:19.295882 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-01d1e5b2-f320-4ad9-8544-0f459639d9d8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:19.297310 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf093b4-745e-43b6-b6c6-5387ac1f1624 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:19.304078 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fbcd47-ed28-4e89-8f62-373b24aef793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:19.305682 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fbcd47-ed28-4e89-8f62-373b24aef793 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:19.306155 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fbcd47-ed28-4e89-8f62-373b24aef793 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:19.306711 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fbcd47-ed28-4e89-8f62-373b24aef793 admin admin] PATH_INFO: `/v3/users/bf275fc1ec8440bba63681b548f159fe` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:19.308318 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fbcd47-ed28-4e89-8f62-373b24aef793 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf275fc1ec8440bba63681b548f159fe)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:19.311242 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fbcd47-ed28-4e89-8f62-373b24aef793 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:19.319428 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d1e5b2-f320-4ad9-8544-0f459639d9d8 service cinder] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:19.326117 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5974591-efe6-43de-8921-3dd9c994737e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25048b29787d482783ebc944f1a7df65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:19.327058 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5974591-efe6-43de-8921-3dd9c994737e service cinder] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:19.327417 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5974591-efe6-43de-8921-3dd9c994737e service cinder] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:19.327774 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5974591-efe6-43de-8921-3dd9c994737e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:19.402400 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5974591-efe6-43de-8921-3dd9c994737e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:19.404326 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5974591-efe6-43de-8921-3dd9c994737e service cinder] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:19.416127 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 901/1815] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:38:19 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 09:38:19.427212 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-c6fbcd47-ed28-4e89-8f62-373b24aef793 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf275fc1ec8440bba63681b548f159fe'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:19.455552 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-c6fbcd47-ed28-4e89-8f62-373b24aef793 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf275fc1ec8440bba63681b548f159fe'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:19.456332 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-c6fbcd47-ed28-4e89-8f62-373b24aef793 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf275fc1ec8440bba63681b548f159fe'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:19.465211 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-c6fbcd47-ed28-4e89-8f62-373b24aef793 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf275fc1ec8440bba63681b548f159fe'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:19.477228 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-c6fbcd47-ed28-4e89-8f62-373b24aef793 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf275fc1ec8440bba63681b548f159fe'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:19.502909 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 915/1816] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 14 09:38:19 2022] DELETE /identity/v3/users/bf275fc1ec8440bba63681b548f159fe => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 09:38:19.507234 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f37740-0397-49a4-ac4f-e9a31de72e3a None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:19.507551 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f37740-0397-49a4-ac4f-e9a31de72e3a None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:19.507827 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f37740-0397-49a4-ac4f-e9a31de72e3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:19.540449 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-36f37740-0397-49a4-ac4f-e9a31de72e3a None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:38:19.541750 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-36f37740-0397-49a4-ac4f-e9a31de72e3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:19.672695 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 902/1817] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:38:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 09:38:19.687568 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fbcd47-ed28-4e89-8f62-373b24aef793 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:19.689488 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-c6fbcd47-ed28-4e89-8f62-373b24aef793 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:19.846092 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fbcd47-ed28-4e89-8f62-373b24aef793 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:19.862806 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e01f1d-57c0-4cd2-85b1-9f2004b6f8ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e4a5a8965e4802a9055d332179b7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:19.863917 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e01f1d-57c0-4cd2-85b1-9f2004b6f8ec service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:19.864219 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e01f1d-57c0-4cd2-85b1-9f2004b6f8ec service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:19.864585 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e01f1d-57c0-4cd2-85b1-9f2004b6f8ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:19.876769 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e01f1d-57c0-4cd2-85b1-9f2004b6f8ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:19.878595 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e01f1d-57c0-4cd2-85b1-9f2004b6f8ec service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:19.898706 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 916/1818] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:38:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 09:38:20.361551 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f37740-0397-49a4-ac4f-e9a31de72e3a None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:20.363233 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-36f37740-0397-49a4-ac4f-e9a31de72e3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:20.376179 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f37740-0397-49a4-ac4f-e9a31de72e3a None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:20.380893 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624dac50-7b1c-42af-95d1-a737ff65c5f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:20.381817 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624dac50-7b1c-42af-95d1-a737ff65c5f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:20.382159 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624dac50-7b1c-42af-95d1-a737ff65c5f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:20.382484 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624dac50-7b1c-42af-95d1-a737ff65c5f7 admin admin] PATH_INFO: `/v3/projects/e93b54fa3c984ebda354d3d6b872b083` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:20.383932 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624dac50-7b1c-42af-95d1-a737ff65c5f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e93b54fa3c984ebda354d3d6b872b083)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:20.385860 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624dac50-7b1c-42af-95d1-a737ff65c5f7 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:20.427321 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:38:20.438088 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-624dac50-7b1c-42af-95d1-a737ff65c5f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e93b54fa3c984ebda354d3d6b872b083', 'request_id': 'req-624dac50-7b1c-42af-95d1-a737ff65c5f7'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:20.447539 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-624dac50-7b1c-42af-95d1-a737ff65c5f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e93b54fa3c984ebda354d3d6b872b083', 'request_id': 'req-624dac50-7b1c-42af-95d1-a737ff65c5f7'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:20.456889 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-624dac50-7b1c-42af-95d1-a737ff65c5f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e93b54fa3c984ebda354d3d6b872b083', 'request_id': 'req-624dac50-7b1c-42af-95d1-a737ff65c5f7'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:20.468671 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-624dac50-7b1c-42af-95d1-a737ff65c5f7 admin admin] The token cache is being invalidate because project e93b54fa3c984ebda354d3d6b872b083 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 09:38:20.468973 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-624dac50-7b1c-42af-95d1-a737ff65c5f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:20.469937 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-624dac50-7b1c-42af-95d1-a737ff65c5f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:20.471538 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 903/1819] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 14 09:38:20 2022] DELETE /identity/v3/projects/e93b54fa3c984ebda354d3d6b872b083 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:38:20.477003 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c6f00d-992f-4d62-82ab-c7512ae62042 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:20.477529 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c6f00d-992f-4d62-82ab-c7512ae62042 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:20.477623 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c6f00d-992f-4d62-82ab-c7512ae62042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:20.496823 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-35c6f00d-992f-4d62-82ab-c7512ae62042 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:38:20.498631 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-35c6f00d-992f-4d62-82ab-c7512ae62042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:20.572607 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 917/1820] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:38:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:38:20.581206 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aaf43c-ff40-4c67-8054-2bf7ce20e81b None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:20.581496 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aaf43c-ff40-4c67-8054-2bf7ce20e81b None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:20.581778 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aaf43c-ff40-4c67-8054-2bf7ce20e81b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:20.601398 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-89aaf43c-ff40-4c67-8054-2bf7ce20e81b None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:38:20.602643 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-89aaf43c-ff40-4c67-8054-2bf7ce20e81b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:20.610469 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 904/1821] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:38:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:38:20.614953 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c6f00d-992f-4d62-82ab-c7512ae62042 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:20.625147 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c6f00d-992f-4d62-82ab-c7512ae62042 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:20.629738 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a297b711-85ee-4a59-bdce-b2d3789d39ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:20.630435 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a297b711-85ee-4a59-bdce-b2d3789d39ab admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:20.630725 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a297b711-85ee-4a59-bdce-b2d3789d39ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:20.631004 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a297b711-85ee-4a59-bdce-b2d3789d39ab admin admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:20.631748 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a297b711-85ee-4a59-bdce-b2d3789d39ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:38:20.632059 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a297b711-85ee-4a59-bdce-b2d3789d39ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:20.633825 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a297b711-85ee-4a59-bdce-b2d3789d39ab admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:20.648158 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 918/1822] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jul 14 09:38:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:38:20.651464 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aaf43c-ff40-4c67-8054-2bf7ce20e81b None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:20.661028 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aaf43c-ff40-4c67-8054-2bf7ce20e81b None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:20.666066 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7ddbc9-651e-491a-8819-a3e36d1b7376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:20.666781 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7ddbc9-651e-491a-8819-a3e36d1b7376 admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:20.667064 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7ddbc9-651e-491a-8819-a3e36d1b7376 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:20.667343 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7ddbc9-651e-491a-8819-a3e36d1b7376 admin admin] PATH_INFO: `/v3/projects` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:20.668059 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7ddbc9-651e-491a-8819-a3e36d1b7376 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:20.670523 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7ddbc9-651e-491a-8819-a3e36d1b7376 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:20.698348 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 905/1823] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 14 09:38:20 2022] POST /identity/v3/projects => generated 365 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 09:38:20.702830 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a297b711-85ee-4a59-bdce-b2d3789d39ab admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:20.709500 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:38:20.716193 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a297b711-85ee-4a59-bdce-b2d3789d39ab admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:20.792385 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f9119c-0303-4a54-a625-be0afa7a307c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:20.793072 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f9119c-0303-4a54-a625-be0afa7a307c admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:20.793358 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f9119c-0303-4a54-a625-be0afa7a307c admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:20.793631 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f9119c-0303-4a54-a625-be0afa7a307c admin admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:20.794379 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f9119c-0303-4a54-a625-be0afa7a307c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:20.796882 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f9119c-0303-4a54-a625-be0afa7a307c admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:20.823759 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 919/1824] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 14 09:38:20 2022] POST /identity/v3/users => generated 283 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:38:20.827703 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7ddbc9-651e-491a-8819-a3e36d1b7376 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:20.845401 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7ddbc9-651e-491a-8819-a3e36d1b7376 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:20.851718 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a439433-04b4-4f11-9c6f-1a7bd54ad88f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:20.853585 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a439433-04b4-4f11-9c6f-1a7bd54ad88f admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:20.854273 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a439433-04b4-4f11-9c6f-1a7bd54ad88f admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:20.855499 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a439433-04b4-4f11-9c6f-1a7bd54ad88f admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:20.856742 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a439433-04b4-4f11-9c6f-1a7bd54ad88f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:20.860967 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a439433-04b4-4f11-9c6f-1a7bd54ad88f admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:20.876646 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 906/1825] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 09:38:20 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:38:20.880622 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f9119c-0303-4a54-a625-be0afa7a307c admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:20.893841 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f9119c-0303-4a54-a625-be0afa7a307c admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:20.899737 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76eb276a-2e94-4fef-be48-532f72a8df29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:20.900853 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eb276a-2e94-4fef-be48-532f72a8df29 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:20.900986 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eb276a-2e94-4fef-be48-532f72a8df29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:20.901267 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eb276a-2e94-4fef-be48-532f72a8df29 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:20.902104 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76eb276a-2e94-4fef-be48-532f72a8df29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:20.903881 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76eb276a-2e94-4fef-be48-532f72a8df29 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:20.918902 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 920/1826] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 09:38:20 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:38:20.923524 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a439433-04b4-4f11-9c6f-1a7bd54ad88f admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:20.935158 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a439433-04b4-4f11-9c6f-1a7bd54ad88f admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:20.948570 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13673a8f-a03e-449f-acda-ee58bd4d51ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:20.949407 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13673a8f-a03e-449f-acda-ee58bd4d51ff admin admin] REQUEST_METHOD: `PUT` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:20.949693 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13673a8f-a03e-449f-acda-ee58bd4d51ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:20.949973 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13673a8f-a03e-449f-acda-ee58bd4d51ff admin admin] PATH_INFO: `/v3/projects/3fde1cfe28574b5788abeb74736fcf84/users/a48a98b718f44f6f9f6ba5d61885802d/roles/17dfac38a2e540fea229af7de99911bb` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:20.991400 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13673a8f-a03e-449f-acda-ee58bd4d51ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fde1cfe28574b5788abeb74736fcf84, user_id=a48a98b718f44f6f9f6ba5d61885802d, role_id=17dfac38a2e540fea229af7de99911bb)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:20.994139 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13673a8f-a03e-449f-acda-ee58bd4d51ff admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:21.012455 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 907/1827] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 14 09:38:20 2022] PUT /identity/v3/projects/3fde1cfe28574b5788abeb74736fcf84/users/a48a98b718f44f6f9f6ba5d61885802d/roles/17dfac38a2e540fea229af7de99911bb => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 09:38:21.022908 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2808dedf-e5b6-4175-80ad-6f161610bdea None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:21.023146 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2808dedf-e5b6-4175-80ad-6f161610bdea None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:21.023421 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2808dedf-e5b6-4175-80ad-6f161610bdea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:21.063247 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-2808dedf-e5b6-4175-80ad-6f161610bdea None None] MFA Rules not processed for user `a48a98b718f44f6f9f6ba5d61885802d`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:38:21.064489 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-2808dedf-e5b6-4175-80ad-6f161610bdea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:21.191604 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 921/1828] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:38:21 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:38:21.193161 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13673a8f-a03e-449f-acda-ee58bd4d51ff admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:21.317071 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13673a8f-a03e-449f-acda-ee58bd4d51ff admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:21.326517 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251b7045-bcba-48bb-b021-3e487143d220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:21.327232 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251b7045-bcba-48bb-b021-3e487143d220 admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:21.327635 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251b7045-bcba-48bb-b021-3e487143d220 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:21.327942 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251b7045-bcba-48bb-b021-3e487143d220 admin admin] PATH_INFO: `/v3/projects` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:21.328699 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251b7045-bcba-48bb-b021-3e487143d220 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:21.332722 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251b7045-bcba-48bb-b021-3e487143d220 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:21.390330 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 908/1829] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 14 09:38:21 2022] POST /identity/v3/projects => generated 365 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:38:21.391610 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2808dedf-e5b6-4175-80ad-6f161610bdea None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:21.407259 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2808dedf-e5b6-4175-80ad-6f161610bdea None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:21.485445 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de41ce9-f8d6-4e02-8f48-da92de2bc5e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:21.486139 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de41ce9-f8d6-4e02-8f48-da92de2bc5e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:21.487476 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de41ce9-f8d6-4e02-8f48-da92de2bc5e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:21.487760 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de41ce9-f8d6-4e02-8f48-da92de2bc5e9 admin admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:21.488479 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de41ce9-f8d6-4e02-8f48-da92de2bc5e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:21.490581 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de41ce9-f8d6-4e02-8f48-da92de2bc5e9 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:21.512674 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 922/1830] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 14 09:38:21 2022] POST /identity/v3/users => generated 289 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 09:38:21.517004 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251b7045-bcba-48bb-b021-3e487143d220 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:21.533784 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251b7045-bcba-48bb-b021-3e487143d220 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:21.539725 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb14795-4593-4de7-a056-462061315e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:21.540420 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb14795-4593-4de7-a056-462061315e43 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:21.540693 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb14795-4593-4de7-a056-462061315e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:21.540972 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb14795-4593-4de7-a056-462061315e43 admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:21.541711 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb14795-4593-4de7-a056-462061315e43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:21.543348 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb14795-4593-4de7-a056-462061315e43 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:21.555647 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 909/1831] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 09:38:21 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:38:21.563150 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de41ce9-f8d6-4e02-8f48-da92de2bc5e9 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:21.568818 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:38:21.577047 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de41ce9-f8d6-4e02-8f48-da92de2bc5e9 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:21.581986 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa7f249-7a29-4d8c-83d7-72cae9d8be27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:21.582929 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa7f249-7a29-4d8c-83d7-72cae9d8be27 admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:21.583217 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa7f249-7a29-4d8c-83d7-72cae9d8be27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:21.583496 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa7f249-7a29-4d8c-83d7-72cae9d8be27 admin admin] PATH_INFO: `/v3/projects/a858e2435966412f8f9bf2c16355d8bb/users/43f28625bf764f608d0faba5c5f7dcbf/roles/e3965bd0d5f1427a86a313c0c90bfef3` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:21.599606 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa7f249-7a29-4d8c-83d7-72cae9d8be27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a858e2435966412f8f9bf2c16355d8bb, user_id=43f28625bf764f608d0faba5c5f7dcbf, role_id=e3965bd0d5f1427a86a313c0c90bfef3)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:21.602302 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa7f249-7a29-4d8c-83d7-72cae9d8be27 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:21.616737 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 923/1832] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 14 09:38:21 2022] PUT /identity/v3/projects/a858e2435966412f8f9bf2c16355d8bb/users/43f28625bf764f608d0faba5c5f7dcbf/roles/e3965bd0d5f1427a86a313c0c90bfef3 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 09:38:21.620855 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb14795-4593-4de7-a056-462061315e43 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:21.631852 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb14795-4593-4de7-a056-462061315e43 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:21.666852 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:38:21.691773 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd8cf24-f9f8-4b8d-91bc-922f09880149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:21.692449 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd8cf24-f9f8-4b8d-91bc-922f09880149 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:21.692738 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd8cf24-f9f8-4b8d-91bc-922f09880149 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:21.693021 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd8cf24-f9f8-4b8d-91bc-922f09880149 admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:21.693757 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd8cf24-f9f8-4b8d-91bc-922f09880149 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:21.695376 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd8cf24-f9f8-4b8d-91bc-922f09880149 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:21.705403 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 910/1833] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 09:38:21 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:38:21.709548 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa7f249-7a29-4d8c-83d7-72cae9d8be27 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:21.720565 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa7f249-7a29-4d8c-83d7-72cae9d8be27 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:21.725148 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1368aeb-5262-4cb7-8cb2-266b0daafbc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:21.725969 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1368aeb-5262-4cb7-8cb2-266b0daafbc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:21.726288 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1368aeb-5262-4cb7-8cb2-266b0daafbc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:21.726574 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1368aeb-5262-4cb7-8cb2-266b0daafbc1 admin admin] PATH_INFO: `/v3/projects/a858e2435966412f8f9bf2c16355d8bb/users/43f28625bf764f608d0faba5c5f7dcbf/roles/e3965bd0d5f1427a86a313c0c90bfef3` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:21.728582 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1368aeb-5262-4cb7-8cb2-266b0daafbc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a858e2435966412f8f9bf2c16355d8bb, user_id=43f28625bf764f608d0faba5c5f7dcbf, role_id=e3965bd0d5f1427a86a313c0c90bfef3)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:21.731274 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1368aeb-5262-4cb7-8cb2-266b0daafbc1 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:21.741516 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 924/1834] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 14 09:38:21 2022] PUT /identity/v3/projects/a858e2435966412f8f9bf2c16355d8bb/users/43f28625bf764f608d0faba5c5f7dcbf/roles/e3965bd0d5f1427a86a313c0c90bfef3 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:38:21.752675 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db87221-42b7-4c30-b059-020e5b9ba279 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:21.752971 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db87221-42b7-4c30-b059-020e5b9ba279 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:21.753256 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db87221-42b7-4c30-b059-020e5b9ba279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:21.781898 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-5db87221-42b7-4c30-b059-020e5b9ba279 None None] MFA Rules not processed for user `43f28625bf764f608d0faba5c5f7dcbf`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:38:21.783153 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-5db87221-42b7-4c30-b059-020e5b9ba279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:21.851580 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 911/1835] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:38:21 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:38:21.863628 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1368aeb-5262-4cb7-8cb2-266b0daafbc1 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:21.865288 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-f1368aeb-5262-4cb7-8cb2-266b0daafbc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:21.924232 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1368aeb-5262-4cb7-8cb2-266b0daafbc1 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:21.930907 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7f5b09-69c8-4886-b11b-013dcc39e763 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25048b29787d482783ebc944f1a7df65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:21.931603 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7f5b09-69c8-4886-b11b-013dcc39e763 service cinder] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:21.931890 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7f5b09-69c8-4886-b11b-013dcc39e763 service cinder] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:21.932221 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7f5b09-69c8-4886-b11b-013dcc39e763 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:21.942064 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7f5b09-69c8-4886-b11b-013dcc39e763 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:21.943527 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7f5b09-69c8-4886-b11b-013dcc39e763 service cinder] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:21.953576 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 925/1836] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:38:21 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:38:22.024380 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db87221-42b7-4c30-b059-020e5b9ba279 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:22.034417 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db87221-42b7-4c30-b059-020e5b9ba279 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:22.038530 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aad53e-76e5-4573-ae67-8afe64d0bbaa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25048b29787d482783ebc944f1a7df65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:22.039306 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aad53e-76e5-4573-ae67-8afe64d0bbaa service cinder] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:22.039602 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aad53e-76e5-4573-ae67-8afe64d0bbaa service cinder] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:22.039899 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aad53e-76e5-4573-ae67-8afe64d0bbaa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:22.100620 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72aad53e-76e5-4573-ae67-8afe64d0bbaa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:22.102061 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72aad53e-76e5-4573-ae67-8afe64d0bbaa service cinder] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:22.111113 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 912/1837] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:38:22 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:38:28.097804 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99d51ee-0f6b-44f8-b0a8-e0e11ca371da None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:28.098474 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99d51ee-0f6b-44f8-b0a8-e0e11ca371da None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:28.098474 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99d51ee-0f6b-44f8-b0a8-e0e11ca371da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:28.117946 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-d99d51ee-0f6b-44f8-b0a8-e0e11ca371da None None] MFA Rules not processed for user `65e4a5a8965e4802a9055d332179b7a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:38:28.119539 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-d99d51ee-0f6b-44f8-b0a8-e0e11ca371da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:28.181012 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 926/1838] 10.222.0.49 () {58 vars in 1015 bytes} [Thu Jul 14 09:38:28 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:38:28.456831 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aad53e-76e5-4573-ae67-8afe64d0bbaa service cinder] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:28.458274 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-72aad53e-76e5-4573-ae67-8afe64d0bbaa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:28.460717 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99d51ee-0f6b-44f8-b0a8-e0e11ca371da None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:28.463401 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-d99d51ee-0f6b-44f8-b0a8-e0e11ca371da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:28.476785 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99d51ee-0f6b-44f8-b0a8-e0e11ca371da None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:28.481027 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee341946-f72a-4c87-acfa-5841793a0650 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e4a5a8965e4802a9055d332179b7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:28.482057 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee341946-f72a-4c87-acfa-5841793a0650 service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:28.482495 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee341946-f72a-4c87-acfa-5841793a0650 service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:28.482927 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee341946-f72a-4c87-acfa-5841793a0650 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:28.483588 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aad53e-76e5-4573-ae67-8afe64d0bbaa service cinder] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:28.487944 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07df5270-afda-448f-8736-c411f1a4652d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e4a5a8965e4802a9055d332179b7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:28.488618 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07df5270-afda-448f-8736-c411f1a4652d service neutron] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:28.488915 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07df5270-afda-448f-8736-c411f1a4652d service neutron] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:28.489260 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07df5270-afda-448f-8736-c411f1a4652d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:28.495707 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee341946-f72a-4c87-acfa-5841793a0650 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:28.498419 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07df5270-afda-448f-8736-c411f1a4652d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:28.500060 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07df5270-afda-448f-8736-c411f1a4652d service neutron] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:28.510467 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 913/1839] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:38:28 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:38:28.513962 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee341946-f72a-4c87-acfa-5841793a0650 service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:28.537531 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 927/1840] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:38:28 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 09:38:30.001045 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7c73e9-62b2-4b41-b892-e8c864174b9a None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:30.001620 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7c73e9-62b2-4b41-b892-e8c864174b9a None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:30.001740 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7c73e9-62b2-4b41-b892-e8c864174b9a None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:30.004838 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 914/1841] 10.222.0.40 () {54 vars in 921 bytes} [Thu Jul 14 09:38:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:38:30.042069 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1012f3-de94-4df6-aa35-fefc90e5ee66 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:30.042658 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1012f3-de94-4df6-aa35-fefc90e5ee66 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:30.043245 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1012f3-de94-4df6-aa35-fefc90e5ee66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:30.072157 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-aa1012f3-de94-4df6-aa35-fefc90e5ee66 None None] MFA Rules not processed for user `1f6962106dfa4c4c9af551053f8095e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:38:30.073852 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-aa1012f3-de94-4df6-aa35-fefc90e5ee66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:30.220141 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:38:30.266159 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 928/1842] 10.222.0.40 () {58 vars in 1018 bytes} [Thu Jul 14 09:38:30 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:38:30.437394 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7c73e9-62b2-4b41-b892-e8c864174b9a None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:30.439192 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-bf7c73e9-62b2-4b41-b892-e8c864174b9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:30.458053 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7c73e9-62b2-4b41-b892-e8c864174b9a None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:30.464254 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acdb3bb-961a-4296-a641-25605e94c95a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f6962106dfa4c4c9af551053f8095e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:30.464926 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acdb3bb-961a-4296-a641-25605e94c95a service nova] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:30.465222 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acdb3bb-961a-4296-a641-25605e94c95a service nova] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:30.465498 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acdb3bb-961a-4296-a641-25605e94c95a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:30.475725 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acdb3bb-961a-4296-a641-25605e94c95a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:30.477482 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acdb3bb-961a-4296-a641-25605e94c95a service nova] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:30.489637 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 915/1843] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:38:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:38:35.740278 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ee2912-c07f-4f79-ac73-c356add7d6aa None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:35.740868 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ee2912-c07f-4f79-ac73-c356add7d6aa None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:35.740996 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ee2912-c07f-4f79-ac73-c356add7d6aa None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:35.742414 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 929/1844] 10.222.0.40 () {54 vars in 921 bytes} [Thu Jul 14 09:38:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:38:35.770989 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e69bff-181d-4a5a-aded-eb977ef53882 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:35.771951 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e69bff-181d-4a5a-aded-eb977ef53882 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:35.772593 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e69bff-181d-4a5a-aded-eb977ef53882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:35.804928 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-12e69bff-181d-4a5a-aded-eb977ef53882 None None] MFA Rules not processed for user `1f6962106dfa4c4c9af551053f8095e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:38:35.806608 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-12e69bff-181d-4a5a-aded-eb977ef53882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:35.833050 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 916/1845] 10.222.0.40 () {58 vars in 1018 bytes} [Thu Jul 14 09:38:35 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:38:35.853768 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ee2912-c07f-4f79-ac73-c356add7d6aa None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:35.855833 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-58ee2912-c07f-4f79-ac73-c356add7d6aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:35.879138 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ee2912-c07f-4f79-ac73-c356add7d6aa None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:35.891572 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9babd642-9f8e-4ac5-8915-3fef1f69b8f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f6962106dfa4c4c9af551053f8095e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:35.892651 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9babd642-9f8e-4ac5-8915-3fef1f69b8f7 service nova] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:35.892651 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9babd642-9f8e-4ac5-8915-3fef1f69b8f7 service nova] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:35.892908 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9babd642-9f8e-4ac5-8915-3fef1f69b8f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:35.904106 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9babd642-9f8e-4ac5-8915-3fef1f69b8f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:35.905718 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9babd642-9f8e-4ac5-8915-3fef1f69b8f7 service nova] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:35.925132 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 930/1846] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:38:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 09:38:39.396120 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e69bff-181d-4a5a-aded-eb977ef53882 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:39.398823 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-12e69bff-181d-4a5a-aded-eb977ef53882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:39.493781 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:38:39.565234 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9babd642-9f8e-4ac5-8915-3fef1f69b8f7 service nova] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:39.567337 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-9babd642-9f8e-4ac5-8915-3fef1f69b8f7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:39.619897 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e69bff-181d-4a5a-aded-eb977ef53882 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:39.633542 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4c7e28-8c11-4b9f-8172-70525285210f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:39.635508 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4c7e28-8c11-4b9f-8172-70525285210f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:39.636234 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4c7e28-8c11-4b9f-8172-70525285210f admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:39.637014 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4c7e28-8c11-4b9f-8172-70525285210f admin admin] PATH_INFO: `/v3/users/a65edfbc56e2478fa9441c7ef43f7cc7` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:39.647154 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4c7e28-8c11-4b9f-8172-70525285210f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a65edfbc56e2478fa9441c7ef43f7cc7)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:39.649999 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4c7e28-8c11-4b9f-8172-70525285210f admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:39.676432 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9babd642-9f8e-4ac5-8915-3fef1f69b8f7 service nova] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:39.681637 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0113babd-8879-4983-9420-7c05e4a775b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:39.683725 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0113babd-8879-4983-9420-7c05e4a775b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:39.685541 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0113babd-8879-4983-9420-7c05e4a775b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:39.685904 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0113babd-8879-4983-9420-7c05e4a775b9 admin admin] PATH_INFO: `/v3/users/19e095b67d0e43fcaa11da4749b0bf80` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:39.687689 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0113babd-8879-4983-9420-7c05e4a775b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=19e095b67d0e43fcaa11da4749b0bf80)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:39.690001 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0113babd-8879-4983-9420-7c05e4a775b9 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:39.728956 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-4f4c7e28-8c11-4b9f-8172-70525285210f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a65edfbc56e2478fa9441c7ef43f7cc7'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:39.750435 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-4f4c7e28-8c11-4b9f-8172-70525285210f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a65edfbc56e2478fa9441c7ef43f7cc7'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:39.751628 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-4f4c7e28-8c11-4b9f-8172-70525285210f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a65edfbc56e2478fa9441c7ef43f7cc7'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:39.762307 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-4f4c7e28-8c11-4b9f-8172-70525285210f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a65edfbc56e2478fa9441c7ef43f7cc7'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:39.763751 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-4f4c7e28-8c11-4b9f-8172-70525285210f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a65edfbc56e2478fa9441c7ef43f7cc7'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:39.768562 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-0113babd-8879-4983-9420-7c05e4a775b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19e095b67d0e43fcaa11da4749b0bf80'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:39.786837 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-0113babd-8879-4983-9420-7c05e4a775b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19e095b67d0e43fcaa11da4749b0bf80'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:39.787851 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-0113babd-8879-4983-9420-7c05e4a775b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19e095b67d0e43fcaa11da4749b0bf80'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:39.803954 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 917/1847] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 14 09:38:39 2022] DELETE /identity/v3/users/a65edfbc56e2478fa9441c7ef43f7cc7 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:38:39.806766 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f988514d-c3ed-491d-b878-a05f50940e52 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:39.807259 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f988514d-c3ed-491d-b878-a05f50940e52 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:39.812032 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f988514d-c3ed-491d-b878-a05f50940e52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:39.824394 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-0113babd-8879-4983-9420-7c05e4a775b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19e095b67d0e43fcaa11da4749b0bf80'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:39.836857 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-0113babd-8879-4983-9420-7c05e4a775b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19e095b67d0e43fcaa11da4749b0bf80'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:39.850560 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-f988514d-c3ed-491d-b878-a05f50940e52 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:38:39.852710 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-f988514d-c3ed-491d-b878-a05f50940e52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:39.855661 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 931/1848] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 14 09:38:39 2022] DELETE /identity/v3/users/19e095b67d0e43fcaa11da4749b0bf80 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 09:38:39.860160 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ee71f9-a7d8-4dfe-bffb-5a4f5a037414 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:39.860365 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ee71f9-a7d8-4dfe-bffb-5a4f5a037414 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:39.860666 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ee71f9-a7d8-4dfe-bffb-5a4f5a037414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:39.895141 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-80ee71f9-a7d8-4dfe-bffb-5a4f5a037414 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:38:39.896624 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-80ee71f9-a7d8-4dfe-bffb-5a4f5a037414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:40.007120 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 918/1849] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:38:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:38:40.025743 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f988514d-c3ed-491d-b878-a05f50940e52 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:40.028907 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-f988514d-c3ed-491d-b878-a05f50940e52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:40.072651 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 932/1850] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:38:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:38:40.080848 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ee71f9-a7d8-4dfe-bffb-5a4f5a037414 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:40.082281 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-80ee71f9-a7d8-4dfe-bffb-5a4f5a037414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:40.087550 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:38:40.136091 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:38:40.169876 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f988514d-c3ed-491d-b878-a05f50940e52 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:40.188291 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fda28cc-2c8f-402c-b12f-ce114ed8414b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e4a5a8965e4802a9055d332179b7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:40.189255 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fda28cc-2c8f-402c-b12f-ce114ed8414b service neutron] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:40.189615 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fda28cc-2c8f-402c-b12f-ce114ed8414b service neutron] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:40.189850 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fda28cc-2c8f-402c-b12f-ce114ed8414b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:40.203310 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fda28cc-2c8f-402c-b12f-ce114ed8414b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:40.206291 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fda28cc-2c8f-402c-b12f-ce114ed8414b service neutron] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:40.217860 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ee71f9-a7d8-4dfe-bffb-5a4f5a037414 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:40.221468 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 919/1851] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:38:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:38:40.226235 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20ef803-93fd-4165-89e7-49472dff5eb6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e4a5a8965e4802a9055d332179b7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:40.227217 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20ef803-93fd-4165-89e7-49472dff5eb6 service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:40.227514 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20ef803-93fd-4165-89e7-49472dff5eb6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:40.227861 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20ef803-93fd-4165-89e7-49472dff5eb6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:40.252901 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20ef803-93fd-4165-89e7-49472dff5eb6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:40.257601 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20ef803-93fd-4165-89e7-49472dff5eb6 service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:40.288112 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 933/1852] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:38:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:38:40.806315 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fda28cc-2c8f-402c-b12f-ce114ed8414b service neutron] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:40.808742 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-4fda28cc-2c8f-402c-b12f-ce114ed8414b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:40.847805 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fda28cc-2c8f-402c-b12f-ce114ed8414b service neutron] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:40.856150 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20ef803-93fd-4165-89e7-49472dff5eb6 service neutron] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:40.858224 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-f20ef803-93fd-4165-89e7-49472dff5eb6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:40.860753 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a78b25a-5133-4132-8023-8d40d7788597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:40.861860 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a78b25a-5133-4132-8023-8d40d7788597 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:40.862312 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a78b25a-5133-4132-8023-8d40d7788597 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:40.862967 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a78b25a-5133-4132-8023-8d40d7788597 admin admin] PATH_INFO: `/v3/projects/79edec4f0e884188bf8e7bf379b6e457` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:40.864605 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a78b25a-5133-4132-8023-8d40d7788597 admin admin] RBAC: Authorizing `identity:delete_project(project_id=79edec4f0e884188bf8e7bf379b6e457)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:40.866859 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a78b25a-5133-4132-8023-8d40d7788597 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:40.894703 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20ef803-93fd-4165-89e7-49472dff5eb6 service neutron] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:40.916892 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5601700a-689a-44e9-b464-59999e6d9e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:40.918253 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5601700a-689a-44e9-b464-59999e6d9e2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:40.918551 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5601700a-689a-44e9-b464-59999e6d9e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:40.920538 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5601700a-689a-44e9-b464-59999e6d9e2b admin admin] PATH_INFO: `/v3/projects/6a9c30f05e784f61b95c80c5ae7de32e` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:40.922402 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5601700a-689a-44e9-b464-59999e6d9e2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a9c30f05e784f61b95c80c5ae7de32e)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:40.924650 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5601700a-689a-44e9-b464-59999e6d9e2b admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:40.993175 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-5a78b25a-5133-4132-8023-8d40d7788597 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79edec4f0e884188bf8e7bf379b6e457', 'request_id': 'req-5a78b25a-5133-4132-8023-8d40d7788597'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:41.010069 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-5601700a-689a-44e9-b464-59999e6d9e2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a9c30f05e784f61b95c80c5ae7de32e', 'request_id': 'req-5601700a-689a-44e9-b464-59999e6d9e2b'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:41.021699 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-5601700a-689a-44e9-b464-59999e6d9e2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a9c30f05e784f61b95c80c5ae7de32e', 'request_id': 'req-5601700a-689a-44e9-b464-59999e6d9e2b'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:41.025010 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-5a78b25a-5133-4132-8023-8d40d7788597 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79edec4f0e884188bf8e7bf379b6e457', 'request_id': 'req-5a78b25a-5133-4132-8023-8d40d7788597'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:41.034862 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-5a78b25a-5133-4132-8023-8d40d7788597 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79edec4f0e884188bf8e7bf379b6e457', 'request_id': 'req-5a78b25a-5133-4132-8023-8d40d7788597'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:41.040062 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-5601700a-689a-44e9-b464-59999e6d9e2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a9c30f05e784f61b95c80c5ae7de32e', 'request_id': 'req-5601700a-689a-44e9-b464-59999e6d9e2b'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:41.062994 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-5a78b25a-5133-4132-8023-8d40d7788597 admin admin] The token cache is being invalidate because project 79edec4f0e884188bf8e7bf379b6e457 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 09:38:41.063366 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-5a78b25a-5133-4132-8023-8d40d7788597 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:41.069322 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-5a78b25a-5133-4132-8023-8d40d7788597 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:41.072032 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 920/1853] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 14 09:38:40 2022] DELETE /identity/v3/projects/79edec4f0e884188bf8e7bf379b6e457 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:38:41.082237 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a78b25a-5133-4132-8023-8d40d7788597 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:41.085599 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-5a78b25a-5133-4132-8023-8d40d7788597 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:41.091117 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-5601700a-689a-44e9-b464-59999e6d9e2b admin admin] The token cache is being invalidate because project 6a9c30f05e784f61b95c80c5ae7de32e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 09:38:41.094573 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-5601700a-689a-44e9-b464-59999e6d9e2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:41.095344 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-5601700a-689a-44e9-b464-59999e6d9e2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:41.100292 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 934/1854] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 14 09:38:40 2022] DELETE /identity/v3/projects/6a9c30f05e784f61b95c80c5ae7de32e => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:38:41.103339 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5601700a-689a-44e9-b464-59999e6d9e2b admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:41.108200 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-5601700a-689a-44e9-b464-59999e6d9e2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:41.197334 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a78b25a-5133-4132-8023-8d40d7788597 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:41.256694 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5601700a-689a-44e9-b464-59999e6d9e2b admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:41.261460 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6021d53-21b1-4137-85a2-80f29183291f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:41.263010 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6021d53-21b1-4137-85a2-80f29183291f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:41.263455 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6021d53-21b1-4137-85a2-80f29183291f admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:41.263813 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6021d53-21b1-4137-85a2-80f29183291f admin admin] PATH_INFO: `/v3/users/e35ee2996a224e759908592ffb0d305a` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:41.265285 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6021d53-21b1-4137-85a2-80f29183291f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e35ee2996a224e759908592ffb0d305a)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:41.267415 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6021d53-21b1-4137-85a2-80f29183291f admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:41.292215 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd13c5bf-e2e9-40db-adbe-a7e93359245a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:41.293108 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd13c5bf-e2e9-40db-adbe-a7e93359245a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:41.293469 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd13c5bf-e2e9-40db-adbe-a7e93359245a admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:41.293853 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd13c5bf-e2e9-40db-adbe-a7e93359245a admin admin] PATH_INFO: `/v3/users/0c1dc07a53b845e98a53fe6b9e1706a5` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:41.295212 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd13c5bf-e2e9-40db-adbe-a7e93359245a admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c1dc07a53b845e98a53fe6b9e1706a5)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:41.297241 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd13c5bf-e2e9-40db-adbe-a7e93359245a admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:41.323851 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:38:41.326637 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:38:41.344166 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-e6021d53-21b1-4137-85a2-80f29183291f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e35ee2996a224e759908592ffb0d305a'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:41.378052 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-e6021d53-21b1-4137-85a2-80f29183291f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e35ee2996a224e759908592ffb0d305a'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:41.378815 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-e6021d53-21b1-4137-85a2-80f29183291f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e35ee2996a224e759908592ffb0d305a'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:41.384640 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-dd13c5bf-e2e9-40db-adbe-a7e93359245a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c1dc07a53b845e98a53fe6b9e1706a5'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:41.393490 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-e6021d53-21b1-4137-85a2-80f29183291f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e35ee2996a224e759908592ffb0d305a'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:41.399992 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-dd13c5bf-e2e9-40db-adbe-a7e93359245a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c1dc07a53b845e98a53fe6b9e1706a5'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:41.401381 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-dd13c5bf-e2e9-40db-adbe-a7e93359245a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c1dc07a53b845e98a53fe6b9e1706a5'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:41.411011 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-dd13c5bf-e2e9-40db-adbe-a7e93359245a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c1dc07a53b845e98a53fe6b9e1706a5'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:41.411789 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-dd13c5bf-e2e9-40db-adbe-a7e93359245a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c1dc07a53b845e98a53fe6b9e1706a5'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:41.412205 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-e6021d53-21b1-4137-85a2-80f29183291f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e35ee2996a224e759908592ffb0d305a'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:41.422092 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 935/1855] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 14 09:38:41 2022] DELETE /identity/v3/users/e35ee2996a224e759908592ffb0d305a => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:38:41.453251 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 921/1856] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 14 09:38:41 2022] DELETE /identity/v3/users/0c1dc07a53b845e98a53fe6b9e1706a5 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:38:42.513949 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6021d53-21b1-4137-85a2-80f29183291f admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:42.515458 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-e6021d53-21b1-4137-85a2-80f29183291f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:42.611378 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6021d53-21b1-4137-85a2-80f29183291f admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:42.635975 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd13c5bf-e2e9-40db-adbe-a7e93359245a admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:42.639206 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-dd13c5bf-e2e9-40db-adbe-a7e93359245a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:42.720324 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2357b20e-9e61-4ccc-a1c6-2a3a3b0c38d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:42.721406 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2357b20e-9e61-4ccc-a1c6-2a3a3b0c38d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:42.721862 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2357b20e-9e61-4ccc-a1c6-2a3a3b0c38d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:42.722571 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2357b20e-9e61-4ccc-a1c6-2a3a3b0c38d1 admin admin] PATH_INFO: `/v3/projects/a4e8ee4cf62a44b48172988468ab30d4` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:42.724101 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2357b20e-9e61-4ccc-a1c6-2a3a3b0c38d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4e8ee4cf62a44b48172988468ab30d4)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:42.727145 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2357b20e-9e61-4ccc-a1c6-2a3a3b0c38d1 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:42.784537 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd13c5bf-e2e9-40db-adbe-a7e93359245a admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:42.789854 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0a04a7-898c-42c6-9124-ecfc38bb292e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:42.790945 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0a04a7-898c-42c6-9124-ecfc38bb292e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:42.791235 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0a04a7-898c-42c6-9124-ecfc38bb292e admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:42.791504 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0a04a7-898c-42c6-9124-ecfc38bb292e admin admin] PATH_INFO: `/v3/projects/9355ded790b748e8b2143ff09725007c` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:42.793036 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0a04a7-898c-42c6-9124-ecfc38bb292e admin admin] RBAC: Authorizing `identity:delete_project(project_id=9355ded790b748e8b2143ff09725007c)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:42.795229 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0a04a7-898c-42c6-9124-ecfc38bb292e admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:42.821078 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-2357b20e-9e61-4ccc-a1c6-2a3a3b0c38d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4e8ee4cf62a44b48172988468ab30d4', 'request_id': 'req-2357b20e-9e61-4ccc-a1c6-2a3a3b0c38d1'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:42.830327 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-2357b20e-9e61-4ccc-a1c6-2a3a3b0c38d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4e8ee4cf62a44b48172988468ab30d4', 'request_id': 'req-2357b20e-9e61-4ccc-a1c6-2a3a3b0c38d1'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:42.832605 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:38:42.839364 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-2357b20e-9e61-4ccc-a1c6-2a3a3b0c38d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4e8ee4cf62a44b48172988468ab30d4', 'request_id': 'req-2357b20e-9e61-4ccc-a1c6-2a3a3b0c38d1'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:42.858855 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-2357b20e-9e61-4ccc-a1c6-2a3a3b0c38d1 admin admin] The token cache is being invalidate because project a4e8ee4cf62a44b48172988468ab30d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 09:38:42.859160 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-2357b20e-9e61-4ccc-a1c6-2a3a3b0c38d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:42.859797 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-2357b20e-9e61-4ccc-a1c6-2a3a3b0c38d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:42.861556 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 936/1857] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 14 09:38:42 2022] DELETE /identity/v3/projects/a4e8ee4cf62a44b48172988468ab30d4 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:38:42.862789 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2357b20e-9e61-4ccc-a1c6-2a3a3b0c38d1 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:42.864384 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-2357b20e-9e61-4ccc-a1c6-2a3a3b0c38d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:42.870313 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-6e0a04a7-898c-42c6-9124-ecfc38bb292e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9355ded790b748e8b2143ff09725007c', 'request_id': 'req-6e0a04a7-898c-42c6-9124-ecfc38bb292e'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:42.880795 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-6e0a04a7-898c-42c6-9124-ecfc38bb292e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9355ded790b748e8b2143ff09725007c', 'request_id': 'req-6e0a04a7-898c-42c6-9124-ecfc38bb292e'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:42.888261 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-6e0a04a7-898c-42c6-9124-ecfc38bb292e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9355ded790b748e8b2143ff09725007c', 'request_id': 'req-6e0a04a7-898c-42c6-9124-ecfc38bb292e'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:42.901519 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-6e0a04a7-898c-42c6-9124-ecfc38bb292e admin admin] The token cache is being invalidate because project 9355ded790b748e8b2143ff09725007c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 09:38:42.901822 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-6e0a04a7-898c-42c6-9124-ecfc38bb292e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:42.902526 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-6e0a04a7-898c-42c6-9124-ecfc38bb292e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:42.904375 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 922/1858] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 14 09:38:42 2022] DELETE /identity/v3/projects/9355ded790b748e8b2143ff09725007c => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:38:42.905763 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b14f3d7-5f3a-449c-aa25-305ab2069720 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:42.906054 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b14f3d7-5f3a-449c-aa25-305ab2069720 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:42.906372 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b14f3d7-5f3a-449c-aa25-305ab2069720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:42.924022 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-5b14f3d7-5f3a-449c-aa25-305ab2069720 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:38:42.925233 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-5b14f3d7-5f3a-449c-aa25-305ab2069720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:42.937401 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2357b20e-9e61-4ccc-a1c6-2a3a3b0c38d1 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:42.944261 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:38:42.988108 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 923/1859] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:38:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:38:42.988955 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b14f3d7-5f3a-449c-aa25-305ab2069720 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:42.990244 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-5b14f3d7-5f3a-449c-aa25-305ab2069720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:42.999291 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ded364-413a-4e9b-a791-b81507ef36be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:43.000162 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ded364-413a-4e9b-a791-b81507ef36be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:43.000440 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ded364-413a-4e9b-a791-b81507ef36be admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:43.000717 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ded364-413a-4e9b-a791-b81507ef36be admin admin] PATH_INFO: `/v3/users/68dca1110e0d491a81bd6bc5a8dc7581` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:43.001928 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ded364-413a-4e9b-a791-b81507ef36be admin admin] RBAC: Authorizing `identity:delete_user(user_id=68dca1110e0d491a81bd6bc5a8dc7581)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:43.002466 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b14f3d7-5f3a-449c-aa25-305ab2069720 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:43.003872 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ded364-413a-4e9b-a791-b81507ef36be admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:43.007159 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd89aa7-151a-4d0d-841f-dc740d1d7180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:43.008057 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd89aa7-151a-4d0d-841f-dc740d1d7180 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:43.008343 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd89aa7-151a-4d0d-841f-dc740d1d7180 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:43.008620 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd89aa7-151a-4d0d-841f-dc740d1d7180 admin admin] PATH_INFO: `/v3/users/a48a98b718f44f6f9f6ba5d61885802d` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:43.009843 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd89aa7-151a-4d0d-841f-dc740d1d7180 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a48a98b718f44f6f9f6ba5d61885802d)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:43.011784 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd89aa7-151a-4d0d-841f-dc740d1d7180 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:43.054400 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-b2ded364-413a-4e9b-a791-b81507ef36be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68dca1110e0d491a81bd6bc5a8dc7581'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:43.061621 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-6cd89aa7-151a-4d0d-841f-dc740d1d7180 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a48a98b718f44f6f9f6ba5d61885802d'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:43.067329 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-b2ded364-413a-4e9b-a791-b81507ef36be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68dca1110e0d491a81bd6bc5a8dc7581'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:43.068091 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-b2ded364-413a-4e9b-a791-b81507ef36be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68dca1110e0d491a81bd6bc5a8dc7581'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:43.068491 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-6cd89aa7-151a-4d0d-841f-dc740d1d7180 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a48a98b718f44f6f9f6ba5d61885802d'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:43.069156 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-6cd89aa7-151a-4d0d-841f-dc740d1d7180 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a48a98b718f44f6f9f6ba5d61885802d'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:43.074800 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-b2ded364-413a-4e9b-a791-b81507ef36be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68dca1110e0d491a81bd6bc5a8dc7581'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:43.077726 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-6cd89aa7-151a-4d0d-841f-dc740d1d7180 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a48a98b718f44f6f9f6ba5d61885802d'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:43.078478 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-6cd89aa7-151a-4d0d-841f-dc740d1d7180 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a48a98b718f44f6f9f6ba5d61885802d'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:43.082573 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-b2ded364-413a-4e9b-a791-b81507ef36be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68dca1110e0d491a81bd6bc5a8dc7581'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:43.089325 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 937/1860] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 14 09:38:42 2022] DELETE /identity/v3/users/68dca1110e0d491a81bd6bc5a8dc7581 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:38:43.090417 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189700b0-a0cc-49d3-a01c-3b5965a18d34 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:43.090712 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189700b0-a0cc-49d3-a01c-3b5965a18d34 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:43.091025 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189700b0-a0cc-49d3-a01c-3b5965a18d34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:43.101574 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 924/1861] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 14 09:38:42 2022] DELETE /identity/v3/users/a48a98b718f44f6f9f6ba5d61885802d => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:38:43.101574 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fde0961-0963-4358-a7cd-e6f617b88453 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:43.101574 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fde0961-0963-4358-a7cd-e6f617b88453 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:43.101574 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fde0961-0963-4358-a7cd-e6f617b88453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:43.109140 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-189700b0-a0cc-49d3-a01c-3b5965a18d34 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:38:43.110393 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-189700b0-a0cc-49d3-a01c-3b5965a18d34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:43.116951 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:38:43.118575 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-8fde0961-0963-4358-a7cd-e6f617b88453 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:38:43.119778 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-8fde0961-0963-4358-a7cd-e6f617b88453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:43.181209 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 938/1862] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:38:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:38:43.182513 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759db789-c957-48df-a661-e2ff06c77811 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:43.182803 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759db789-c957-48df-a661-e2ff06c77811 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:43.183079 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759db789-c957-48df-a661-e2ff06c77811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:43.189866 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 925/1863] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:38:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:38:43.191195 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8aa75c-bada-4d12-b61f-f4651a7dcfae None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:43.191496 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8aa75c-bada-4d12-b61f-f4651a7dcfae None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:43.191779 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8aa75c-bada-4d12-b61f-f4651a7dcfae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:43.203165 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-759db789-c957-48df-a661-e2ff06c77811 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:38:43.204354 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-759db789-c957-48df-a661-e2ff06c77811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:43.209138 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-ce8aa75c-bada-4d12-b61f-f4651a7dcfae None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:38:43.210354 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-ce8aa75c-bada-4d12-b61f-f4651a7dcfae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:43.211885 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 939/1864] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:38:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:38:43.213365 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb912e7-53d0-456b-94ac-b4b9026437db None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:43.213640 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb912e7-53d0-456b-94ac-b4b9026437db None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:43.213915 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb912e7-53d0-456b-94ac-b4b9026437db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:43.218982 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 926/1865] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:38:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:38:43.222802 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8aa75c-bada-4d12-b61f-f4651a7dcfae None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:43.232789 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8aa75c-bada-4d12-b61f-f4651a7dcfae None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:43.235061 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-eeb912e7-53d0-456b-94ac-b4b9026437db None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:38:43.236257 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-eeb912e7-53d0-456b-94ac-b4b9026437db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:43.237425 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9d6848-9666-428e-8c47-fda410766ecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:43.238229 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9d6848-9666-428e-8c47-fda410766ecf admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:43.238588 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9d6848-9666-428e-8c47-fda410766ecf admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:43.238862 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9d6848-9666-428e-8c47-fda410766ecf admin admin] PATH_INFO: `/v3/domains` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:43.239711 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9d6848-9666-428e-8c47-fda410766ecf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:38:43.239997 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9d6848-9666-428e-8c47-fda410766ecf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:43.241847 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9d6848-9666-428e-8c47-fda410766ecf admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:43.245697 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 940/1866] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:38:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:38:43.246536 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb912e7-53d0-456b-94ac-b4b9026437db None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:43.248452 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-eeb912e7-53d0-456b-94ac-b4b9026437db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:43.255578 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 927/1867] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jul 14 09:38:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:38:43.256405 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9d6848-9666-428e-8c47-fda410766ecf admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:43.258038 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-8f9d6848-9666-428e-8c47-fda410766ecf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:43.280801 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:38:43.313365 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb912e7-53d0-456b-94ac-b4b9026437db None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:43.317267 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0201f993-d012-40a3-9c7c-e170fb277350 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e4a5a8965e4802a9055d332179b7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:43.317924 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0201f993-d012-40a3-9c7c-e170fb277350 service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:43.318833 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0201f993-d012-40a3-9c7c-e170fb277350 service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:43.319154 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0201f993-d012-40a3-9c7c-e170fb277350 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:43.322014 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9d6848-9666-428e-8c47-fda410766ecf admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:43.325782 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8539e1f8-bdd3-4a3c-8df1-f38e40721827 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e4a5a8965e4802a9055d332179b7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:43.326479 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8539e1f8-bdd3-4a3c-8df1-f38e40721827 service neutron] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:43.326763 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8539e1f8-bdd3-4a3c-8df1-f38e40721827 service neutron] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:43.327043 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8539e1f8-bdd3-4a3c-8df1-f38e40721827 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:43.330294 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0201f993-d012-40a3-9c7c-e170fb277350 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:43.331887 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0201f993-d012-40a3-9c7c-e170fb277350 service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:43.336757 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8539e1f8-bdd3-4a3c-8df1-f38e40721827 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:43.338457 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8539e1f8-bdd3-4a3c-8df1-f38e40721827 service neutron] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:43.343465 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 941/1868] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:38:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:38:43.344648 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0201f993-d012-40a3-9c7c-e170fb277350 service neutron] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:43.348517 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 928/1869] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:38:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:38:43.349298 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8539e1f8-bdd3-4a3c-8df1-f38e40721827 service neutron] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:43.355150 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0201f993-d012-40a3-9c7c-e170fb277350 service neutron] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:43.360190 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8539e1f8-bdd3-4a3c-8df1-f38e40721827 service neutron] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:43.361588 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12926ec7-fe5e-4adf-a832-78e85bfc0044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:43.362454 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12926ec7-fe5e-4adf-a832-78e85bfc0044 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:43.362802 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12926ec7-fe5e-4adf-a832-78e85bfc0044 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:43.363023 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12926ec7-fe5e-4adf-a832-78e85bfc0044 admin admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:43.364336 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12926ec7-fe5e-4adf-a832-78e85bfc0044 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:38:43.364841 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12926ec7-fe5e-4adf-a832-78e85bfc0044 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:43.366510 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12926ec7-fe5e-4adf-a832-78e85bfc0044 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:43.369976 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1074be7-ae59-440c-9504-3cbffb9f4dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:43.371258 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1074be7-ae59-440c-9504-3cbffb9f4dc7 admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:43.372465 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1074be7-ae59-440c-9504-3cbffb9f4dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:43.372764 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1074be7-ae59-440c-9504-3cbffb9f4dc7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:43.373488 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1074be7-ae59-440c-9504-3cbffb9f4dc7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:43.376027 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1074be7-ae59-440c-9504-3cbffb9f4dc7 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:43.379873 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 942/1870] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jul 14 09:38:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:38:43.384130 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12926ec7-fe5e-4adf-a832-78e85bfc0044 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:43.396492 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12926ec7-fe5e-4adf-a832-78e85bfc0044 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:43.402621 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b7b6d7-9136-4299-9b9c-1f94fc41e797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:43.403321 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b7b6d7-9136-4299-9b9c-1f94fc41e797 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:43.403608 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b7b6d7-9136-4299-9b9c-1f94fc41e797 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:43.403885 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b7b6d7-9136-4299-9b9c-1f94fc41e797 admin admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:43.404595 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b7b6d7-9136-4299-9b9c-1f94fc41e797 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:43.406525 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b7b6d7-9136-4299-9b9c-1f94fc41e797 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:43.415887 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 929/1871] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 14 09:38:43 2022] POST /identity/v3/projects => generated 389 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:38:43.417023 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1074be7-ae59-440c-9504-3cbffb9f4dc7 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:43.443336 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 943/1872] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 14 09:38:43 2022] POST /identity/v3/projects => generated 377 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:38:43.444346 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b7b6d7-9136-4299-9b9c-1f94fc41e797 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:43.497621 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1074be7-ae59-440c-9504-3cbffb9f4dc7 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:43.519083 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b7b6d7-9136-4299-9b9c-1f94fc41e797 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:43.525441 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494949bd-ad93-445d-8122-0d555dcb8436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:43.528859 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494949bd-ad93-445d-8122-0d555dcb8436 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:43.529348 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494949bd-ad93-445d-8122-0d555dcb8436 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:43.529926 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494949bd-ad93-445d-8122-0d555dcb8436 admin admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:43.530981 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494949bd-ad93-445d-8122-0d555dcb8436 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:43.535804 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494949bd-ad93-445d-8122-0d555dcb8436 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:43.549062 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:38:43.581888 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 944/1873] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 14 09:38:43 2022] POST /identity/v3/users => generated 289 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:38:43.583397 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494949bd-ad93-445d-8122-0d555dcb8436 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:43.587965 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15277b77-76e8-4f65-94e8-48e015ff01f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:43.588797 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15277b77-76e8-4f65-94e8-48e015ff01f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:43.589171 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15277b77-76e8-4f65-94e8-48e015ff01f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:43.590840 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15277b77-76e8-4f65-94e8-48e015ff01f3 admin admin] PATH_INFO: `/v3/users` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:43.592291 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15277b77-76e8-4f65-94e8-48e015ff01f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:43.596234 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15277b77-76e8-4f65-94e8-48e015ff01f3 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:43.597680 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494949bd-ad93-445d-8122-0d555dcb8436 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:43.604652 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9adfac6-c23e-4e2b-85cb-cb862b47eab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:43.605622 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9adfac6-c23e-4e2b-85cb-cb862b47eab2 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:43.606921 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9adfac6-c23e-4e2b-85cb-cb862b47eab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:43.607259 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9adfac6-c23e-4e2b-85cb-cb862b47eab2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:43.608116 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9adfac6-c23e-4e2b-85cb-cb862b47eab2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:43.610478 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9adfac6-c23e-4e2b-85cb-cb862b47eab2 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:43.629329 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 930/1874] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 14 09:38:43 2022] POST /identity/v3/users => generated 295 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:38:43.633400 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15277b77-76e8-4f65-94e8-48e015ff01f3 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:43.640989 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 945/1875] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 09:38:43 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:38:43.646087 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9adfac6-c23e-4e2b-85cb-cb862b47eab2 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:43.650113 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15277b77-76e8-4f65-94e8-48e015ff01f3 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:43.658690 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9adfac6-c23e-4e2b-85cb-cb862b47eab2 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:43.659227 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229b8b89-703a-4225-8f22-4a6b455c73bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:43.659913 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229b8b89-703a-4225-8f22-4a6b455c73bb admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:43.660196 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229b8b89-703a-4225-8f22-4a6b455c73bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:43.660474 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229b8b89-703a-4225-8f22-4a6b455c73bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:43.661217 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229b8b89-703a-4225-8f22-4a6b455c73bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:43.663472 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229b8b89-703a-4225-8f22-4a6b455c73bb admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:43.663785 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176d740b-522e-4ae5-84d2-5f88986adf6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:43.664604 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176d740b-522e-4ae5-84d2-5f88986adf6b admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:43.665000 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176d740b-522e-4ae5-84d2-5f88986adf6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:43.665289 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176d740b-522e-4ae5-84d2-5f88986adf6b admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:43.666425 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176d740b-522e-4ae5-84d2-5f88986adf6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:43.674648 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176d740b-522e-4ae5-84d2-5f88986adf6b admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:43.677496 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 931/1876] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 09:38:43 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:38:43.681184 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229b8b89-703a-4225-8f22-4a6b455c73bb admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:43.695773 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 946/1877] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 09:38:43 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:38:43.696341 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229b8b89-703a-4225-8f22-4a6b455c73bb admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:43.699707 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176d740b-522e-4ae5-84d2-5f88986adf6b admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:43.705308 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02b6dae-8069-429d-be88-57ecfa34c17d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:43.706004 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02b6dae-8069-429d-be88-57ecfa34c17d admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:43.706328 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02b6dae-8069-429d-be88-57ecfa34c17d admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:43.706615 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02b6dae-8069-429d-be88-57ecfa34c17d admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:43.707502 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02b6dae-8069-429d-be88-57ecfa34c17d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:43.709124 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02b6dae-8069-429d-be88-57ecfa34c17d admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:43.716802 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176d740b-522e-4ae5-84d2-5f88986adf6b admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:43.724944 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5af42f8-c4e5-4502-883a-7ceacef21b9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:43.727974 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5af42f8-c4e5-4502-883a-7ceacef21b9a admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:43.728598 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5af42f8-c4e5-4502-883a-7ceacef21b9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:43.729076 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 932/1878] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 09:38:43 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 09:38:43.729282 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5af42f8-c4e5-4502-883a-7ceacef21b9a admin admin] PATH_INFO: `/v3/projects/335e467616a44ee6be811e7cdc57d435/users/b20150b5de18430485429b4f72ee65a1/roles/17dfac38a2e540fea229af7de99911bb` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:43.733289 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02b6dae-8069-429d-be88-57ecfa34c17d admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:43.746553 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02b6dae-8069-429d-be88-57ecfa34c17d admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:43.748778 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5af42f8-c4e5-4502-883a-7ceacef21b9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=335e467616a44ee6be811e7cdc57d435, user_id=b20150b5de18430485429b4f72ee65a1, role_id=17dfac38a2e540fea229af7de99911bb)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:43.752838 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5af42f8-c4e5-4502-883a-7ceacef21b9a admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:43.753853 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d92b8a-9c75-414f-b26d-894ccc47d6f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:43.755120 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d92b8a-9c75-414f-b26d-894ccc47d6f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:43.755692 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d92b8a-9c75-414f-b26d-894ccc47d6f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:43.756043 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d92b8a-9c75-414f-b26d-894ccc47d6f0 admin admin] PATH_INFO: `/v3/projects/3287dab29ec147fdbd3cd177ff2e770d/users/0d4847b19af04861b3e73d0871116922/roles/17dfac38a2e540fea229af7de99911bb` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:43.771096 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:38:43.773324 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 947/1879] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 14 09:38:43 2022] PUT /identity/v3/projects/335e467616a44ee6be811e7cdc57d435/users/b20150b5de18430485429b4f72ee65a1/roles/17dfac38a2e540fea229af7de99911bb => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:38:43.777370 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d92b8a-9c75-414f-b26d-894ccc47d6f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3287dab29ec147fdbd3cd177ff2e770d, user_id=0d4847b19af04861b3e73d0871116922, role_id=17dfac38a2e540fea229af7de99911bb)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:43.781138 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d92b8a-9c75-414f-b26d-894ccc47d6f0 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:43.794867 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84dca0f-339f-4f22-a499-9167e7df011e None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:43.795149 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84dca0f-339f-4f22-a499-9167e7df011e None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:43.795424 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84dca0f-339f-4f22-a499-9167e7df011e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:43.813541 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 933/1880] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 14 09:38:43 2022] PUT /identity/v3/projects/3287dab29ec147fdbd3cd177ff2e770d/users/0d4847b19af04861b3e73d0871116922/roles/17dfac38a2e540fea229af7de99911bb => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:38:43.817961 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a8a3d3-139f-4f4f-a220-579a74bdadd5 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:43.819145 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a8a3d3-139f-4f4f-a220-579a74bdadd5 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:43.819546 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a8a3d3-139f-4f4f-a220-579a74bdadd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:43.845256 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-a84dca0f-339f-4f22-a499-9167e7df011e None None] MFA Rules not processed for user `b20150b5de18430485429b4f72ee65a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:38:43.846976 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-a84dca0f-339f-4f22-a499-9167e7df011e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:43.852479 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-e4a8a3d3-139f-4f4f-a220-579a74bdadd5 None None] MFA Rules not processed for user `0d4847b19af04861b3e73d0871116922`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:38:43.854097 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-e4a8a3d3-139f-4f4f-a220-579a74bdadd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:43.951567 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 934/1881] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:38:43 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:38:43.956422 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a8a3d3-139f-4f4f-a220-579a74bdadd5 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:44.028552 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 948/1882] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:38:43 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:38:44.029538 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84dca0f-339f-4f22-a499-9167e7df011e None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:44.035222 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-a84dca0f-339f-4f22-a499-9167e7df011e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:44.076759 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a8a3d3-139f-4f4f-a220-579a74bdadd5 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:44.091550 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbebac9d-0d19-4bc7-a0f8-100f4e2ceb37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:44.092301 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbebac9d-0d19-4bc7-a0f8-100f4e2ceb37 admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:44.092660 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbebac9d-0d19-4bc7-a0f8-100f4e2ceb37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:44.093183 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbebac9d-0d19-4bc7-a0f8-100f4e2ceb37 admin admin] PATH_INFO: `/v3/projects` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:44.093966 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbebac9d-0d19-4bc7-a0f8-100f4e2ceb37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:44.096231 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbebac9d-0d19-4bc7-a0f8-100f4e2ceb37 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:44.150300 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 935/1883] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 14 09:38:43 2022] POST /identity/v3/projects => generated 389 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 09:38:44.151389 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbebac9d-0d19-4bc7-a0f8-100f4e2ceb37 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:44.154809 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-cbebac9d-0d19-4bc7-a0f8-100f4e2ceb37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:44.158499 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84dca0f-339f-4f22-a499-9167e7df011e None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:44.218512 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:38:44.232206 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33f2462-56a6-416a-89bb-31fd2b180014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:44.233080 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33f2462-56a6-416a-89bb-31fd2b180014 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:44.233361 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33f2462-56a6-416a-89bb-31fd2b180014 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:44.233639 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33f2462-56a6-416a-89bb-31fd2b180014 admin admin] PATH_INFO: `/v3/projects/3fde1cfe28574b5788abeb74736fcf84` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:44.234843 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33f2462-56a6-416a-89bb-31fd2b180014 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3fde1cfe28574b5788abeb74736fcf84)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:44.236825 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33f2462-56a6-416a-89bb-31fd2b180014 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:44.239616 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:38:44.250747 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbebac9d-0d19-4bc7-a0f8-100f4e2ceb37 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:44.258654 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971fdc88-d665-4aeb-b53d-a15b893bf8fa service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba461800d6845e6a767c83777ae5213', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:44.259521 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971fdc88-d665-4aeb-b53d-a15b893bf8fa service glance] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:44.259946 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971fdc88-d665-4aeb-b53d-a15b893bf8fa service glance] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:44.260350 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971fdc88-d665-4aeb-b53d-a15b893bf8fa service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:44.292805 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-a33f2462-56a6-416a-89bb-31fd2b180014 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3fde1cfe28574b5788abeb74736fcf84', 'request_id': 'req-a33f2462-56a6-416a-89bb-31fd2b180014'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:44.298941 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-a33f2462-56a6-416a-89bb-31fd2b180014 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3fde1cfe28574b5788abeb74736fcf84', 'request_id': 'req-a33f2462-56a6-416a-89bb-31fd2b180014'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:44.304950 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-a33f2462-56a6-416a-89bb-31fd2b180014 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3fde1cfe28574b5788abeb74736fcf84', 'request_id': 'req-a33f2462-56a6-416a-89bb-31fd2b180014'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:44.317697 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-a33f2462-56a6-416a-89bb-31fd2b180014 admin admin] The token cache is being invalidate because project 3fde1cfe28574b5788abeb74736fcf84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 09:38:44.317999 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-a33f2462-56a6-416a-89bb-31fd2b180014 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:44.318666 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-a33f2462-56a6-416a-89bb-31fd2b180014 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:44.318965 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971fdc88-d665-4aeb-b53d-a15b893bf8fa service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:44.320444 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 949/1884] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 14 09:38:44 2022] DELETE /identity/v3/projects/3fde1cfe28574b5788abeb74736fcf84 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:38:44.320551 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971fdc88-d665-4aeb-b53d-a15b893bf8fa service glance] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:44.321188 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33f2462-56a6-416a-89bb-31fd2b180014 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:44.322542 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-a33f2462-56a6-416a-89bb-31fd2b180014 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:44.330561 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 936/1885] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:38:44 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:38:44.332970 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971fdc88-d665-4aeb-b53d-a15b893bf8fa service glance] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:44.343260 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971fdc88-d665-4aeb-b53d-a15b893bf8fa service glance] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:44.396821 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33f2462-56a6-416a-89bb-31fd2b180014 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:44.402243 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc48b63-f35a-43b5-80a2-71bbc3be795b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:44.403288 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc48b63-f35a-43b5-80a2-71bbc3be795b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:44.403955 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc48b63-f35a-43b5-80a2-71bbc3be795b admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:44.403955 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc48b63-f35a-43b5-80a2-71bbc3be795b admin admin] PATH_INFO: `/v3/projects/762b9b8f24924f6e89d2bbfefd8feb2b` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:44.405153 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc48b63-f35a-43b5-80a2-71bbc3be795b admin admin] RBAC: Authorizing `identity:delete_project(project_id=762b9b8f24924f6e89d2bbfefd8feb2b)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:44.407319 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc48b63-f35a-43b5-80a2-71bbc3be795b admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:44.410084 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756e765b-ebe2-4fab-9704-e38c0ec3c3f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:44.410815 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756e765b-ebe2-4fab-9704-e38c0ec3c3f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:44.411106 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756e765b-ebe2-4fab-9704-e38c0ec3c3f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:44.411389 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756e765b-ebe2-4fab-9704-e38c0ec3c3f7 admin admin] PATH_INFO: `/v3/users` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:44.412094 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756e765b-ebe2-4fab-9704-e38c0ec3c3f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:44.414027 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756e765b-ebe2-4fab-9704-e38c0ec3c3f7 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:44.437557 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 937/1886] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 14 09:38:44 2022] POST /identity/v3/users => generated 301 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:38:44.438541 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756e765b-ebe2-4fab-9704-e38c0ec3c3f7 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:44.442059 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-756e765b-ebe2-4fab-9704-e38c0ec3c3f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:44.455084 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756e765b-ebe2-4fab-9704-e38c0ec3c3f7 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:44.460444 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-1dc48b63-f35a-43b5-80a2-71bbc3be795b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '762b9b8f24924f6e89d2bbfefd8feb2b', 'request_id': 'req-1dc48b63-f35a-43b5-80a2-71bbc3be795b'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:44.468603 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-1dc48b63-f35a-43b5-80a2-71bbc3be795b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '762b9b8f24924f6e89d2bbfefd8feb2b', 'request_id': 'req-1dc48b63-f35a-43b5-80a2-71bbc3be795b'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:44.475906 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-1dc48b63-f35a-43b5-80a2-71bbc3be795b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '762b9b8f24924f6e89d2bbfefd8feb2b', 'request_id': 'req-1dc48b63-f35a-43b5-80a2-71bbc3be795b'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:44.491422 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-1dc48b63-f35a-43b5-80a2-71bbc3be795b admin admin] The token cache is being invalidate because project 762b9b8f24924f6e89d2bbfefd8feb2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 09:38:44.491728 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-1dc48b63-f35a-43b5-80a2-71bbc3be795b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:44.492573 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-1dc48b63-f35a-43b5-80a2-71bbc3be795b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:44.494589 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 950/1887] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 14 09:38:44 2022] DELETE /identity/v3/projects/762b9b8f24924f6e89d2bbfefd8feb2b => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:38:44.495102 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc48b63-f35a-43b5-80a2-71bbc3be795b admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:44.496446 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-1dc48b63-f35a-43b5-80a2-71bbc3be795b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:44.506929 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:38:44.538663 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f56d2ac-d957-4f82-a6df-39952fb75a3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:44.539573 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f56d2ac-d957-4f82-a6df-39952fb75a3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:44.539862 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f56d2ac-d957-4f82-a6df-39952fb75a3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:44.540139 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f56d2ac-d957-4f82-a6df-39952fb75a3f admin admin] PATH_INFO: `/v3/users/43f28625bf764f608d0faba5c5f7dcbf` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:44.542589 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f56d2ac-d957-4f82-a6df-39952fb75a3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=43f28625bf764f608d0faba5c5f7dcbf)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:44.544766 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f56d2ac-d957-4f82-a6df-39952fb75a3f admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:44.625338 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:38:44.640172 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc48b63-f35a-43b5-80a2-71bbc3be795b admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:44.649542 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-1f56d2ac-d957-4f82-a6df-39952fb75a3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43f28625bf764f608d0faba5c5f7dcbf'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:44.657293 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdeb0863-db9a-4304-b440-51330a765ce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:44.659953 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-1f56d2ac-d957-4f82-a6df-39952fb75a3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43f28625bf764f608d0faba5c5f7dcbf'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:44.660426 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeb0863-db9a-4304-b440-51330a765ce4 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:44.660426 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeb0863-db9a-4304-b440-51330a765ce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:44.660865 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-1f56d2ac-d957-4f82-a6df-39952fb75a3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43f28625bf764f608d0faba5c5f7dcbf'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:44.662968 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeb0863-db9a-4304-b440-51330a765ce4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:44.664169 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdeb0863-db9a-4304-b440-51330a765ce4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:44.667402 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdeb0863-db9a-4304-b440-51330a765ce4 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:44.672448 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-1f56d2ac-d957-4f82-a6df-39952fb75a3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43f28625bf764f608d0faba5c5f7dcbf'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:44.674047 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-1f56d2ac-d957-4f82-a6df-39952fb75a3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43f28625bf764f608d0faba5c5f7dcbf'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:44.695913 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 951/1888] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 09:38:44 2022] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:38:44.700240 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf020fa2-61a0-47dd-b9a6-12c1578ed80d None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:44.700592 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf020fa2-61a0-47dd-b9a6-12c1578ed80d None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:44.700925 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf020fa2-61a0-47dd-b9a6-12c1578ed80d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:44.702678 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 938/1889] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 14 09:38:44 2022] DELETE /identity/v3/users/43f28625bf764f608d0faba5c5f7dcbf => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:38:44.703597 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f56d2ac-d957-4f82-a6df-39952fb75a3f admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:44.706792 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-1f56d2ac-d957-4f82-a6df-39952fb75a3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:44.759426 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-cf020fa2-61a0-47dd-b9a6-12c1578ed80d None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:38:44.760696 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-cf020fa2-61a0-47dd-b9a6-12c1578ed80d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:44.838565 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 952/1890] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:38:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:38:44.848647 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144df634-9c40-44a7-b307-0f88d6bf0800 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:44.848838 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f56d2ac-d957-4f82-a6df-39952fb75a3f admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:44.849402 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144df634-9c40-44a7-b307-0f88d6bf0800 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:44.850866 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144df634-9c40-44a7-b307-0f88d6bf0800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:44.859126 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20af4124-5bb2-49a3-9895-f826a130517c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:44.860761 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20af4124-5bb2-49a3-9895-f826a130517c admin admin] REQUEST_METHOD: `PUT` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:44.861735 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20af4124-5bb2-49a3-9895-f826a130517c admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:44.862330 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20af4124-5bb2-49a3-9895-f826a130517c admin admin] PATH_INFO: `/v3/projects/7f7518d5261245099a82e1e46834351f/users/2ea6063ae0a0439fbe5de730f165f0b2/roles/e3965bd0d5f1427a86a313c0c90bfef3` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:44.890558 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20af4124-5bb2-49a3-9895-f826a130517c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f7518d5261245099a82e1e46834351f, user_id=2ea6063ae0a0439fbe5de730f165f0b2, role_id=e3965bd0d5f1427a86a313c0c90bfef3)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:44.892062 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-144df634-9c40-44a7-b307-0f88d6bf0800 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:38:44.893321 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-144df634-9c40-44a7-b307-0f88d6bf0800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:44.895354 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20af4124-5bb2-49a3-9895-f826a130517c admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:44.913196 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 953/1891] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:38:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:38:44.917443 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144df634-9c40-44a7-b307-0f88d6bf0800 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:44.933041 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144df634-9c40-44a7-b307-0f88d6bf0800 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:44.944277 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 939/1892] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 14 09:38:44 2022] PUT /identity/v3/projects/7f7518d5261245099a82e1e46834351f/users/2ea6063ae0a0439fbe5de730f165f0b2/roles/e3965bd0d5f1427a86a313c0c90bfef3 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:38:44.948472 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20af4124-5bb2-49a3-9895-f826a130517c admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:45.153591 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895389c7-622d-4fd4-bb3f-483cc3b0656e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:45.155024 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895389c7-622d-4fd4-bb3f-483cc3b0656e admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:45.156588 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895389c7-622d-4fd4-bb3f-483cc3b0656e admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:45.157533 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895389c7-622d-4fd4-bb3f-483cc3b0656e admin admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:45.158896 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895389c7-622d-4fd4-bb3f-483cc3b0656e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:38:45.159623 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895389c7-622d-4fd4-bb3f-483cc3b0656e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:45.161705 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895389c7-622d-4fd4-bb3f-483cc3b0656e admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:45.162412 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20af4124-5bb2-49a3-9895-f826a130517c admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:45.170161 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07a968e-9f4a-461b-b0dd-bc7192255191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:45.171038 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07a968e-9f4a-461b-b0dd-bc7192255191 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:45.171332 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07a968e-9f4a-461b-b0dd-bc7192255191 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:45.171668 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07a968e-9f4a-461b-b0dd-bc7192255191 admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:45.172483 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07a968e-9f4a-461b-b0dd-bc7192255191 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:45.175272 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07a968e-9f4a-461b-b0dd-bc7192255191 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:45.179973 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 954/1893] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jul 14 09:38:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:38:45.186699 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895389c7-622d-4fd4-bb3f-483cc3b0656e admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:45.197914 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 940/1894] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 09:38:44 2022] GET /identity/v3/roles => generated 1420 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:38:45.199395 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07a968e-9f4a-461b-b0dd-bc7192255191 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:45.205806 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895389c7-622d-4fd4-bb3f-483cc3b0656e admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:45.215425 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07a968e-9f4a-461b-b0dd-bc7192255191 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:45.219604 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6029ea8-b1c1-42e0-9553-af73939feb5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:45.220376 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6029ea8-b1c1-42e0-9553-af73939feb5e admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:45.220697 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6029ea8-b1c1-42e0-9553-af73939feb5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:45.221538 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118a35b0-abb1-4ed4-8e9e-90c7569d2c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:45.222421 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6029ea8-b1c1-42e0-9553-af73939feb5e admin admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:45.223158 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6029ea8-b1c1-42e0-9553-af73939feb5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:45.223273 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118a35b0-abb1-4ed4-8e9e-90c7569d2c9f admin admin] REQUEST_METHOD: `PUT` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:45.223636 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118a35b0-abb1-4ed4-8e9e-90c7569d2c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:45.224020 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118a35b0-abb1-4ed4-8e9e-90c7569d2c9f admin admin] PATH_INFO: `/v3/projects/7f7518d5261245099a82e1e46834351f/users/2ea6063ae0a0439fbe5de730f165f0b2/roles/e3965bd0d5f1427a86a313c0c90bfef3` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:45.227019 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118a35b0-abb1-4ed4-8e9e-90c7569d2c9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f7518d5261245099a82e1e46834351f, user_id=2ea6063ae0a0439fbe5de730f165f0b2, role_id=e3965bd0d5f1427a86a313c0c90bfef3)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:45.230690 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6029ea8-b1c1-42e0-9553-af73939feb5e admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:45.233535 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118a35b0-abb1-4ed4-8e9e-90c7569d2c9f admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:45.262858 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 941/1895] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 14 09:38:45 2022] PUT /identity/v3/projects/7f7518d5261245099a82e1e46834351f/users/2ea6063ae0a0439fbe5de730f165f0b2/roles/e3965bd0d5f1427a86a313c0c90bfef3 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:38:45.265279 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cbdc63-27ee-43f4-a0b2-ab7b4436acd3 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:45.265279 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cbdc63-27ee-43f4-a0b2-ab7b4436acd3 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:45.265461 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cbdc63-27ee-43f4-a0b2-ab7b4436acd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:45.294745 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 955/1896] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 14 09:38:45 2022] POST /identity/v3/projects => generated 367 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:38:45.295885 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6029ea8-b1c1-42e0-9553-af73939feb5e admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:45.307731 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:38:45.312960 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-a3cbdc63-27ee-43f4-a0b2-ab7b4436acd3 None None] MFA Rules not processed for user `2ea6063ae0a0439fbe5de730f165f0b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:38:45.315170 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-a3cbdc63-27ee-43f4-a0b2-ab7b4436acd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:45.340057 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:38:45.422317 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 942/1897] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:38:45 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:38:45.434805 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cbdc63-27ee-43f4-a0b2-ab7b4436acd3 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:45.436234 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-a3cbdc63-27ee-43f4-a0b2-ab7b4436acd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:45.437085 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6029ea8-b1c1-42e0-9553-af73939feb5e admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:45.444329 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552ae3a3-e2a5-4f68-86df-06235922a5ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:45.445031 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552ae3a3-e2a5-4f68-86df-06235922a5ea admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:45.445319 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552ae3a3-e2a5-4f68-86df-06235922a5ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:45.445599 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552ae3a3-e2a5-4f68-86df-06235922a5ea admin admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:45.446344 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552ae3a3-e2a5-4f68-86df-06235922a5ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:45.448558 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552ae3a3-e2a5-4f68-86df-06235922a5ea admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:45.487540 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 956/1898] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 14 09:38:45 2022] POST /identity/v3/users => generated 284 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:38:45.491751 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552ae3a3-e2a5-4f68-86df-06235922a5ea admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:45.518596 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552ae3a3-e2a5-4f68-86df-06235922a5ea admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:45.532323 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cbdc63-27ee-43f4-a0b2-ab7b4436acd3 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:45.534172 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee047756-2544-4845-a7a2-8dd4a0bec14f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:45.535202 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee047756-2544-4845-a7a2-8dd4a0bec14f admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:45.535694 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee047756-2544-4845-a7a2-8dd4a0bec14f admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:45.536166 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b89dcef-f74d-4967-b09e-8acfadde2975 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25048b29787d482783ebc944f1a7df65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:45.536422 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee047756-2544-4845-a7a2-8dd4a0bec14f admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:45.536963 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b89dcef-f74d-4967-b09e-8acfadde2975 service cinder] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:45.537249 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b89dcef-f74d-4967-b09e-8acfadde2975 service cinder] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:45.537531 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b89dcef-f74d-4967-b09e-8acfadde2975 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:45.538144 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee047756-2544-4845-a7a2-8dd4a0bec14f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:45.541895 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee047756-2544-4845-a7a2-8dd4a0bec14f admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:45.558801 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b89dcef-f74d-4967-b09e-8acfadde2975 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:45.560426 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 957/1899] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 09:38:45 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:38:45.562243 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b89dcef-f74d-4967-b09e-8acfadde2975 service cinder] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:45.572284 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee047756-2544-4845-a7a2-8dd4a0bec14f admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:45.586558 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee047756-2544-4845-a7a2-8dd4a0bec14f admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:45.589149 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 943/1900] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:38:45 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 09:38:45.595104 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b982ce-5840-483c-91c4-f53d8d88c7ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:45.595995 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b982ce-5840-483c-91c4-f53d8d88c7ea admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:45.596466 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b982ce-5840-483c-91c4-f53d8d88c7ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:45.596915 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b982ce-5840-483c-91c4-f53d8d88c7ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:45.597878 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b982ce-5840-483c-91c4-f53d8d88c7ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:45.600034 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b982ce-5840-483c-91c4-f53d8d88c7ea admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:45.618091 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 958/1901] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 09:38:45 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:38:45.620813 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b89dcef-f74d-4967-b09e-8acfadde2975 service cinder] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:45.636428 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b89dcef-f74d-4967-b09e-8acfadde2975 service cinder] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:45.660819 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0786bcc-cb88-47b7-8f16-a57947d50b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:45.661634 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0786bcc-cb88-47b7-8f16-a57947d50b07 admin admin] REQUEST_METHOD: `PUT` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:45.661926 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0786bcc-cb88-47b7-8f16-a57947d50b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:45.662208 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0786bcc-cb88-47b7-8f16-a57947d50b07 admin admin] PATH_INFO: `/v3/projects/d93cfa479b474c508c67869a48db9a1d/users/87ec9d3d45574e1d88f62d9d90191bc1/roles/17dfac38a2e540fea229af7de99911bb` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:45.696035 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0786bcc-cb88-47b7-8f16-a57947d50b07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d93cfa479b474c508c67869a48db9a1d, user_id=87ec9d3d45574e1d88f62d9d90191bc1, role_id=17dfac38a2e540fea229af7de99911bb)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:45.701072 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0786bcc-cb88-47b7-8f16-a57947d50b07 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:45.723438 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 944/1902] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 14 09:38:45 2022] PUT /identity/v3/projects/d93cfa479b474c508c67869a48db9a1d/users/87ec9d3d45574e1d88f62d9d90191bc1/roles/17dfac38a2e540fea229af7de99911bb => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:38:45.736388 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916a917a-5132-4160-8a63-01f9942e2cd3 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:45.736875 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916a917a-5132-4160-8a63-01f9942e2cd3 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:45.736976 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916a917a-5132-4160-8a63-01f9942e2cd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:45.759750 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0786bcc-cb88-47b7-8f16-a57947d50b07 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:45.761525 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-a0786bcc-cb88-47b7-8f16-a57947d50b07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:45.787301 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-916a917a-5132-4160-8a63-01f9942e2cd3 None None] MFA Rules not processed for user `87ec9d3d45574e1d88f62d9d90191bc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:38:45.791089 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-916a917a-5132-4160-8a63-01f9942e2cd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:45.883350 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 959/1903] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:38:45 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:38:45.887292 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916a917a-5132-4160-8a63-01f9942e2cd3 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:45.912163 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0786bcc-cb88-47b7-8f16-a57947d50b07 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:45.919270 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e7c6cf-9783-4028-ae9c-47eb897c0666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:45.920193 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e7c6cf-9783-4028-ae9c-47eb897c0666 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:45.920503 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e7c6cf-9783-4028-ae9c-47eb897c0666 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:45.920879 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e7c6cf-9783-4028-ae9c-47eb897c0666 admin admin] PATH_INFO: `/v3/projects/a858e2435966412f8f9bf2c16355d8bb` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:45.929198 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e7c6cf-9783-4028-ae9c-47eb897c0666 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a858e2435966412f8f9bf2c16355d8bb)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:45.932112 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e7c6cf-9783-4028-ae9c-47eb897c0666 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:45.959306 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:38:45.980176 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916a917a-5132-4160-8a63-01f9942e2cd3 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:45.989789 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:38:45.994087 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-53e7c6cf-9783-4028-ae9c-47eb897c0666 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a858e2435966412f8f9bf2c16355d8bb', 'request_id': 'req-53e7c6cf-9783-4028-ae9c-47eb897c0666'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:46.002124 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-53e7c6cf-9783-4028-ae9c-47eb897c0666 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a858e2435966412f8f9bf2c16355d8bb', 'request_id': 'req-53e7c6cf-9783-4028-ae9c-47eb897c0666'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:46.009141 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-53e7c6cf-9783-4028-ae9c-47eb897c0666 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a858e2435966412f8f9bf2c16355d8bb', 'request_id': 'req-53e7c6cf-9783-4028-ae9c-47eb897c0666'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:46.022478 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-53e7c6cf-9783-4028-ae9c-47eb897c0666 admin admin] The token cache is being invalidate because project a858e2435966412f8f9bf2c16355d8bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 09:38:46.022776 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-53e7c6cf-9783-4028-ae9c-47eb897c0666 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:46.023453 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-53e7c6cf-9783-4028-ae9c-47eb897c0666 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:46.025105 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 945/1904] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 14 09:38:45 2022] DELETE /identity/v3/projects/a858e2435966412f8f9bf2c16355d8bb => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 09:38:46.028683 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e7c6cf-9783-4028-ae9c-47eb897c0666 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:46.028683 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-53e7c6cf-9783-4028-ae9c-47eb897c0666 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:46.047168 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec2020c-846a-4389-aae7-8d27e3ecba6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:46.048053 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec2020c-846a-4389-aae7-8d27e3ecba6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:46.048469 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec2020c-846a-4389-aae7-8d27e3ecba6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:46.048750 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec2020c-846a-4389-aae7-8d27e3ecba6e admin admin] PATH_INFO: `/v3/users/0d4847b19af04861b3e73d0871116922` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:46.049966 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec2020c-846a-4389-aae7-8d27e3ecba6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d4847b19af04861b3e73d0871116922)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:46.051927 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec2020c-846a-4389-aae7-8d27e3ecba6e admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:46.097247 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e7c6cf-9783-4028-ae9c-47eb897c0666 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:46.101883 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dba283e-ec29-4749-8e90-1ba5b5ddcaf8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba461800d6845e6a767c83777ae5213', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:46.102689 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dba283e-ec29-4749-8e90-1ba5b5ddcaf8 service glance] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:46.103049 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dba283e-ec29-4749-8e90-1ba5b5ddcaf8 service glance] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:46.103403 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dba283e-ec29-4749-8e90-1ba5b5ddcaf8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:46.105366 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-8dba283e-ec29-4749-8e90-1ba5b5ddcaf8 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:46.109484 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-dec2020c-846a-4389-aae7-8d27e3ecba6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d4847b19af04861b3e73d0871116922'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:46.123161 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-dec2020c-846a-4389-aae7-8d27e3ecba6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d4847b19af04861b3e73d0871116922'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:46.126639 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-dec2020c-846a-4389-aae7-8d27e3ecba6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d4847b19af04861b3e73d0871116922'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:46.144504 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-dec2020c-846a-4389-aae7-8d27e3ecba6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d4847b19af04861b3e73d0871116922'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:46.158538 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-dec2020c-846a-4389-aae7-8d27e3ecba6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d4847b19af04861b3e73d0871116922'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:46.167086 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 960/1905] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 14 09:38:45 2022] DELETE /identity/v3/users/0d4847b19af04861b3e73d0871116922 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:38:46.171027 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d891931f-4cde-4cfb-89ef-433ffaacad48 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:46.171027 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d891931f-4cde-4cfb-89ef-433ffaacad48 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:46.171027 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d891931f-4cde-4cfb-89ef-433ffaacad48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:46.188863 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dba283e-ec29-4749-8e90-1ba5b5ddcaf8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:46.190341 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dba283e-ec29-4749-8e90-1ba5b5ddcaf8 service glance] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:46.203559 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-d891931f-4cde-4cfb-89ef-433ffaacad48 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:38:46.204947 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-d891931f-4cde-4cfb-89ef-433ffaacad48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:46.206679 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 946/1906] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:38:46 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:38:46.208111 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e69d5e-4e8a-4bb1-b4f5-8a9160d254de None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:46.208409 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e69d5e-4e8a-4bb1-b4f5-8a9160d254de None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:46.209000 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e69d5e-4e8a-4bb1-b4f5-8a9160d254de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:46.236235 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-66e69d5e-4e8a-4bb1-b4f5-8a9160d254de None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:38:46.237461 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-66e69d5e-4e8a-4bb1-b4f5-8a9160d254de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:46.305428 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 961/1907] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:38:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:38:46.314262 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587aeebe-f8ae-4b55-bf15-aeb78d2d988a None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:46.314789 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587aeebe-f8ae-4b55-bf15-aeb78d2d988a None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:46.315197 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587aeebe-f8ae-4b55-bf15-aeb78d2d988a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:46.343072 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-587aeebe-f8ae-4b55-bf15-aeb78d2d988a None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:38:46.343212 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 947/1908] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:38:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:38:46.343302 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-587aeebe-f8ae-4b55-bf15-aeb78d2d988a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:46.350564 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 962/1909] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:38:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:38:46.352265 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e69d5e-4e8a-4bb1-b4f5-8a9160d254de None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:46.354418 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-66e69d5e-4e8a-4bb1-b4f5-8a9160d254de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:46.355134 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587aeebe-f8ae-4b55-bf15-aeb78d2d988a None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:46.365953 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587aeebe-f8ae-4b55-bf15-aeb78d2d988a None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:46.366085 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:38:46.373291 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c057cd-fc06-40e4-bbf4-6a60d4bd6bb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:46.374645 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c057cd-fc06-40e4-bbf4-6a60d4bd6bb5 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:46.375132 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c057cd-fc06-40e4-bbf4-6a60d4bd6bb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:46.375424 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c057cd-fc06-40e4-bbf4-6a60d4bd6bb5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:46.376583 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c057cd-fc06-40e4-bbf4-6a60d4bd6bb5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:38:46.377194 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c057cd-fc06-40e4-bbf4-6a60d4bd6bb5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:46.379179 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c057cd-fc06-40e4-bbf4-6a60d4bd6bb5 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:46.398397 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 963/1910] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jul 14 09:38:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:38:46.399312 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c057cd-fc06-40e4-bbf4-6a60d4bd6bb5 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:46.413979 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c057cd-fc06-40e4-bbf4-6a60d4bd6bb5 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:46.421061 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305dc93b-dd84-45a3-9341-ce330abd6012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:46.421934 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305dc93b-dd84-45a3-9341-ce330abd6012 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:46.422499 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305dc93b-dd84-45a3-9341-ce330abd6012 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:46.423031 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305dc93b-dd84-45a3-9341-ce330abd6012 admin admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:46.423757 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305dc93b-dd84-45a3-9341-ce330abd6012 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:46.426010 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305dc93b-dd84-45a3-9341-ce330abd6012 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:46.440045 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e69d5e-4e8a-4bb1-b4f5-8a9160d254de None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:46.441824 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:38:46.446945 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ff3294-e920-4ae1-a2fd-feaf1a0afa66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e4a5a8965e4802a9055d332179b7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:46.447854 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ff3294-e920-4ae1-a2fd-feaf1a0afa66 service neutron] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:46.448286 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ff3294-e920-4ae1-a2fd-feaf1a0afa66 service neutron] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:46.449731 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ff3294-e920-4ae1-a2fd-feaf1a0afa66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:46.465067 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 964/1911] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 14 09:38:46 2022] POST /identity/v3/projects => generated 381 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:38:46.466683 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ff3294-e920-4ae1-a2fd-feaf1a0afa66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:46.469660 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ff3294-e920-4ae1-a2fd-feaf1a0afa66 service neutron] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:46.469795 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305dc93b-dd84-45a3-9341-ce330abd6012 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:46.506144 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 948/1912] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:38:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 09:38:46.586944 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e11a238-2634-4925-b1d4-efee4c7bdcc6 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:46.587071 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305dc93b-dd84-45a3-9341-ce330abd6012 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:46.587286 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e11a238-2634-4925-b1d4-efee4c7bdcc6 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:46.587857 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e11a238-2634-4925-b1d4-efee4c7bdcc6 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:46.589598 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 949/1913] 10.222.0.40 () {54 vars in 921 bytes} [Thu Jul 14 09:38:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 09:38:46.598538 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a100fc49-6ffc-4554-af90-88af5752bbe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:46.599312 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a100fc49-6ffc-4554-af90-88af5752bbe0 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:46.599803 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a100fc49-6ffc-4554-af90-88af5752bbe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:46.600397 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a100fc49-6ffc-4554-af90-88af5752bbe0 admin admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:46.601274 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a100fc49-6ffc-4554-af90-88af5752bbe0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:46.607126 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a100fc49-6ffc-4554-af90-88af5752bbe0 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:46.613851 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c21e36-a846-4fab-9161-1c800a856fc8 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:46.614235 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c21e36-a846-4fab-9161-1c800a856fc8 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:46.614524 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c21e36-a846-4fab-9161-1c800a856fc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:46.693249 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-e6c21e36-a846-4fab-9161-1c800a856fc8 None None] MFA Rules not processed for user `1f6962106dfa4c4c9af551053f8095e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:38:46.698302 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 965/1914] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 14 09:38:46 2022] POST /identity/v3/users => generated 291 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 09:38:46.699120 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a100fc49-6ffc-4554-af90-88af5752bbe0 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:46.700600 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-e6c21e36-a846-4fab-9161-1c800a856fc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:46.754711 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a100fc49-6ffc-4554-af90-88af5752bbe0 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:46.774688 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f680b68-c71f-4213-b577-c18bc39fe6d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:46.781022 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f680b68-c71f-4213-b577-c18bc39fe6d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:46.781309 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f680b68-c71f-4213-b577-c18bc39fe6d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:46.781591 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f680b68-c71f-4213-b577-c18bc39fe6d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:46.782381 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f680b68-c71f-4213-b577-c18bc39fe6d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:46.791842 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f680b68-c71f-4213-b577-c18bc39fe6d0 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:46.816445 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 966/1915] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 09:38:46 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:38:46.818566 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f680b68-c71f-4213-b577-c18bc39fe6d0 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:46.845319 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f680b68-c71f-4213-b577-c18bc39fe6d0 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:46.859909 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f650f08-39cc-4c72-9ef8-f2b4185626e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:46.860680 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f650f08-39cc-4c72-9ef8-f2b4185626e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:46.861567 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f650f08-39cc-4c72-9ef8-f2b4185626e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:46.861922 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f650f08-39cc-4c72-9ef8-f2b4185626e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:46.862767 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f650f08-39cc-4c72-9ef8-f2b4185626e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:46.865611 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f650f08-39cc-4c72-9ef8-f2b4185626e2 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:46.898551 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 967/1916] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 09:38:46 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 09:38:46.900598 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f650f08-39cc-4c72-9ef8-f2b4185626e2 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:46.926686 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 950/1917] 10.222.0.40 () {58 vars in 1018 bytes} [Thu Jul 14 09:38:46 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:38:46.944820 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f650f08-39cc-4c72-9ef8-f2b4185626e2 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:46.953157 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfdf28a-4235-41c7-aea1-3ed16868a607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:46.954358 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfdf28a-4235-41c7-aea1-3ed16868a607 admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:46.954749 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfdf28a-4235-41c7-aea1-3ed16868a607 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:46.955131 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfdf28a-4235-41c7-aea1-3ed16868a607 admin admin] PATH_INFO: `/v3/projects/0acba9c7aa9b4e1d9ba23c9709f07657/users/99dc258f96ae47da9385043e61766153/roles/17dfac38a2e540fea229af7de99911bb` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:46.962095 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c21e36-a846-4fab-9161-1c800a856fc8 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:46.964055 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-e6c21e36-a846-4fab-9161-1c800a856fc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:46.990229 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c21e36-a846-4fab-9161-1c800a856fc8 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:47.009240 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335eeb51-16a0-4490-90b0-e6baa7394bff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:47.011097 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335eeb51-16a0-4490-90b0-e6baa7394bff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:47.012577 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335eeb51-16a0-4490-90b0-e6baa7394bff admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:47.013510 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335eeb51-16a0-4490-90b0-e6baa7394bff admin admin] PATH_INFO: `/v3/projects/3287dab29ec147fdbd3cd177ff2e770d` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:47.015414 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfdf28a-4235-41c7-aea1-3ed16868a607 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0acba9c7aa9b4e1d9ba23c9709f07657, user_id=99dc258f96ae47da9385043e61766153, role_id=17dfac38a2e540fea229af7de99911bb)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:47.015782 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335eeb51-16a0-4490-90b0-e6baa7394bff admin admin] RBAC: Authorizing `identity:delete_project(project_id=3287dab29ec147fdbd3cd177ff2e770d)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:47.021489 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335eeb51-16a0-4490-90b0-e6baa7394bff admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:47.023433 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfdf28a-4235-41c7-aea1-3ed16868a607 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:47.058229 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 968/1918] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 14 09:38:46 2022] PUT /identity/v3/projects/0acba9c7aa9b4e1d9ba23c9709f07657/users/99dc258f96ae47da9385043e61766153/roles/17dfac38a2e540fea229af7de99911bb => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:38:47.066237 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfdf28a-4235-41c7-aea1-3ed16868a607 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:47.066237 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-fbfdf28a-4235-41c7-aea1-3ed16868a607 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:47.103119 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-335eeb51-16a0-4490-90b0-e6baa7394bff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3287dab29ec147fdbd3cd177ff2e770d', 'request_id': 'req-335eeb51-16a0-4490-90b0-e6baa7394bff'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:47.112543 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-335eeb51-16a0-4490-90b0-e6baa7394bff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3287dab29ec147fdbd3cd177ff2e770d', 'request_id': 'req-335eeb51-16a0-4490-90b0-e6baa7394bff'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:47.119925 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-335eeb51-16a0-4490-90b0-e6baa7394bff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3287dab29ec147fdbd3cd177ff2e770d', 'request_id': 'req-335eeb51-16a0-4490-90b0-e6baa7394bff'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:47.132942 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-335eeb51-16a0-4490-90b0-e6baa7394bff admin admin] The token cache is being invalidate because project 3287dab29ec147fdbd3cd177ff2e770d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 09:38:47.134421 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-335eeb51-16a0-4490-90b0-e6baa7394bff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:47.135495 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-335eeb51-16a0-4490-90b0-e6baa7394bff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:47.138609 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 951/1919] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 14 09:38:46 2022] DELETE /identity/v3/projects/3287dab29ec147fdbd3cd177ff2e770d => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 09:38:47.140100 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a0be35-9c34-4d67-8009-de5eedbe27f9 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:47.140400 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a0be35-9c34-4d67-8009-de5eedbe27f9 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:47.140688 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a0be35-9c34-4d67-8009-de5eedbe27f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:47.173444 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-83a0be35-9c34-4d67-8009-de5eedbe27f9 None None] MFA Rules not processed for user `99dc258f96ae47da9385043e61766153`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:38:47.175379 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-83a0be35-9c34-4d67-8009-de5eedbe27f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:47.184058 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfdf28a-4235-41c7-aea1-3ed16868a607 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:47.194668 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:38:47.255413 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:38:47.323354 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 952/1920] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:38:47 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:38:47.324939 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a0be35-9c34-4d67-8009-de5eedbe27f9 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:47.326601 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-83a0be35-9c34-4d67-8009-de5eedbe27f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:47.336561 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd1900d-8bc7-4496-8c6e-b14161de63fa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f6962106dfa4c4c9af551053f8095e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:47.338479 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd1900d-8bc7-4496-8c6e-b14161de63fa service nova] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:47.338844 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd1900d-8bc7-4496-8c6e-b14161de63fa service nova] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:47.339133 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd1900d-8bc7-4496-8c6e-b14161de63fa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:47.344063 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-8bd1900d-8bc7-4496-8c6e-b14161de63fa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:47.362246 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd1900d-8bc7-4496-8c6e-b14161de63fa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:47.362246 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd1900d-8bc7-4496-8c6e-b14161de63fa service nova] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:47.376280 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 969/1921] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:38:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:38:47.377439 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd1900d-8bc7-4496-8c6e-b14161de63fa service nova] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:47.380233 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-8bd1900d-8bc7-4496-8c6e-b14161de63fa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:47.422708 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a0be35-9c34-4d67-8009-de5eedbe27f9 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:47.427648 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a86d041-0cd4-4122-9034-600f71cedc4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:47.428541 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a86d041-0cd4-4122-9034-600f71cedc4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:47.428828 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a86d041-0cd4-4122-9034-600f71cedc4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:47.429114 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a86d041-0cd4-4122-9034-600f71cedc4c admin admin] PATH_INFO: `/v3/users/2ea6063ae0a0439fbe5de730f165f0b2` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:47.430375 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a86d041-0cd4-4122-9034-600f71cedc4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ea6063ae0a0439fbe5de730f165f0b2)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:47.432314 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a86d041-0cd4-4122-9034-600f71cedc4c admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:47.455240 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd1900d-8bc7-4496-8c6e-b14161de63fa service nova] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:47.460763 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9970203f-d8ee-4fd4-82d9-d9dea900107c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:47.461530 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9970203f-d8ee-4fd4-82d9-d9dea900107c admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:47.461895 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9970203f-d8ee-4fd4-82d9-d9dea900107c admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:47.462779 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9970203f-d8ee-4fd4-82d9-d9dea900107c admin admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:47.463565 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9970203f-d8ee-4fd4-82d9-d9dea900107c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:47.465941 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9970203f-d8ee-4fd4-82d9-d9dea900107c admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:47.489222 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-7a86d041-0cd4-4122-9034-600f71cedc4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ea6063ae0a0439fbe5de730f165f0b2'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:47.497377 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-7a86d041-0cd4-4122-9034-600f71cedc4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ea6063ae0a0439fbe5de730f165f0b2'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:47.498085 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-7a86d041-0cd4-4122-9034-600f71cedc4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ea6063ae0a0439fbe5de730f165f0b2'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:47.498971 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 970/1922] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 14 09:38:47 2022] POST /identity/v3/projects => generated 385 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:38:47.503137 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9970203f-d8ee-4fd4-82d9-d9dea900107c admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:47.531377 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-7a86d041-0cd4-4122-9034-600f71cedc4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ea6063ae0a0439fbe5de730f165f0b2'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:47.532402 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-7a86d041-0cd4-4122-9034-600f71cedc4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ea6063ae0a0439fbe5de730f165f0b2'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:47.562735 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 953/1923] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 14 09:38:47 2022] DELETE /identity/v3/users/2ea6063ae0a0439fbe5de730f165f0b2 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:38:47.601849 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9970203f-d8ee-4fd4-82d9-d9dea900107c admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:47.659854 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:38:47.670916 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d3ddc3-dc06-40f8-8d0c-961aea6b86ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:47.671609 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d3ddc3-dc06-40f8-8d0c-961aea6b86ce admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:47.671900 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d3ddc3-dc06-40f8-8d0c-961aea6b86ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:47.672185 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d3ddc3-dc06-40f8-8d0c-961aea6b86ce admin admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:47.672888 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d3ddc3-dc06-40f8-8d0c-961aea6b86ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:47.674874 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d3ddc3-dc06-40f8-8d0c-961aea6b86ce admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:47.710163 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 971/1924] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 14 09:38:47 2022] POST /identity/v3/users => generated 299 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 09:38:47.711459 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a86d041-0cd4-4122-9034-600f71cedc4c admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:47.713279 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-7a86d041-0cd4-4122-9034-600f71cedc4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:47.727776 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a86d041-0cd4-4122-9034-600f71cedc4c admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:47.732861 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7849ecb-19d4-4b1f-8a4e-776e20482f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:47.733643 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7849ecb-19d4-4b1f-8a4e-776e20482f63 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:47.734039 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7849ecb-19d4-4b1f-8a4e-776e20482f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:47.734984 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7849ecb-19d4-4b1f-8a4e-776e20482f63 admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:47.735460 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7849ecb-19d4-4b1f-8a4e-776e20482f63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:47.737045 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7849ecb-19d4-4b1f-8a4e-776e20482f63 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:47.750891 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 954/1925] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 09:38:47 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:38:47.755197 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d3ddc3-dc06-40f8-8d0c-961aea6b86ce admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:47.766002 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d3ddc3-dc06-40f8-8d0c-961aea6b86ce admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:47.770666 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e896667a-2b59-4d23-8b1d-b9fa052e10dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:47.771618 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e896667a-2b59-4d23-8b1d-b9fa052e10dd admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:47.771899 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e896667a-2b59-4d23-8b1d-b9fa052e10dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:47.772203 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e896667a-2b59-4d23-8b1d-b9fa052e10dd admin admin] PATH_INFO: `/v3/projects/4821f93006444deaa89cc854f3c47b41/users/de69ef62665f4236af27fb97904d13bf/roles/e3965bd0d5f1427a86a313c0c90bfef3` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:47.791306 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e896667a-2b59-4d23-8b1d-b9fa052e10dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=4821f93006444deaa89cc854f3c47b41, user_id=de69ef62665f4236af27fb97904d13bf, role_id=e3965bd0d5f1427a86a313c0c90bfef3)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:47.794250 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e896667a-2b59-4d23-8b1d-b9fa052e10dd admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:47.815983 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 972/1926] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 14 09:38:47 2022] PUT /identity/v3/projects/4821f93006444deaa89cc854f3c47b41/users/de69ef62665f4236af27fb97904d13bf/roles/e3965bd0d5f1427a86a313c0c90bfef3 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 09:38:47.819859 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7849ecb-19d4-4b1f-8a4e-776e20482f63 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:47.831548 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7849ecb-19d4-4b1f-8a4e-776e20482f63 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:47.847153 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:38:47.904844 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d79014-d836-4f2c-8f06-a9990ebcbcab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:47.905441 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d79014-d836-4f2c-8f06-a9990ebcbcab admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:47.905726 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d79014-d836-4f2c-8f06-a9990ebcbcab admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:47.906013 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d79014-d836-4f2c-8f06-a9990ebcbcab admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:47.906788 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d79014-d836-4f2c-8f06-a9990ebcbcab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:47.908387 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d79014-d836-4f2c-8f06-a9990ebcbcab admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:47.931794 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 955/1927] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 09:38:47 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:38:47.933671 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e896667a-2b59-4d23-8b1d-b9fa052e10dd admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:47.947241 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e896667a-2b59-4d23-8b1d-b9fa052e10dd admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:47.957874 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7970569a-d10e-43d6-928c-08883ceb865c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:47.958956 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7970569a-d10e-43d6-928c-08883ceb865c admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:47.959367 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7970569a-d10e-43d6-928c-08883ceb865c admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:47.959754 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7970569a-d10e-43d6-928c-08883ceb865c admin admin] PATH_INFO: `/v3/projects/4821f93006444deaa89cc854f3c47b41/users/de69ef62665f4236af27fb97904d13bf/roles/e3965bd0d5f1427a86a313c0c90bfef3` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:47.961882 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7970569a-d10e-43d6-928c-08883ceb865c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4821f93006444deaa89cc854f3c47b41, user_id=de69ef62665f4236af27fb97904d13bf, role_id=e3965bd0d5f1427a86a313c0c90bfef3)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:47.965438 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7970569a-d10e-43d6-928c-08883ceb865c admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:47.986168 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 973/1928] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 14 09:38:47 2022] PUT /identity/v3/projects/4821f93006444deaa89cc854f3c47b41/users/de69ef62665f4236af27fb97904d13bf/roles/e3965bd0d5f1427a86a313c0c90bfef3 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 09:38:47.998047 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1f14f0-34b7-4940-bf25-9a54c47c6c77 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:47.998487 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1f14f0-34b7-4940-bf25-9a54c47c6c77 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:47.998903 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1f14f0-34b7-4940-bf25-9a54c47c6c77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:48.038027 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-9d1f14f0-34b7-4940-bf25-9a54c47c6c77 None None] MFA Rules not processed for user `de69ef62665f4236af27fb97904d13bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:38:48.039572 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-9d1f14f0-34b7-4940-bf25-9a54c47c6c77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:48.140344 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 956/1929] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:38:47 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:38:48.153015 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7970569a-d10e-43d6-928c-08883ceb865c admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:48.159138 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-7970569a-d10e-43d6-928c-08883ceb865c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:48.178237 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1f14f0-34b7-4940-bf25-9a54c47c6c77 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:48.181073 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-9d1f14f0-34b7-4940-bf25-9a54c47c6c77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:48.281066 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7970569a-d10e-43d6-928c-08883ceb865c admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:48.291107 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91387eb7-4b47-47fb-a7de-bdec4a16a07a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25048b29787d482783ebc944f1a7df65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:48.291790 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91387eb7-4b47-47fb-a7de-bdec4a16a07a service cinder] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:48.292083 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91387eb7-4b47-47fb-a7de-bdec4a16a07a service cinder] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:48.292370 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91387eb7-4b47-47fb-a7de-bdec4a16a07a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:48.292545 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1f14f0-34b7-4940-bf25-9a54c47c6c77 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:48.298335 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ef38d5-793e-4dc8-9ac1-ec5d5414dc80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:48.299320 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ef38d5-793e-4dc8-9ac1-ec5d5414dc80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:48.305673 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ef38d5-793e-4dc8-9ac1-ec5d5414dc80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:48.306076 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ef38d5-793e-4dc8-9ac1-ec5d5414dc80 admin admin] PATH_INFO: `/v3/projects/7f7518d5261245099a82e1e46834351f` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:48.307518 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ef38d5-793e-4dc8-9ac1-ec5d5414dc80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f7518d5261245099a82e1e46834351f)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:48.308590 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91387eb7-4b47-47fb-a7de-bdec4a16a07a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:48.310762 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ef38d5-793e-4dc8-9ac1-ec5d5414dc80 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:48.341606 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91387eb7-4b47-47fb-a7de-bdec4a16a07a service cinder] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:48.379706 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 974/1930] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:38:48 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:38:48.429926 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:38:48.439440 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91387eb7-4b47-47fb-a7de-bdec4a16a07a service cinder] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:48.440185 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-f6ef38d5-793e-4dc8-9ac1-ec5d5414dc80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f7518d5261245099a82e1e46834351f', 'request_id': 'req-f6ef38d5-793e-4dc8-9ac1-ec5d5414dc80'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:48.455020 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91387eb7-4b47-47fb-a7de-bdec4a16a07a service cinder] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:48.459874 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-f6ef38d5-793e-4dc8-9ac1-ec5d5414dc80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f7518d5261245099a82e1e46834351f', 'request_id': 'req-f6ef38d5-793e-4dc8-9ac1-ec5d5414dc80'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:48.468154 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-f6ef38d5-793e-4dc8-9ac1-ec5d5414dc80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f7518d5261245099a82e1e46834351f', 'request_id': 'req-f6ef38d5-793e-4dc8-9ac1-ec5d5414dc80'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:48.483202 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-f6ef38d5-793e-4dc8-9ac1-ec5d5414dc80 admin admin] The token cache is being invalidate because project 7f7518d5261245099a82e1e46834351f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 09:38:48.483668 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-f6ef38d5-793e-4dc8-9ac1-ec5d5414dc80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:48.485067 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-f6ef38d5-793e-4dc8-9ac1-ec5d5414dc80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:48.490236 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 957/1931] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 14 09:38:48 2022] DELETE /identity/v3/projects/7f7518d5261245099a82e1e46834351f => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 09:38:48.493791 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28cb247-a1b3-4548-85de-46aaa5e16192 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:48.494999 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28cb247-a1b3-4548-85de-46aaa5e16192 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:48.495911 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28cb247-a1b3-4548-85de-46aaa5e16192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:48.530454 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-f28cb247-a1b3-4548-85de-46aaa5e16192 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:38:48.531851 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-f28cb247-a1b3-4548-85de-46aaa5e16192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:48.559606 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906b6134-4368-44fb-a09f-b27734fdd8f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:48.559606 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906b6134-4368-44fb-a09f-b27734fdd8f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:48.559606 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906b6134-4368-44fb-a09f-b27734fdd8f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:48.559606 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906b6134-4368-44fb-a09f-b27734fdd8f2 admin admin] PATH_INFO: `/v3/users/99dc258f96ae47da9385043e61766153` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:48.560035 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906b6134-4368-44fb-a09f-b27734fdd8f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=99dc258f96ae47da9385043e61766153)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:48.561818 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906b6134-4368-44fb-a09f-b27734fdd8f2 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:48.628995 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 958/1932] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:38:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:38:48.630829 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a8366c-311c-445f-88fd-b9b9b77a9cf2 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:48.631229 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a8366c-311c-445f-88fd-b9b9b77a9cf2 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:48.631491 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a8366c-311c-445f-88fd-b9b9b77a9cf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:48.636270 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-906b6134-4368-44fb-a09f-b27734fdd8f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99dc258f96ae47da9385043e61766153'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:48.638576 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:38:48.670877 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-77a8366c-311c-445f-88fd-b9b9b77a9cf2 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:38:48.672042 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-77a8366c-311c-445f-88fd-b9b9b77a9cf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:48.677488 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-906b6134-4368-44fb-a09f-b27734fdd8f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99dc258f96ae47da9385043e61766153'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:48.678544 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-906b6134-4368-44fb-a09f-b27734fdd8f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99dc258f96ae47da9385043e61766153'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:48.685571 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 959/1933] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:38:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:38:48.690544 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-906b6134-4368-44fb-a09f-b27734fdd8f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99dc258f96ae47da9385043e61766153'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:48.695594 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a8366c-311c-445f-88fd-b9b9b77a9cf2 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:48.702681 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-906b6134-4368-44fb-a09f-b27734fdd8f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99dc258f96ae47da9385043e61766153'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:48.712024 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a8366c-311c-445f-88fd-b9b9b77a9cf2 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:48.714997 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 975/1934] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 14 09:38:48 2022] DELETE /identity/v3/users/99dc258f96ae47da9385043e61766153 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:38:48.720185 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7b7a03-26cd-4cc0-9654-3ea93fa2ba72 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:48.720185 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7b7a03-26cd-4cc0-9654-3ea93fa2ba72 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:48.720646 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7b7a03-26cd-4cc0-9654-3ea93fa2ba72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:48.777000 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-de7b7a03-26cd-4cc0-9654-3ea93fa2ba72 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:38:48.779264 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-de7b7a03-26cd-4cc0-9654-3ea93fa2ba72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:48.793370 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b6a132-90a4-441a-9343-a1e0fb208635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:48.793764 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b6a132-90a4-441a-9343-a1e0fb208635 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:48.794178 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b6a132-90a4-441a-9343-a1e0fb208635 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:48.794592 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b6a132-90a4-441a-9343-a1e0fb208635 admin admin] PATH_INFO: `/v3/domains` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:48.795539 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b6a132-90a4-441a-9343-a1e0fb208635 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:38:48.795928 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b6a132-90a4-441a-9343-a1e0fb208635 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:48.797887 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b6a132-90a4-441a-9343-a1e0fb208635 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:48.814435 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 960/1935] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jul 14 09:38:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:38:48.821978 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b6a132-90a4-441a-9343-a1e0fb208635 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:48.825455 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-85b6a132-90a4-441a-9343-a1e0fb208635 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:48.842477 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b6a132-90a4-441a-9343-a1e0fb208635 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:48.850391 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6419da36-e906-4a32-aad8-d85779b11745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:48.850391 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6419da36-e906-4a32-aad8-d85779b11745 admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:48.850391 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6419da36-e906-4a32-aad8-d85779b11745 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:48.850391 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6419da36-e906-4a32-aad8-d85779b11745 admin admin] PATH_INFO: `/v3/projects` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:48.850931 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6419da36-e906-4a32-aad8-d85779b11745 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:48.852603 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6419da36-e906-4a32-aad8-d85779b11745 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:48.886722 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 961/1936] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 14 09:38:48 2022] POST /identity/v3/projects => generated 367 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:38:48.888159 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6419da36-e906-4a32-aad8-d85779b11745 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:48.890402 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 976/1937] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:38:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 09:38:48.903209 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7b7a03-26cd-4cc0-9654-3ea93fa2ba72 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:48.904600 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-de7b7a03-26cd-4cc0-9654-3ea93fa2ba72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:48.941768 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:38:48.974311 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6419da36-e906-4a32-aad8-d85779b11745 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:48.979593 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52328a83-28de-453a-859f-f1e75bdb9c14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:48.980498 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52328a83-28de-453a-859f-f1e75bdb9c14 admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:48.981608 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52328a83-28de-453a-859f-f1e75bdb9c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:48.982050 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52328a83-28de-453a-859f-f1e75bdb9c14 admin admin] PATH_INFO: `/v3/users` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:48.982790 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52328a83-28de-453a-859f-f1e75bdb9c14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:48.984660 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7b7a03-26cd-4cc0-9654-3ea93fa2ba72 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:48.984804 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52328a83-28de-453a-859f-f1e75bdb9c14 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:49.006455 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 962/1938] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 14 09:38:48 2022] POST /identity/v3/users => generated 284 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 09:38:49.010763 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52328a83-28de-453a-859f-f1e75bdb9c14 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:49.020767 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52328a83-28de-453a-859f-f1e75bdb9c14 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:49.025415 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdb2f24-1ce8-445c-bde9-e2cb952dc744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:49.026076 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdb2f24-1ce8-445c-bde9-e2cb952dc744 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:49.026399 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdb2f24-1ce8-445c-bde9-e2cb952dc744 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:49.026686 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdb2f24-1ce8-445c-bde9-e2cb952dc744 admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:49.027416 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdb2f24-1ce8-445c-bde9-e2cb952dc744 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:49.029074 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdb2f24-1ce8-445c-bde9-e2cb952dc744 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:49.034268 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ef8d38-91c8-495a-9e55-6bf0eea322fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e4a5a8965e4802a9055d332179b7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:49.034925 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ef8d38-91c8-495a-9e55-6bf0eea322fc service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:49.035209 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ef8d38-91c8-495a-9e55-6bf0eea322fc service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:49.035487 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ef8d38-91c8-495a-9e55-6bf0eea322fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:49.039848 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 963/1939] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 09:38:49 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 09:38:49.044223 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdb2f24-1ce8-445c-bde9-e2cb952dc744 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:49.046207 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ef8d38-91c8-495a-9e55-6bf0eea322fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:49.047865 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ef8d38-91c8-495a-9e55-6bf0eea322fc service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:49.054101 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdb2f24-1ce8-445c-bde9-e2cb952dc744 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:49.059620 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b34a4d7-2185-411f-ade6-a2e027047fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:49.060246 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 977/1940] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:38:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 09:38:49.060369 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b34a4d7-2185-411f-ade6-a2e027047fe7 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:49.060634 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b34a4d7-2185-411f-ade6-a2e027047fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:49.060929 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b34a4d7-2185-411f-ade6-a2e027047fe7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:49.061663 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b34a4d7-2185-411f-ade6-a2e027047fe7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:49.063331 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b34a4d7-2185-411f-ade6-a2e027047fe7 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:49.075953 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 964/1941] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 09:38:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 09:38:49.085388 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ef8d38-91c8-495a-9e55-6bf0eea322fc service neutron] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:49.096738 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ef8d38-91c8-495a-9e55-6bf0eea322fc service neutron] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:49.102246 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace7dda3-fc07-4a59-8c03-c0ed64fd5209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:49.103188 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace7dda3-fc07-4a59-8c03-c0ed64fd5209 admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:49.103455 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace7dda3-fc07-4a59-8c03-c0ed64fd5209 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:49.103740 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace7dda3-fc07-4a59-8c03-c0ed64fd5209 admin admin] PATH_INFO: `/v3/projects/3bba8dbdcb334750a0dcfdd5b76f1daa/users/7c532eca4d294a51b43e057f9f61d756/roles/17dfac38a2e540fea229af7de99911bb` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:49.122360 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace7dda3-fc07-4a59-8c03-c0ed64fd5209 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bba8dbdcb334750a0dcfdd5b76f1daa, user_id=7c532eca4d294a51b43e057f9f61d756, role_id=17dfac38a2e540fea229af7de99911bb)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:49.125443 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace7dda3-fc07-4a59-8c03-c0ed64fd5209 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:49.143269 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:38:49.151803 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 978/1942] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 14 09:38:49 2022] PUT /identity/v3/projects/3bba8dbdcb334750a0dcfdd5b76f1daa/users/7c532eca4d294a51b43e057f9f61d756/roles/17dfac38a2e540fea229af7de99911bb => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:38:49.162704 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87b52cd-26ea-423f-a86c-674a6b5ace06 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:49.162998 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87b52cd-26ea-423f-a86c-674a6b5ace06 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:49.163276 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87b52cd-26ea-423f-a86c-674a6b5ace06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:49.202764 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-b87b52cd-26ea-423f-a86c-674a6b5ace06 None None] MFA Rules not processed for user `7c532eca4d294a51b43e057f9f61d756`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:38:49.203910 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-b87b52cd-26ea-423f-a86c-674a6b5ace06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:49.276733 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 965/1943] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:38:49 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:38:49.281918 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace7dda3-fc07-4a59-8c03-c0ed64fd5209 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:49.370753 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87b52cd-26ea-423f-a86c-674a6b5ace06 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:49.372595 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-b87b52cd-26ea-423f-a86c-674a6b5ace06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:49.374401 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace7dda3-fc07-4a59-8c03-c0ed64fd5209 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:49.381684 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31778423-1ceb-4c44-8e3f-b2cdbdd65d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:49.382754 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31778423-1ceb-4c44-8e3f-b2cdbdd65d0b admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:49.383088 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31778423-1ceb-4c44-8e3f-b2cdbdd65d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:49.383374 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31778423-1ceb-4c44-8e3f-b2cdbdd65d0b admin admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:49.384092 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31778423-1ceb-4c44-8e3f-b2cdbdd65d0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:49.386555 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31778423-1ceb-4c44-8e3f-b2cdbdd65d0b admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:49.392848 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87b52cd-26ea-423f-a86c-674a6b5ace06 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:49.398573 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf68ead8-ffa2-4fe0-8793-354521da6b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:49.400224 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf68ead8-ffa2-4fe0-8793-354521da6b32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:49.400657 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf68ead8-ffa2-4fe0-8793-354521da6b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:49.401190 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf68ead8-ffa2-4fe0-8793-354521da6b32 admin admin] PATH_INFO: `/v3/projects/0acba9c7aa9b4e1d9ba23c9709f07657` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:49.404072 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf68ead8-ffa2-4fe0-8793-354521da6b32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0acba9c7aa9b4e1d9ba23c9709f07657)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:49.408332 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf68ead8-ffa2-4fe0-8793-354521da6b32 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:49.422854 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 979/1944] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 14 09:38:49 2022] POST /identity/v3/projects => generated 365 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:38:49.427411 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31778423-1ceb-4c44-8e3f-b2cdbdd65d0b admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:49.495889 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-cf68ead8-ffa2-4fe0-8793-354521da6b32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0acba9c7aa9b4e1d9ba23c9709f07657', 'request_id': 'req-cf68ead8-ffa2-4fe0-8793-354521da6b32'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:49.511818 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-cf68ead8-ffa2-4fe0-8793-354521da6b32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0acba9c7aa9b4e1d9ba23c9709f07657', 'request_id': 'req-cf68ead8-ffa2-4fe0-8793-354521da6b32'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:49.520585 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-cf68ead8-ffa2-4fe0-8793-354521da6b32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0acba9c7aa9b4e1d9ba23c9709f07657', 'request_id': 'req-cf68ead8-ffa2-4fe0-8793-354521da6b32'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:49.535929 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-cf68ead8-ffa2-4fe0-8793-354521da6b32 admin admin] The token cache is being invalidate because project 0acba9c7aa9b4e1d9ba23c9709f07657 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 09:38:49.536372 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-cf68ead8-ffa2-4fe0-8793-354521da6b32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:49.537162 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-cf68ead8-ffa2-4fe0-8793-354521da6b32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:49.538937 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 966/1945] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 14 09:38:49 2022] DELETE /identity/v3/projects/0acba9c7aa9b4e1d9ba23c9709f07657 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:38:49.542740 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf68ead8-ffa2-4fe0-8793-354521da6b32 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:49.544725 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-cf68ead8-ffa2-4fe0-8793-354521da6b32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:49.551645 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31778423-1ceb-4c44-8e3f-b2cdbdd65d0b admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:49.563027 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:38:49.621700 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e202f6cf-cdd1-417f-9846-f5543fe94eeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:49.622734 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e202f6cf-cdd1-417f-9846-f5543fe94eeb admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:49.623102 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e202f6cf-cdd1-417f-9846-f5543fe94eeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:49.623390 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e202f6cf-cdd1-417f-9846-f5543fe94eeb admin admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:49.624177 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e202f6cf-cdd1-417f-9846-f5543fe94eeb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:49.624893 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf68ead8-ffa2-4fe0-8793-354521da6b32 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:49.628799 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e202f6cf-cdd1-417f-9846-f5543fe94eeb admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:49.630921 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834666ab-3cd9-4a13-b255-2fb316f7dafe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:49.631836 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834666ab-3cd9-4a13-b255-2fb316f7dafe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:49.632119 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834666ab-3cd9-4a13-b255-2fb316f7dafe admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:49.632395 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834666ab-3cd9-4a13-b255-2fb316f7dafe admin admin] PATH_INFO: `/v3/users/de69ef62665f4236af27fb97904d13bf` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:49.633723 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834666ab-3cd9-4a13-b255-2fb316f7dafe admin admin] RBAC: Authorizing `identity:delete_user(user_id=de69ef62665f4236af27fb97904d13bf)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:49.644107 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834666ab-3cd9-4a13-b255-2fb316f7dafe admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:49.663193 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 980/1946] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 14 09:38:49 2022] POST /identity/v3/users => generated 289 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:38:49.667196 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e202f6cf-cdd1-417f-9846-f5543fe94eeb admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:49.669097 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-e202f6cf-cdd1-417f-9846-f5543fe94eeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:49.685754 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e202f6cf-cdd1-417f-9846-f5543fe94eeb admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:49.693100 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47175bab-894a-40a1-b123-16d29c67888e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:49.694012 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47175bab-894a-40a1-b123-16d29c67888e admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:49.694404 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47175bab-894a-40a1-b123-16d29c67888e admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:49.694894 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47175bab-894a-40a1-b123-16d29c67888e admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:49.695729 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47175bab-894a-40a1-b123-16d29c67888e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:49.697593 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47175bab-894a-40a1-b123-16d29c67888e admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:49.710617 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 981/1947] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 09:38:49 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:38:49.716234 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47175bab-894a-40a1-b123-16d29c67888e admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:49.719982 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-834666ab-3cd9-4a13-b255-2fb316f7dafe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de69ef62665f4236af27fb97904d13bf'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:49.727774 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-834666ab-3cd9-4a13-b255-2fb316f7dafe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de69ef62665f4236af27fb97904d13bf'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:49.728648 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-834666ab-3cd9-4a13-b255-2fb316f7dafe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de69ef62665f4236af27fb97904d13bf'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:49.728834 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47175bab-894a-40a1-b123-16d29c67888e admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:49.735962 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4f3a4a-cf05-4756-807e-6cf77860803d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:49.737012 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4f3a4a-cf05-4756-807e-6cf77860803d admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:49.737302 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4f3a4a-cf05-4756-807e-6cf77860803d admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:49.737588 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4f3a4a-cf05-4756-807e-6cf77860803d admin admin] PATH_INFO: `/v3/projects/eccaf23ab2c8430dbb4be7e15949bc96/users/34c52a0272c648f08060eba7a8193565/roles/e3965bd0d5f1427a86a313c0c90bfef3` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:49.738308 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-834666ab-3cd9-4a13-b255-2fb316f7dafe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de69ef62665f4236af27fb97904d13bf'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:49.739316 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-834666ab-3cd9-4a13-b255-2fb316f7dafe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de69ef62665f4236af27fb97904d13bf'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:49.749641 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:38:49.758139 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 967/1948] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 14 09:38:49 2022] DELETE /identity/v3/users/de69ef62665f4236af27fb97904d13bf => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 09:38:49.760630 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4f3a4a-cf05-4756-807e-6cf77860803d admin admin] RBAC: Authorizing `identity:create_grant(project_id=eccaf23ab2c8430dbb4be7e15949bc96, user_id=34c52a0272c648f08060eba7a8193565, role_id=e3965bd0d5f1427a86a313c0c90bfef3)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:49.764031 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4f3a4a-cf05-4756-807e-6cf77860803d admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:49.783663 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 982/1949] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 14 09:38:49 2022] PUT /identity/v3/projects/eccaf23ab2c8430dbb4be7e15949bc96/users/34c52a0272c648f08060eba7a8193565/roles/e3965bd0d5f1427a86a313c0c90bfef3 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:38:49.787801 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834666ab-3cd9-4a13-b255-2fb316f7dafe admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:49.789467 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-834666ab-3cd9-4a13-b255-2fb316f7dafe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:49.890030 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834666ab-3cd9-4a13-b255-2fb316f7dafe admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:49.945281 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:38:49.990731 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b540a2-1c40-4af6-bc60-74555ba6fc85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:49.991442 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b540a2-1c40-4af6-bc60-74555ba6fc85 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:49.991693 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b540a2-1c40-4af6-bc60-74555ba6fc85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:49.991977 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b540a2-1c40-4af6-bc60-74555ba6fc85 admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:49.992792 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b540a2-1c40-4af6-bc60-74555ba6fc85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:49.998520 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b540a2-1c40-4af6-bc60-74555ba6fc85 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:50.022239 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 968/1950] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 09:38:49 2022] GET /identity/v3/roles => generated 1420 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 09:38:50.024035 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4f3a4a-cf05-4756-807e-6cf77860803d admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:50.035512 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4f3a4a-cf05-4756-807e-6cf77860803d admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:50.040805 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d03aac9-db59-4715-8219-acaa9aeb45b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:50.041717 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d03aac9-db59-4715-8219-acaa9aeb45b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:50.042006 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d03aac9-db59-4715-8219-acaa9aeb45b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:50.042341 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d03aac9-db59-4715-8219-acaa9aeb45b0 admin admin] PATH_INFO: `/v3/projects/eccaf23ab2c8430dbb4be7e15949bc96/users/34c52a0272c648f08060eba7a8193565/roles/e3965bd0d5f1427a86a313c0c90bfef3` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:50.045143 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d03aac9-db59-4715-8219-acaa9aeb45b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eccaf23ab2c8430dbb4be7e15949bc96, user_id=34c52a0272c648f08060eba7a8193565, role_id=e3965bd0d5f1427a86a313c0c90bfef3)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:50.047998 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d03aac9-db59-4715-8219-acaa9aeb45b0 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:50.072022 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 983/1951] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 14 09:38:50 2022] PUT /identity/v3/projects/eccaf23ab2c8430dbb4be7e15949bc96/users/34c52a0272c648f08060eba7a8193565/roles/e3965bd0d5f1427a86a313c0c90bfef3 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:38:50.081848 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d368f32-0f5b-44b1-8748-4df302fd659e None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:50.082142 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d368f32-0f5b-44b1-8748-4df302fd659e None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:50.082451 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d368f32-0f5b-44b1-8748-4df302fd659e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:50.122223 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-7d368f32-0f5b-44b1-8748-4df302fd659e None None] MFA Rules not processed for user `34c52a0272c648f08060eba7a8193565`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:38:50.123469 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-7d368f32-0f5b-44b1-8748-4df302fd659e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:50.143325 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d03aac9-db59-4715-8219-acaa9aeb45b0 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:50.165165 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-8d03aac9-db59-4715-8219-acaa9aeb45b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:50.249220 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 969/1952] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:38:50 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:38:50.263262 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d368f32-0f5b-44b1-8748-4df302fd659e None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:50.265154 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-7d368f32-0f5b-44b1-8748-4df302fd659e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:50.284144 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d03aac9-db59-4715-8219-acaa9aeb45b0 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:50.289175 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a84990d-8620-40a8-8451-d11acd63cbbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:50.290088 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a84990d-8620-40a8-8451-d11acd63cbbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:50.290417 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a84990d-8620-40a8-8451-d11acd63cbbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:50.290772 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a84990d-8620-40a8-8451-d11acd63cbbf admin admin] PATH_INFO: `/v3/projects/4821f93006444deaa89cc854f3c47b41` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:50.294883 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a84990d-8620-40a8-8451-d11acd63cbbf admin admin] RBAC: Authorizing `identity:delete_project(project_id=4821f93006444deaa89cc854f3c47b41)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:50.297042 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a84990d-8620-40a8-8451-d11acd63cbbf admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:50.354796 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d368f32-0f5b-44b1-8748-4df302fd659e None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:50.360569 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-0a84990d-8620-40a8-8451-d11acd63cbbf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4821f93006444deaa89cc854f3c47b41', 'request_id': 'req-0a84990d-8620-40a8-8451-d11acd63cbbf'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:50.367192 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-0a84990d-8620-40a8-8451-d11acd63cbbf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4821f93006444deaa89cc854f3c47b41', 'request_id': 'req-0a84990d-8620-40a8-8451-d11acd63cbbf'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:50.373930 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-0a84990d-8620-40a8-8451-d11acd63cbbf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4821f93006444deaa89cc854f3c47b41', 'request_id': 'req-0a84990d-8620-40a8-8451-d11acd63cbbf'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:50.395109 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-0a84990d-8620-40a8-8451-d11acd63cbbf admin admin] The token cache is being invalidate because project 4821f93006444deaa89cc854f3c47b41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 09:38:50.395405 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-0a84990d-8620-40a8-8451-d11acd63cbbf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:50.396090 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-0a84990d-8620-40a8-8451-d11acd63cbbf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:50.397885 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 984/1953] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 14 09:38:50 2022] DELETE /identity/v3/projects/4821f93006444deaa89cc854f3c47b41 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 09:38:50.403044 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2063ccd8-e58e-43bd-b675-9b44d32fbfe6 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:50.403344 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2063ccd8-e58e-43bd-b675-9b44d32fbfe6 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:50.403626 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2063ccd8-e58e-43bd-b675-9b44d32fbfe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:50.414172 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f76b7d3-dbb9-4f50-b744-0cc5f36b626b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25048b29787d482783ebc944f1a7df65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:50.414956 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f76b7d3-dbb9-4f50-b744-0cc5f36b626b service cinder] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:50.415201 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f76b7d3-dbb9-4f50-b744-0cc5f36b626b service cinder] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:50.415605 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f76b7d3-dbb9-4f50-b744-0cc5f36b626b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:50.418410 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-4f76b7d3-dbb9-4f50-b744-0cc5f36b626b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:50.422388 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-2063ccd8-e58e-43bd-b675-9b44d32fbfe6 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:38:50.423576 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-2063ccd8-e58e-43bd-b675-9b44d32fbfe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:50.463031 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:38:50.502829 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 985/1954] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:38:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 09:38:50.513149 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa46bb4-4969-4530-8d92-a342007a4722 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:50.513448 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa46bb4-4969-4530-8d92-a342007a4722 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:50.513738 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa46bb4-4969-4530-8d92-a342007a4722 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:50.516393 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f76b7d3-dbb9-4f50-b744-0cc5f36b626b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:50.517932 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f76b7d3-dbb9-4f50-b744-0cc5f36b626b service cinder] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:50.522277 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:38:50.538067 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 970/1955] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:38:50 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 09:38:50.542678 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-dfa46bb4-4969-4530-8d92-a342007a4722 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:38:50.544247 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-dfa46bb4-4969-4530-8d92-a342007a4722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:50.562912 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 986/1956] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:38:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 09:38:50.567268 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f76b7d3-dbb9-4f50-b744-0cc5f36b626b service cinder] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:50.583683 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f76b7d3-dbb9-4f50-b744-0cc5f36b626b service cinder] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:50.591297 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee3434f-a98e-466f-b0e3-407157ffa764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:50.592217 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee3434f-a98e-466f-b0e3-407157ffa764 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:50.592771 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee3434f-a98e-466f-b0e3-407157ffa764 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:50.593683 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee3434f-a98e-466f-b0e3-407157ffa764 admin admin] PATH_INFO: `/v3/domains` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:50.594836 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee3434f-a98e-466f-b0e3-407157ffa764 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:38:50.595287 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee3434f-a98e-466f-b0e3-407157ffa764 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:50.597068 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee3434f-a98e-466f-b0e3-407157ffa764 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:50.614250 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 971/1957] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jul 14 09:38:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:38:50.615901 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa46bb4-4969-4530-8d92-a342007a4722 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:50.630356 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa46bb4-4969-4530-8d92-a342007a4722 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:50.635365 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2991f3-da2c-45f6-aba1-5a53268155b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:50.636172 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2991f3-da2c-45f6-aba1-5a53268155b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:50.637458 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2991f3-da2c-45f6-aba1-5a53268155b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:50.638181 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2991f3-da2c-45f6-aba1-5a53268155b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:50.639526 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2991f3-da2c-45f6-aba1-5a53268155b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:50.641730 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2991f3-da2c-45f6-aba1-5a53268155b7 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:50.650654 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee3434f-a98e-466f-b0e3-407157ffa764 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:50.653046 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-2ee3434f-a98e-466f-b0e3-407157ffa764 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:50.669329 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee3434f-a98e-466f-b0e3-407157ffa764 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:50.676643 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843f44ab-d30d-47e0-bdf9-8798e2db9efc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25048b29787d482783ebc944f1a7df65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:50.676643 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843f44ab-d30d-47e0-bdf9-8798e2db9efc service cinder] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:50.676643 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843f44ab-d30d-47e0-bdf9-8798e2db9efc service cinder] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:50.676643 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843f44ab-d30d-47e0-bdf9-8798e2db9efc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:50.677676 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-843f44ab-d30d-47e0-bdf9-8798e2db9efc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:50.681041 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 987/1958] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 14 09:38:50 2022] POST /identity/v3/projects => generated 381 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:38:50.682009 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2991f3-da2c-45f6-aba1-5a53268155b7 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:50.759360 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843f44ab-d30d-47e0-bdf9-8798e2db9efc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:50.760773 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843f44ab-d30d-47e0-bdf9-8798e2db9efc service cinder] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:50.764253 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2991f3-da2c-45f6-aba1-5a53268155b7 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:50.769078 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468b55cc-a0cd-4332-a8c7-0b945753cd1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:50.769759 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468b55cc-a0cd-4332-a8c7-0b945753cd1e admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:50.770047 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468b55cc-a0cd-4332-a8c7-0b945753cd1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:50.770365 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468b55cc-a0cd-4332-a8c7-0b945753cd1e admin admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:50.770485 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 972/1959] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:38:50 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 09:38:50.771064 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468b55cc-a0cd-4332-a8c7-0b945753cd1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:50.773081 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468b55cc-a0cd-4332-a8c7-0b945753cd1e admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:50.797112 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 988/1960] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 14 09:38:50 2022] POST /identity/v3/users => generated 291 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 09:38:50.798298 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843f44ab-d30d-47e0-bdf9-8798e2db9efc service cinder] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:50.810210 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843f44ab-d30d-47e0-bdf9-8798e2db9efc service cinder] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:50.815026 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f29e7c6-c0e4-4926-bf5d-f509cb3e15f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:50.815701 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f29e7c6-c0e4-4926-bf5d-f509cb3e15f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:50.815990 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f29e7c6-c0e4-4926-bf5d-f509cb3e15f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:50.816272 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f29e7c6-c0e4-4926-bf5d-f509cb3e15f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:50.817004 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f29e7c6-c0e4-4926-bf5d-f509cb3e15f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:50.818672 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f29e7c6-c0e4-4926-bf5d-f509cb3e15f8 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:50.839025 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 973/1961] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 09:38:50 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 09:38:50.839493 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468b55cc-a0cd-4332-a8c7-0b945753cd1e admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:50.857262 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468b55cc-a0cd-4332-a8c7-0b945753cd1e admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:50.863129 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286311a3-26bb-4788-98f3-bc43a02d378f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:50.863826 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286311a3-26bb-4788-98f3-bc43a02d378f admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:50.864168 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286311a3-26bb-4788-98f3-bc43a02d378f admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:50.864383 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286311a3-26bb-4788-98f3-bc43a02d378f admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:50.865162 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286311a3-26bb-4788-98f3-bc43a02d378f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:50.866954 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286311a3-26bb-4788-98f3-bc43a02d378f admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:50.895583 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f29e7c6-c0e4-4926-bf5d-f509cb3e15f8 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:50.895976 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 989/1962] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 09:38:50 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:38:50.919138 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f29e7c6-c0e4-4926-bf5d-f509cb3e15f8 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:50.926934 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a173e78e-d903-4109-af12-fe146295f81f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:50.927967 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a173e78e-d903-4109-af12-fe146295f81f admin admin] REQUEST_METHOD: `PUT` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:50.928249 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a173e78e-d903-4109-af12-fe146295f81f admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:50.928530 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a173e78e-d903-4109-af12-fe146295f81f admin admin] PATH_INFO: `/v3/projects/c182b170e5a74c0e8250cde6df3aca35/users/9a2af205ddbe451e80d473b15fa195cf/roles/17dfac38a2e540fea229af7de99911bb` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:50.947428 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a173e78e-d903-4109-af12-fe146295f81f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c182b170e5a74c0e8250cde6df3aca35, user_id=9a2af205ddbe451e80d473b15fa195cf, role_id=17dfac38a2e540fea229af7de99911bb)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:50.951527 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a173e78e-d903-4109-af12-fe146295f81f admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:50.965835 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 974/1963] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 14 09:38:50 2022] PUT /identity/v3/projects/c182b170e5a74c0e8250cde6df3aca35/users/9a2af205ddbe451e80d473b15fa195cf/roles/17dfac38a2e540fea229af7de99911bb => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:38:50.980356 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40526b4a-7bfb-45ef-a0e9-f97b0e17ff5c None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:50.980741 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40526b4a-7bfb-45ef-a0e9-f97b0e17ff5c None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:50.981098 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40526b4a-7bfb-45ef-a0e9-f97b0e17ff5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:51.016518 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-40526b4a-7bfb-45ef-a0e9-f97b0e17ff5c None None] MFA Rules not processed for user `9a2af205ddbe451e80d473b15fa195cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:38:51.018072 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-40526b4a-7bfb-45ef-a0e9-f97b0e17ff5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:51.157220 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 990/1964] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:38:50 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:38:51.161500 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a173e78e-d903-4109-af12-fe146295f81f admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:51.326482 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a173e78e-d903-4109-af12-fe146295f81f admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:51.334012 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e3494a-6ec7-4d06-8028-2bfde83f92e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:51.335490 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e3494a-6ec7-4d06-8028-2bfde83f92e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:51.335490 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e3494a-6ec7-4d06-8028-2bfde83f92e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:51.335490 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e3494a-6ec7-4d06-8028-2bfde83f92e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:51.336416 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e3494a-6ec7-4d06-8028-2bfde83f92e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:51.347491 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e3494a-6ec7-4d06-8028-2bfde83f92e4 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:51.377394 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 975/1965] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 14 09:38:51 2022] POST /identity/v3/projects => generated 381 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 09:38:51.380799 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40526b4a-7bfb-45ef-a0e9-f97b0e17ff5c None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:51.392161 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40526b4a-7bfb-45ef-a0e9-f97b0e17ff5c None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:51.438941 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:38:51.457896 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520b146d-9df4-4429-9c81-565c29818d4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:51.458736 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520b146d-9df4-4429-9c81-565c29818d4e admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:51.459096 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520b146d-9df4-4429-9c81-565c29818d4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:51.459446 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520b146d-9df4-4429-9c81-565c29818d4e admin admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:51.460234 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520b146d-9df4-4429-9c81-565c29818d4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:51.462615 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520b146d-9df4-4429-9c81-565c29818d4e admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:51.484190 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 991/1966] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 14 09:38:51 2022] POST /identity/v3/users => generated 297 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:38:51.490715 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e3494a-6ec7-4d06-8028-2bfde83f92e4 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:51.498780 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:38:51.503551 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e3494a-6ec7-4d06-8028-2bfde83f92e4 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:51.508844 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71293259-1186-4743-bfb2-4f73da208de6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:51.509622 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71293259-1186-4743-bfb2-4f73da208de6 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:51.509977 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71293259-1186-4743-bfb2-4f73da208de6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:51.510372 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71293259-1186-4743-bfb2-4f73da208de6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:51.511213 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71293259-1186-4743-bfb2-4f73da208de6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:51.512930 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71293259-1186-4743-bfb2-4f73da208de6 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:51.525215 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 976/1967] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 09:38:51 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:38:51.530308 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520b146d-9df4-4429-9c81-565c29818d4e admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:51.541301 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520b146d-9df4-4429-9c81-565c29818d4e admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:51.546745 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894609c0-419a-481e-b2fc-c8c98148f777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:51.547642 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894609c0-419a-481e-b2fc-c8c98148f777 admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:51.547931 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894609c0-419a-481e-b2fc-c8c98148f777 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:51.548216 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894609c0-419a-481e-b2fc-c8c98148f777 admin admin] PATH_INFO: `/v3/projects/75b549f5d6b8454fa4dd420d72ed2120/users/2778be25636441f1ac9b58675b708275/roles/e3965bd0d5f1427a86a313c0c90bfef3` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:51.564639 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894609c0-419a-481e-b2fc-c8c98148f777 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75b549f5d6b8454fa4dd420d72ed2120, user_id=2778be25636441f1ac9b58675b708275, role_id=e3965bd0d5f1427a86a313c0c90bfef3)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:51.567365 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894609c0-419a-481e-b2fc-c8c98148f777 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:51.583099 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 992/1968] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 14 09:38:51 2022] PUT /identity/v3/projects/75b549f5d6b8454fa4dd420d72ed2120/users/2778be25636441f1ac9b58675b708275/roles/e3965bd0d5f1427a86a313c0c90bfef3 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:38:51.587091 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71293259-1186-4743-bfb2-4f73da208de6 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:51.599281 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71293259-1186-4743-bfb2-4f73da208de6 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:51.698281 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fca7e5-856e-48de-9e62-dca02c50cbce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:51.699001 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fca7e5-856e-48de-9e62-dca02c50cbce admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:51.699314 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fca7e5-856e-48de-9e62-dca02c50cbce admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:51.699593 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fca7e5-856e-48de-9e62-dca02c50cbce admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:51.700337 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fca7e5-856e-48de-9e62-dca02c50cbce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:51.701941 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fca7e5-856e-48de-9e62-dca02c50cbce admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:51.713509 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 977/1969] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 09:38:51 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:38:51.720876 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894609c0-419a-481e-b2fc-c8c98148f777 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:51.735729 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894609c0-419a-481e-b2fc-c8c98148f777 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:51.741263 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f76ee5-4534-4306-a8d6-468ff1df8b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:51.742173 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f76ee5-4534-4306-a8d6-468ff1df8b7b admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:51.743322 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f76ee5-4534-4306-a8d6-468ff1df8b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:51.743606 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f76ee5-4534-4306-a8d6-468ff1df8b7b admin admin] PATH_INFO: `/v3/projects/75b549f5d6b8454fa4dd420d72ed2120/users/2778be25636441f1ac9b58675b708275/roles/e3965bd0d5f1427a86a313c0c90bfef3` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:51.745769 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f76ee5-4534-4306-a8d6-468ff1df8b7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=75b549f5d6b8454fa4dd420d72ed2120, user_id=2778be25636441f1ac9b58675b708275, role_id=e3965bd0d5f1427a86a313c0c90bfef3)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:51.748588 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f76ee5-4534-4306-a8d6-468ff1df8b7b admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:51.761642 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 993/1970] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 14 09:38:51 2022] PUT /identity/v3/projects/75b549f5d6b8454fa4dd420d72ed2120/users/2778be25636441f1ac9b58675b708275/roles/e3965bd0d5f1427a86a313c0c90bfef3 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:38:51.774063 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5a8888-a460-4cf1-a403-973f61094d17 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:51.774637 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5a8888-a460-4cf1-a403-973f61094d17 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:51.774756 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5a8888-a460-4cf1-a403-973f61094d17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:51.804095 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-6e5a8888-a460-4cf1-a403-973f61094d17 None None] MFA Rules not processed for user `2778be25636441f1ac9b58675b708275`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:38:51.805328 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-6e5a8888-a460-4cf1-a403-973f61094d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:51.918719 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 978/1971] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:38:51 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:38:51.932829 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f76ee5-4534-4306-a8d6-468ff1df8b7b admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:51.996253 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f76ee5-4534-4306-a8d6-468ff1df8b7b admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:52.000589 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4923dc6c-4a3c-4909-9099-115d228ee225 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25048b29787d482783ebc944f1a7df65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:52.001583 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4923dc6c-4a3c-4909-9099-115d228ee225 service cinder] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:52.001583 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4923dc6c-4a3c-4909-9099-115d228ee225 service cinder] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:52.001776 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4923dc6c-4a3c-4909-9099-115d228ee225 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:52.022228 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4923dc6c-4a3c-4909-9099-115d228ee225 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:52.024266 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4923dc6c-4a3c-4909-9099-115d228ee225 service cinder] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:52.041201 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 994/1972] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:38:51 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:38:52.384474 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5a8888-a460-4cf1-a403-973f61094d17 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:52.394970 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5a8888-a460-4cf1-a403-973f61094d17 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:52.399857 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b79fd0-ae16-4e3b-937e-863d0ef90dcf tempest-VolumeQuotaClassesTest-1271020923 tempest-VolumeQuotaClassesTest-1271020923-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2778be25636441f1ac9b58675b708275', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75b549f5d6b8454fa4dd420d72ed2120', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:52.400522 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b79fd0-ae16-4e3b-937e-863d0ef90dcf tempest-VolumeQuotaClassesTest-1271020923 tempest-VolumeQuotaClassesTest-1271020923-project-admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:52.400815 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b79fd0-ae16-4e3b-937e-863d0ef90dcf tempest-VolumeQuotaClassesTest-1271020923 tempest-VolumeQuotaClassesTest-1271020923-project-admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:52.401099 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b79fd0-ae16-4e3b-937e-863d0ef90dcf tempest-VolumeQuotaClassesTest-1271020923 tempest-VolumeQuotaClassesTest-1271020923-project-admin] PATH_INFO: `/v3/domains` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:52.401867 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b79fd0-ae16-4e3b-937e-863d0ef90dcf tempest-VolumeQuotaClassesTest-1271020923 tempest-VolumeQuotaClassesTest-1271020923-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:38:52.402225 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b79fd0-ae16-4e3b-937e-863d0ef90dcf tempest-VolumeQuotaClassesTest-1271020923 tempest-VolumeQuotaClassesTest-1271020923-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:52.403806 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b79fd0-ae16-4e3b-937e-863d0ef90dcf tempest-VolumeQuotaClassesTest-1271020923 tempest-VolumeQuotaClassesTest-1271020923-project-admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:52.416626 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 979/1973] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jul 14 09:38:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:38:52.421042 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4923dc6c-4a3c-4909-9099-115d228ee225 service cinder] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:52.431047 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4923dc6c-4a3c-4909-9099-115d228ee225 service cinder] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:52.436168 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702d6dc2-3d2f-4573-9c8d-1a2ec687f9fc tempest-VolumeQuotaClassesTest-1271020923 tempest-VolumeQuotaClassesTest-1271020923-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2778be25636441f1ac9b58675b708275', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75b549f5d6b8454fa4dd420d72ed2120', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:52.436834 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702d6dc2-3d2f-4573-9c8d-1a2ec687f9fc tempest-VolumeQuotaClassesTest-1271020923 tempest-VolumeQuotaClassesTest-1271020923-project-admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:52.437123 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702d6dc2-3d2f-4573-9c8d-1a2ec687f9fc tempest-VolumeQuotaClassesTest-1271020923 tempest-VolumeQuotaClassesTest-1271020923-project-admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:52.437410 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702d6dc2-3d2f-4573-9c8d-1a2ec687f9fc tempest-VolumeQuotaClassesTest-1271020923 tempest-VolumeQuotaClassesTest-1271020923-project-admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:52.438106 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702d6dc2-3d2f-4573-9c8d-1a2ec687f9fc tempest-VolumeQuotaClassesTest-1271020923 tempest-VolumeQuotaClassesTest-1271020923-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:52.440037 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702d6dc2-3d2f-4573-9c8d-1a2ec687f9fc tempest-VolumeQuotaClassesTest-1271020923 tempest-VolumeQuotaClassesTest-1271020923-project-admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:52.465725 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 995/1974] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 14 09:38:52 2022] POST /identity/v3/projects => generated 355 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:38:52.470045 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b79fd0-ae16-4e3b-937e-863d0ef90dcf tempest-VolumeQuotaClassesTest-1271020923 tempest-VolumeQuotaClassesTest-1271020923-project-admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:52.480259 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b79fd0-ae16-4e3b-937e-863d0ef90dcf tempest-VolumeQuotaClassesTest-1271020923 tempest-VolumeQuotaClassesTest-1271020923-project-admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:52.540714 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bb6734-b40f-4c80-b033-b09fc9db3fda tempest-VolumeQuotaClassesTest-1271020923 tempest-VolumeQuotaClassesTest-1271020923-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2778be25636441f1ac9b58675b708275', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75b549f5d6b8454fa4dd420d72ed2120', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:52.541401 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bb6734-b40f-4c80-b033-b09fc9db3fda tempest-VolumeQuotaClassesTest-1271020923 tempest-VolumeQuotaClassesTest-1271020923-project-admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:52.541691 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bb6734-b40f-4c80-b033-b09fc9db3fda tempest-VolumeQuotaClassesTest-1271020923 tempest-VolumeQuotaClassesTest-1271020923-project-admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:52.541975 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bb6734-b40f-4c80-b033-b09fc9db3fda tempest-VolumeQuotaClassesTest-1271020923 tempest-VolumeQuotaClassesTest-1271020923-project-admin] PATH_INFO: `/v3/domains` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:52.542758 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bb6734-b40f-4c80-b033-b09fc9db3fda tempest-VolumeQuotaClassesTest-1271020923 tempest-VolumeQuotaClassesTest-1271020923-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:38:52.543128 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bb6734-b40f-4c80-b033-b09fc9db3fda tempest-VolumeQuotaClassesTest-1271020923 tempest-VolumeQuotaClassesTest-1271020923-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:52.544671 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bb6734-b40f-4c80-b033-b09fc9db3fda tempest-VolumeQuotaClassesTest-1271020923 tempest-VolumeQuotaClassesTest-1271020923-project-admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:52.547369 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:38:52.559107 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 980/1975] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jul 14 09:38:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:38:52.602596 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702d6dc2-3d2f-4573-9c8d-1a2ec687f9fc tempest-VolumeQuotaClassesTest-1271020923 tempest-VolumeQuotaClassesTest-1271020923-project-admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:52.613293 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702d6dc2-3d2f-4573-9c8d-1a2ec687f9fc tempest-VolumeQuotaClassesTest-1271020923 tempest-VolumeQuotaClassesTest-1271020923-project-admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:52.617882 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3430e629-c089-46d1-aead-16550027c3f5 tempest-VolumeQuotaClassesTest-1271020923 tempest-VolumeQuotaClassesTest-1271020923-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2778be25636441f1ac9b58675b708275', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75b549f5d6b8454fa4dd420d72ed2120', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:52.618794 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3430e629-c089-46d1-aead-16550027c3f5 tempest-VolumeQuotaClassesTest-1271020923 tempest-VolumeQuotaClassesTest-1271020923-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:52.619088 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3430e629-c089-46d1-aead-16550027c3f5 tempest-VolumeQuotaClassesTest-1271020923 tempest-VolumeQuotaClassesTest-1271020923-project-admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:52.619371 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3430e629-c089-46d1-aead-16550027c3f5 tempest-VolumeQuotaClassesTest-1271020923 tempest-VolumeQuotaClassesTest-1271020923-project-admin] PATH_INFO: `/v3/projects/bcd904f125bb4fb4ba4b8a20109e3e53` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:52.620596 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3430e629-c089-46d1-aead-16550027c3f5 tempest-VolumeQuotaClassesTest-1271020923 tempest-VolumeQuotaClassesTest-1271020923-project-admin] RBAC: Authorizing `identity:delete_project(project_id=bcd904f125bb4fb4ba4b8a20109e3e53)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:52.623823 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3430e629-c089-46d1-aead-16550027c3f5 tempest-VolumeQuotaClassesTest-1271020923 tempest-VolumeQuotaClassesTest-1271020923-project-admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:52.687978 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-3430e629-c089-46d1-aead-16550027c3f5 tempest-VolumeQuotaClassesTest-1271020923 tempest-VolumeQuotaClassesTest-1271020923-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bcd904f125bb4fb4ba4b8a20109e3e53', 'request_id': 'req-3430e629-c089-46d1-aead-16550027c3f5'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:52.696772 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-3430e629-c089-46d1-aead-16550027c3f5 tempest-VolumeQuotaClassesTest-1271020923 tempest-VolumeQuotaClassesTest-1271020923-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bcd904f125bb4fb4ba4b8a20109e3e53', 'request_id': 'req-3430e629-c089-46d1-aead-16550027c3f5'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:52.703546 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-3430e629-c089-46d1-aead-16550027c3f5 tempest-VolumeQuotaClassesTest-1271020923 tempest-VolumeQuotaClassesTest-1271020923-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bcd904f125bb4fb4ba4b8a20109e3e53', 'request_id': 'req-3430e629-c089-46d1-aead-16550027c3f5'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:52.720059 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=86,keystone:INSERT=7,keystone:DELETE=7 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:38:52.725324 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-3430e629-c089-46d1-aead-16550027c3f5 tempest-VolumeQuotaClassesTest-1271020923 tempest-VolumeQuotaClassesTest-1271020923-project-admin] The token cache is being invalidate because project bcd904f125bb4fb4ba4b8a20109e3e53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 09:38:52.725950 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-3430e629-c089-46d1-aead-16550027c3f5 tempest-VolumeQuotaClassesTest-1271020923 tempest-VolumeQuotaClassesTest-1271020923-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:52.728121 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-3430e629-c089-46d1-aead-16550027c3f5 tempest-VolumeQuotaClassesTest-1271020923 tempest-VolumeQuotaClassesTest-1271020923-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:52.730242 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 996/1976] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 14 09:38:52 2022] DELETE /identity/v3/projects/bcd904f125bb4fb4ba4b8a20109e3e53 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:38:52.971350 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bb6734-b40f-4c80-b033-b09fc9db3fda tempest-VolumeQuotaClassesTest-1271020923 tempest-VolumeQuotaClassesTest-1271020923-project-admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:52.973495 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-c6bb6734-b40f-4c80-b033-b09fc9db3fda tempest-VolumeQuotaClassesTest-1271020923 tempest-VolumeQuotaClassesTest-1271020923-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:53.086054 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bb6734-b40f-4c80-b033-b09fc9db3fda tempest-VolumeQuotaClassesTest-1271020923 tempest-VolumeQuotaClassesTest-1271020923-project-admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:53.160592 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed26f190-4508-497a-92a6-c08d5fe2692c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:53.161593 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed26f190-4508-497a-92a6-c08d5fe2692c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:53.162474 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed26f190-4508-497a-92a6-c08d5fe2692c admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:53.162760 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed26f190-4508-497a-92a6-c08d5fe2692c admin admin] PATH_INFO: `/v3/users/9a2af205ddbe451e80d473b15fa195cf` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:53.164536 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed26f190-4508-497a-92a6-c08d5fe2692c admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a2af205ddbe451e80d473b15fa195cf)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:53.166563 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed26f190-4508-497a-92a6-c08d5fe2692c admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:53.228098 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-ed26f190-4508-497a-92a6-c08d5fe2692c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a2af205ddbe451e80d473b15fa195cf'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:53.237019 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-ed26f190-4508-497a-92a6-c08d5fe2692c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a2af205ddbe451e80d473b15fa195cf'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:53.237813 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-ed26f190-4508-497a-92a6-c08d5fe2692c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a2af205ddbe451e80d473b15fa195cf'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:53.246840 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-ed26f190-4508-497a-92a6-c08d5fe2692c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a2af205ddbe451e80d473b15fa195cf'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:53.247468 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-ed26f190-4508-497a-92a6-c08d5fe2692c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a2af205ddbe451e80d473b15fa195cf'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:53.265667 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 981/1977] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 14 09:38:52 2022] DELETE /identity/v3/users/9a2af205ddbe451e80d473b15fa195cf => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:38:53.270698 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b84cc5e-cdca-4b1f-a24a-1785197b58bd None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:53.271200 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b84cc5e-cdca-4b1f-a24a-1785197b58bd None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:53.271334 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b84cc5e-cdca-4b1f-a24a-1785197b58bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:53.290319 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-8b84cc5e-cdca-4b1f-a24a-1785197b58bd None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:38:53.291557 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-8b84cc5e-cdca-4b1f-a24a-1785197b58bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:53.368147 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 997/1978] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:38:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 09:38:53.385188 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed26f190-4508-497a-92a6-c08d5fe2692c admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:53.388417 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-ed26f190-4508-497a-92a6-c08d5fe2692c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:53.456844 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:38:53.500272 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed26f190-4508-497a-92a6-c08d5fe2692c admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:53.503920 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cceb1f-0d33-413b-b0b1-592999d7db87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e4a5a8965e4802a9055d332179b7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:53.504579 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cceb1f-0d33-413b-b0b1-592999d7db87 service neutron] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:53.504864 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cceb1f-0d33-413b-b0b1-592999d7db87 service neutron] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:53.505145 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cceb1f-0d33-413b-b0b1-592999d7db87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:53.516672 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cceb1f-0d33-413b-b0b1-592999d7db87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:53.518295 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cceb1f-0d33-413b-b0b1-592999d7db87 service neutron] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:53.530714 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 982/1979] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:38:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:38:53.846857 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b84cc5e-cdca-4b1f-a24a-1785197b58bd None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:53.848349 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-8b84cc5e-cdca-4b1f-a24a-1785197b58bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:53.860760 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b84cc5e-cdca-4b1f-a24a-1785197b58bd None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:53.865571 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff552a6-3a8a-4ef7-95e6-06b1692b6bb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:53.866511 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff552a6-3a8a-4ef7-95e6-06b1692b6bb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:53.866804 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff552a6-3a8a-4ef7-95e6-06b1692b6bb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:53.867233 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff552a6-3a8a-4ef7-95e6-06b1692b6bb3 admin admin] PATH_INFO: `/v3/projects/c182b170e5a74c0e8250cde6df3aca35` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:53.868413 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff552a6-3a8a-4ef7-95e6-06b1692b6bb3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c182b170e5a74c0e8250cde6df3aca35)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:53.870400 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff552a6-3a8a-4ef7-95e6-06b1692b6bb3 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:53.918222 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-bff552a6-3a8a-4ef7-95e6-06b1692b6bb3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c182b170e5a74c0e8250cde6df3aca35', 'request_id': 'req-bff552a6-3a8a-4ef7-95e6-06b1692b6bb3'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:53.924468 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-bff552a6-3a8a-4ef7-95e6-06b1692b6bb3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c182b170e5a74c0e8250cde6df3aca35', 'request_id': 'req-bff552a6-3a8a-4ef7-95e6-06b1692b6bb3'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:53.930344 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-bff552a6-3a8a-4ef7-95e6-06b1692b6bb3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c182b170e5a74c0e8250cde6df3aca35', 'request_id': 'req-bff552a6-3a8a-4ef7-95e6-06b1692b6bb3'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:53.944215 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-bff552a6-3a8a-4ef7-95e6-06b1692b6bb3 admin admin] The token cache is being invalidate because project c182b170e5a74c0e8250cde6df3aca35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 09:38:53.944582 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-bff552a6-3a8a-4ef7-95e6-06b1692b6bb3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:53.945238 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-bff552a6-3a8a-4ef7-95e6-06b1692b6bb3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:53.946833 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 998/1980] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 14 09:38:53 2022] DELETE /identity/v3/projects/c182b170e5a74c0e8250cde6df3aca35 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:38:53.951434 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cceb1f-0d33-413b-b0b1-592999d7db87 service neutron] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:53.961223 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cceb1f-0d33-413b-b0b1-592999d7db87 service neutron] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:54.019783 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb27fa3-7261-4a43-accc-12d60672a2f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:54.020677 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb27fa3-7261-4a43-accc-12d60672a2f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:54.020965 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb27fa3-7261-4a43-accc-12d60672a2f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:54.021251 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb27fa3-7261-4a43-accc-12d60672a2f0 admin admin] PATH_INFO: `/v3/users/2778be25636441f1ac9b58675b708275` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:54.022492 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb27fa3-7261-4a43-accc-12d60672a2f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2778be25636441f1ac9b58675b708275)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:54.024416 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb27fa3-7261-4a43-accc-12d60672a2f0 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:54.072657 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-fcb27fa3-7261-4a43-accc-12d60672a2f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2778be25636441f1ac9b58675b708275'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:54.088531 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-fcb27fa3-7261-4a43-accc-12d60672a2f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2778be25636441f1ac9b58675b708275'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:54.089329 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-fcb27fa3-7261-4a43-accc-12d60672a2f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2778be25636441f1ac9b58675b708275'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:54.098020 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-fcb27fa3-7261-4a43-accc-12d60672a2f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2778be25636441f1ac9b58675b708275'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:54.098687 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-fcb27fa3-7261-4a43-accc-12d60672a2f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2778be25636441f1ac9b58675b708275'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:54.118898 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 983/1981] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 14 09:38:53 2022] DELETE /identity/v3/users/2778be25636441f1ac9b58675b708275 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:38:54.585598 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff552a6-3a8a-4ef7-95e6-06b1692b6bb3 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:54.590579 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-bff552a6-3a8a-4ef7-95e6-06b1692b6bb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:54.627572 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff552a6-3a8a-4ef7-95e6-06b1692b6bb3 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:54.695782 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16535ad4-6998-4dde-b261-90121ac639d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:54.696677 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16535ad4-6998-4dde-b261-90121ac639d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:54.697354 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16535ad4-6998-4dde-b261-90121ac639d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:54.697354 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16535ad4-6998-4dde-b261-90121ac639d8 admin admin] PATH_INFO: `/v3/projects/75b549f5d6b8454fa4dd420d72ed2120` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:54.698604 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16535ad4-6998-4dde-b261-90121ac639d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=75b549f5d6b8454fa4dd420d72ed2120)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:54.701048 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16535ad4-6998-4dde-b261-90121ac639d8 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:54.741958 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:38:54.763061 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-16535ad4-6998-4dde-b261-90121ac639d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75b549f5d6b8454fa4dd420d72ed2120', 'request_id': 'req-16535ad4-6998-4dde-b261-90121ac639d8'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:54.771090 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-16535ad4-6998-4dde-b261-90121ac639d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75b549f5d6b8454fa4dd420d72ed2120', 'request_id': 'req-16535ad4-6998-4dde-b261-90121ac639d8'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:54.778275 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-16535ad4-6998-4dde-b261-90121ac639d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75b549f5d6b8454fa4dd420d72ed2120', 'request_id': 'req-16535ad4-6998-4dde-b261-90121ac639d8'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:54.793685 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-16535ad4-6998-4dde-b261-90121ac639d8 admin admin] The token cache is being invalidate because project 75b549f5d6b8454fa4dd420d72ed2120 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 09:38:54.794069 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-16535ad4-6998-4dde-b261-90121ac639d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:54.795208 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-16535ad4-6998-4dde-b261-90121ac639d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:54.796920 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 999/1982] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 14 09:38:54 2022] DELETE /identity/v3/projects/75b549f5d6b8454fa4dd420d72ed2120 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:38:54.802869 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20b54ee-bae2-47a9-8e77-cf493a46821e None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:54.803506 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20b54ee-bae2-47a9-8e77-cf493a46821e None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:54.803952 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20b54ee-bae2-47a9-8e77-cf493a46821e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:54.829012 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-b20b54ee-bae2-47a9-8e77-cf493a46821e None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:38:54.830399 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-b20b54ee-bae2-47a9-8e77-cf493a46821e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:54.874775 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:38:54.906361 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 984/1983] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:38:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:38:54.912703 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d591396-24a5-4bf0-bb2e-d26b0a68ac0f None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:54.913003 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d591396-24a5-4bf0-bb2e-d26b0a68ac0f None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:54.913362 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d591396-24a5-4bf0-bb2e-d26b0a68ac0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:54.933392 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-2d591396-24a5-4bf0-bb2e-d26b0a68ac0f None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:38:54.934653 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-2d591396-24a5-4bf0-bb2e-d26b0a68ac0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:54.952719 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1000/1984] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:38:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:38:54.959039 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20b54ee-bae2-47a9-8e77-cf493a46821e None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:54.972181 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20b54ee-bae2-47a9-8e77-cf493a46821e None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:54.976775 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2828ae29-137a-487b-918a-4d92a55384e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:54.977472 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2828ae29-137a-487b-918a-4d92a55384e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:54.977756 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2828ae29-137a-487b-918a-4d92a55384e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:54.978028 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2828ae29-137a-487b-918a-4d92a55384e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:54.978803 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2828ae29-137a-487b-918a-4d92a55384e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:38:54.979109 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2828ae29-137a-487b-918a-4d92a55384e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:54.980787 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2828ae29-137a-487b-918a-4d92a55384e2 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:54.993019 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 985/1985] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jul 14 09:38:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:38:55.000586 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d591396-24a5-4bf0-bb2e-d26b0a68ac0f None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:55.014507 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d591396-24a5-4bf0-bb2e-d26b0a68ac0f None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:55.020470 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4803e61d-ab01-411e-9f81-f37fdd4bb490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:55.021455 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4803e61d-ab01-411e-9f81-f37fdd4bb490 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:55.021751 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4803e61d-ab01-411e-9f81-f37fdd4bb490 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:55.022030 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4803e61d-ab01-411e-9f81-f37fdd4bb490 admin admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:55.023058 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4803e61d-ab01-411e-9f81-f37fdd4bb490 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:55.026127 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4803e61d-ab01-411e-9f81-f37fdd4bb490 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:55.068293 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1001/1986] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 14 09:38:54 2022] POST /identity/v3/projects => generated 377 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:38:55.073432 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2828ae29-137a-487b-918a-4d92a55384e2 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:55.085436 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2828ae29-137a-487b-918a-4d92a55384e2 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:55.165965 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acccdfad-9cd0-4ea3-ba73-88a83b7b7b73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:55.167246 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acccdfad-9cd0-4ea3-ba73-88a83b7b7b73 admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:55.167700 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acccdfad-9cd0-4ea3-ba73-88a83b7b7b73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:55.167992 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acccdfad-9cd0-4ea3-ba73-88a83b7b7b73 admin admin] PATH_INFO: `/v3/users` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:55.168701 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acccdfad-9cd0-4ea3-ba73-88a83b7b7b73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:55.170913 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acccdfad-9cd0-4ea3-ba73-88a83b7b7b73 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:55.194785 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 986/1987] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 14 09:38:55 2022] POST /identity/v3/users => generated 289 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:38:55.200074 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4803e61d-ab01-411e-9f81-f37fdd4bb490 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:55.213434 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4803e61d-ab01-411e-9f81-f37fdd4bb490 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:55.220111 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708aeede-9074-4554-b617-061f49ae2966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:55.221738 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708aeede-9074-4554-b617-061f49ae2966 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:55.221893 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708aeede-9074-4554-b617-061f49ae2966 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:55.222210 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708aeede-9074-4554-b617-061f49ae2966 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:55.223958 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708aeede-9074-4554-b617-061f49ae2966 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:55.225255 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708aeede-9074-4554-b617-061f49ae2966 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:55.247828 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1002/1988] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 09:38:55 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 09:38:55.251904 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acccdfad-9cd0-4ea3-ba73-88a83b7b7b73 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:55.269043 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acccdfad-9cd0-4ea3-ba73-88a83b7b7b73 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:55.275328 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f98af38-fd2f-4bb2-a38d-daaa2ccc2d1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:55.276086 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f98af38-fd2f-4bb2-a38d-daaa2ccc2d1f admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:55.276444 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f98af38-fd2f-4bb2-a38d-daaa2ccc2d1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:55.276795 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f98af38-fd2f-4bb2-a38d-daaa2ccc2d1f admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:55.277599 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f98af38-fd2f-4bb2-a38d-daaa2ccc2d1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:55.279429 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f98af38-fd2f-4bb2-a38d-daaa2ccc2d1f admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:55.292465 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 987/1989] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 09:38:55 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:38:55.295065 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708aeede-9074-4554-b617-061f49ae2966 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:55.306305 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708aeede-9074-4554-b617-061f49ae2966 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:55.316807 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c278f1-9815-4a02-ac25-da1d7e378bd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:55.321521 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c278f1-9815-4a02-ac25-da1d7e378bd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:55.321749 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c278f1-9815-4a02-ac25-da1d7e378bd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:55.322236 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c278f1-9815-4a02-ac25-da1d7e378bd3 admin admin] PATH_INFO: `/v3/projects/43f9d20b5d7746698d16b0a43dafb756/users/12e3d71497cf438bbb270488b41c1fa1/roles/17dfac38a2e540fea229af7de99911bb` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:55.343760 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c278f1-9815-4a02-ac25-da1d7e378bd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43f9d20b5d7746698d16b0a43dafb756, user_id=12e3d71497cf438bbb270488b41c1fa1, role_id=17dfac38a2e540fea229af7de99911bb)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:55.346555 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c278f1-9815-4a02-ac25-da1d7e378bd3 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:55.361043 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1003/1990] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 14 09:38:55 2022] PUT /identity/v3/projects/43f9d20b5d7746698d16b0a43dafb756/users/12e3d71497cf438bbb270488b41c1fa1/roles/17dfac38a2e540fea229af7de99911bb => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:38:55.372903 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61083634-3b52-409f-8535-3ea67503795a None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:55.373325 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61083634-3b52-409f-8535-3ea67503795a None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:55.373745 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61083634-3b52-409f-8535-3ea67503795a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:55.408491 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-61083634-3b52-409f-8535-3ea67503795a None None] MFA Rules not processed for user `12e3d71497cf438bbb270488b41c1fa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:38:55.409757 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-61083634-3b52-409f-8535-3ea67503795a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:55.518667 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 988/1991] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:38:55 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:38:55.524332 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c278f1-9815-4a02-ac25-da1d7e378bd3 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:55.629954 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c278f1-9815-4a02-ac25-da1d7e378bd3 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:55.636887 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20c1598-7f0d-4dc1-b3e3-d51340772b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:55.637581 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20c1598-7f0d-4dc1-b3e3-d51340772b71 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:55.637875 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20c1598-7f0d-4dc1-b3e3-d51340772b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:55.638162 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20c1598-7f0d-4dc1-b3e3-d51340772b71 admin admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:55.639249 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20c1598-7f0d-4dc1-b3e3-d51340772b71 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:55.641593 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20c1598-7f0d-4dc1-b3e3-d51340772b71 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:55.682393 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1004/1992] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 14 09:38:55 2022] POST /identity/v3/projects => generated 379 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:38:55.684816 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61083634-3b52-409f-8535-3ea67503795a None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:55.699817 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61083634-3b52-409f-8535-3ea67503795a None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:55.754500 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:38:55.799702 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc97c5d8-d71d-415a-9e5d-00b9c69c93e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:55.800666 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc97c5d8-d71d-415a-9e5d-00b9c69c93e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:55.801108 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc97c5d8-d71d-415a-9e5d-00b9c69c93e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:55.801557 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc97c5d8-d71d-415a-9e5d-00b9c69c93e1 admin admin] PATH_INFO: `/v3/users` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:55.802501 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc97c5d8-d71d-415a-9e5d-00b9c69c93e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:55.805514 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc97c5d8-d71d-415a-9e5d-00b9c69c93e1 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:55.834932 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 989/1993] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 14 09:38:55 2022] POST /identity/v3/users => generated 290 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:38:55.839473 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20c1598-7f0d-4dc1-b3e3-d51340772b71 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:55.852571 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20c1598-7f0d-4dc1-b3e3-d51340772b71 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:55.862556 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ec36db-2100-436b-b75c-960998f0808f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:55.863699 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ec36db-2100-436b-b75c-960998f0808f admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:55.864845 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ec36db-2100-436b-b75c-960998f0808f admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:55.865289 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ec36db-2100-436b-b75c-960998f0808f admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:55.866383 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ec36db-2100-436b-b75c-960998f0808f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:55.869253 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ec36db-2100-436b-b75c-960998f0808f admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:55.884814 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1005/1994] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 09:38:55 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:38:55.889192 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc97c5d8-d71d-415a-9e5d-00b9c69c93e1 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:55.904778 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc97c5d8-d71d-415a-9e5d-00b9c69c93e1 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:55.910901 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c0740a-a6d5-4405-9c14-43d50b152d2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:55.911595 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c0740a-a6d5-4405-9c14-43d50b152d2e admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:55.911885 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c0740a-a6d5-4405-9c14-43d50b152d2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:55.912165 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c0740a-a6d5-4405-9c14-43d50b152d2e admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:55.918348 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c0740a-a6d5-4405-9c14-43d50b152d2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:55.918348 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c0740a-a6d5-4405-9c14-43d50b152d2e admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:55.930565 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 990/1995] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 09:38:55 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:38:55.932412 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ec36db-2100-436b-b75c-960998f0808f admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:55.944740 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ec36db-2100-436b-b75c-960998f0808f admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:55.959205 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb91822a-e595-4f1a-b2ce-5027fc8205a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:55.959993 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb91822a-e595-4f1a-b2ce-5027fc8205a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:55.960275 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb91822a-e595-4f1a-b2ce-5027fc8205a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:55.960569 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb91822a-e595-4f1a-b2ce-5027fc8205a0 admin admin] PATH_INFO: `/v3/projects/8746e7dde2814041a7e20d3236dce391/users/299fa45e679c45a992292456eaa3d378/roles/17dfac38a2e540fea229af7de99911bb` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:55.977166 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb91822a-e595-4f1a-b2ce-5027fc8205a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8746e7dde2814041a7e20d3236dce391, user_id=299fa45e679c45a992292456eaa3d378, role_id=17dfac38a2e540fea229af7de99911bb)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:55.979862 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb91822a-e595-4f1a-b2ce-5027fc8205a0 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:55.988730 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:DELETE=6,keystone:SELECT=89,keystone:INSERT=5 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:38:55.994529 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1006/1996] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 14 09:38:55 2022] PUT /identity/v3/projects/8746e7dde2814041a7e20d3236dce391/users/299fa45e679c45a992292456eaa3d378/roles/17dfac38a2e540fea229af7de99911bb => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:38:56.005394 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ecd429-31e6-446a-8983-b9d812b52c7f None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:56.005776 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ecd429-31e6-446a-8983-b9d812b52c7f None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:56.006128 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ecd429-31e6-446a-8983-b9d812b52c7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:56.033037 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-85ecd429-31e6-446a-8983-b9d812b52c7f None None] MFA Rules not processed for user `299fa45e679c45a992292456eaa3d378`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:38:56.034311 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-85ecd429-31e6-446a-8983-b9d812b52c7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:56.100088 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 991/1997] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:38:56 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:38:56.104659 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb91822a-e595-4f1a-b2ce-5027fc8205a0 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:56.181110 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb91822a-e595-4f1a-b2ce-5027fc8205a0 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:56.186298 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e440015-66cc-4190-a56b-e710aa2dd0dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:56.186965 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e440015-66cc-4190-a56b-e710aa2dd0dc admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:56.187254 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e440015-66cc-4190-a56b-e710aa2dd0dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:56.187537 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e440015-66cc-4190-a56b-e710aa2dd0dc admin admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:56.188243 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e440015-66cc-4190-a56b-e710aa2dd0dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:56.190209 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e440015-66cc-4190-a56b-e710aa2dd0dc admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:56.216612 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1007/1998] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 14 09:38:56 2022] POST /identity/v3/projects => generated 379 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:38:56.220703 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ecd429-31e6-446a-8983-b9d812b52c7f None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:56.234018 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ecd429-31e6-446a-8983-b9d812b52c7f None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:56.293816 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3cc25f-b2e8-422d-8af3-76da4feb3b96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:56.294494 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3cc25f-b2e8-422d-8af3-76da4feb3b96 admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:56.294882 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3cc25f-b2e8-422d-8af3-76da4feb3b96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:56.295166 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3cc25f-b2e8-422d-8af3-76da4feb3b96 admin admin] PATH_INFO: `/v3/users` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:56.296075 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3cc25f-b2e8-422d-8af3-76da4feb3b96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:56.298258 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3cc25f-b2e8-422d-8af3-76da4feb3b96 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:56.317064 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 992/1999] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 14 09:38:56 2022] POST /identity/v3/users => generated 296 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:38:56.321271 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e440015-66cc-4190-a56b-e710aa2dd0dc admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:56.332243 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e440015-66cc-4190-a56b-e710aa2dd0dc admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:56.338141 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6522148-944e-46f7-90a5-bb9935797efe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:56.338877 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6522148-944e-46f7-90a5-bb9935797efe admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:56.339186 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6522148-944e-46f7-90a5-bb9935797efe admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:56.340000 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6522148-944e-46f7-90a5-bb9935797efe admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:56.340735 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6522148-944e-46f7-90a5-bb9935797efe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:56.342386 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6522148-944e-46f7-90a5-bb9935797efe admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:56.355821 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1008/2000] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 09:38:56 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:38:56.360078 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3cc25f-b2e8-422d-8af3-76da4feb3b96 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:56.370439 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3cc25f-b2e8-422d-8af3-76da4feb3b96 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:56.378231 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d878ca4a-af97-404b-8349-fa1b672567ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:56.378733 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d878ca4a-af97-404b-8349-fa1b672567ee admin admin] REQUEST_METHOD: `PUT` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:56.379213 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d878ca4a-af97-404b-8349-fa1b672567ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:56.380016 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d878ca4a-af97-404b-8349-fa1b672567ee admin admin] PATH_INFO: `/v3/projects/2668dfe6b53d44a48bbfa9fd452a3115/users/1f8ec56d66774f00a09422b79e63d390/roles/e3965bd0d5f1427a86a313c0c90bfef3` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:56.399450 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d878ca4a-af97-404b-8349-fa1b672567ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=2668dfe6b53d44a48bbfa9fd452a3115, user_id=1f8ec56d66774f00a09422b79e63d390, role_id=e3965bd0d5f1427a86a313c0c90bfef3)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:56.402788 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d878ca4a-af97-404b-8349-fa1b672567ee admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:56.415551 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 993/2001] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 14 09:38:56 2022] PUT /identity/v3/projects/2668dfe6b53d44a48bbfa9fd452a3115/users/1f8ec56d66774f00a09422b79e63d390/roles/e3965bd0d5f1427a86a313c0c90bfef3 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:38:56.419543 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6522148-944e-46f7-90a5-bb9935797efe admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:56.430067 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6522148-944e-46f7-90a5-bb9935797efe admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:56.487522 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d49f809-eb31-4403-ba3b-d1199094a668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:56.488114 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d49f809-eb31-4403-ba3b-d1199094a668 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:56.488403 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d49f809-eb31-4403-ba3b-d1199094a668 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:56.488684 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d49f809-eb31-4403-ba3b-d1199094a668 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:56.489454 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d49f809-eb31-4403-ba3b-d1199094a668 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:56.491081 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d49f809-eb31-4403-ba3b-d1199094a668 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:56.500872 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1009/2002] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 09:38:56 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:38:56.505262 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d878ca4a-af97-404b-8349-fa1b672567ee admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:56.515962 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d878ca4a-af97-404b-8349-fa1b672567ee admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:56.521235 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f69b9e5-75b6-49d1-8a41-199260406810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:56.522116 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f69b9e5-75b6-49d1-8a41-199260406810 admin admin] REQUEST_METHOD: `PUT` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:56.522428 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f69b9e5-75b6-49d1-8a41-199260406810 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:56.522802 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f69b9e5-75b6-49d1-8a41-199260406810 admin admin] PATH_INFO: `/v3/projects/2668dfe6b53d44a48bbfa9fd452a3115/users/1f8ec56d66774f00a09422b79e63d390/roles/e3965bd0d5f1427a86a313c0c90bfef3` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:56.526178 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f69b9e5-75b6-49d1-8a41-199260406810 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2668dfe6b53d44a48bbfa9fd452a3115, user_id=1f8ec56d66774f00a09422b79e63d390, role_id=e3965bd0d5f1427a86a313c0c90bfef3)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:56.532286 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f69b9e5-75b6-49d1-8a41-199260406810 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:56.540034 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:38:56.545762 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 994/2003] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 14 09:38:56 2022] PUT /identity/v3/projects/2668dfe6b53d44a48bbfa9fd452a3115/users/1f8ec56d66774f00a09422b79e63d390/roles/e3965bd0d5f1427a86a313c0c90bfef3 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:38:56.555974 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8969a667-6dbd-4029-8aa6-fbf33ac2bc0b None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:56.556273 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8969a667-6dbd-4029-8aa6-fbf33ac2bc0b None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:56.556561 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8969a667-6dbd-4029-8aa6-fbf33ac2bc0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:56.595874 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-8969a667-6dbd-4029-8aa6-fbf33ac2bc0b None None] MFA Rules not processed for user `1f8ec56d66774f00a09422b79e63d390`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:38:56.597160 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-8969a667-6dbd-4029-8aa6-fbf33ac2bc0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:56.662855 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:38:56.673968 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1010/2004] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:38:56 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:38:56.685473 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f69b9e5-75b6-49d1-8a41-199260406810 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:56.687291 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-3f69b9e5-75b6-49d1-8a41-199260406810 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:56.752247 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f69b9e5-75b6-49d1-8a41-199260406810 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:56.755994 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5517a16-b5f9-4bd2-a7b0-7c43421a163c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25048b29787d482783ebc944f1a7df65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:56.756893 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5517a16-b5f9-4bd2-a7b0-7c43421a163c service cinder] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:56.757181 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5517a16-b5f9-4bd2-a7b0-7c43421a163c service cinder] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:56.757459 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5517a16-b5f9-4bd2-a7b0-7c43421a163c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:56.767527 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5517a16-b5f9-4bd2-a7b0-7c43421a163c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:56.768948 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5517a16-b5f9-4bd2-a7b0-7c43421a163c service cinder] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:56.778727 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 995/2005] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:38:56 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:38:56.819034 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8969a667-6dbd-4029-8aa6-fbf33ac2bc0b None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:56.820533 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-8969a667-6dbd-4029-8aa6-fbf33ac2bc0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:56.834377 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8969a667-6dbd-4029-8aa6-fbf33ac2bc0b None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:56.838336 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93751ad5-bb8b-489e-b42c-755600504461 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25048b29787d482783ebc944f1a7df65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:56.838993 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93751ad5-bb8b-489e-b42c-755600504461 service cinder] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:56.839286 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93751ad5-bb8b-489e-b42c-755600504461 service cinder] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:56.839569 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93751ad5-bb8b-489e-b42c-755600504461 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:56.899784 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93751ad5-bb8b-489e-b42c-755600504461 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:56.901572 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93751ad5-bb8b-489e-b42c-755600504461 service cinder] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:56.912724 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1011/2006] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:38:56 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:38:57.166998 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5517a16-b5f9-4bd2-a7b0-7c43421a163c service cinder] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:57.169355 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-e5517a16-b5f9-4bd2-a7b0-7c43421a163c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:57.333842 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5517a16-b5f9-4bd2-a7b0-7c43421a163c service cinder] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:57.347824 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a4d42f-43d0-4c62-9c51-59722e38d063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:57.349541 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a4d42f-43d0-4c62-9c51-59722e38d063 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:57.350082 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a4d42f-43d0-4c62-9c51-59722e38d063 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:57.351227 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a4d42f-43d0-4c62-9c51-59722e38d063 admin admin] PATH_INFO: `/v3/users/7c532eca4d294a51b43e057f9f61d756` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:57.354801 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a4d42f-43d0-4c62-9c51-59722e38d063 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c532eca4d294a51b43e057f9f61d756)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:57.358729 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a4d42f-43d0-4c62-9c51-59722e38d063 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:57.446271 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-a2a4d42f-43d0-4c62-9c51-59722e38d063 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c532eca4d294a51b43e057f9f61d756'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:57.454734 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-a2a4d42f-43d0-4c62-9c51-59722e38d063 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c532eca4d294a51b43e057f9f61d756'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:57.456039 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-a2a4d42f-43d0-4c62-9c51-59722e38d063 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c532eca4d294a51b43e057f9f61d756'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:57.468446 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-a2a4d42f-43d0-4c62-9c51-59722e38d063 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c532eca4d294a51b43e057f9f61d756'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:57.470164 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-a2a4d42f-43d0-4c62-9c51-59722e38d063 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c532eca4d294a51b43e057f9f61d756'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:57.520858 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 996/2007] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 14 09:38:57 2022] DELETE /identity/v3/users/7c532eca4d294a51b43e057f9f61d756 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:38:57.525864 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2a03a5-dfc9-4c6a-aeba-68fdbc3cc9f2 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:57.526319 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2a03a5-dfc9-4c6a-aeba-68fdbc3cc9f2 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:57.527415 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2a03a5-dfc9-4c6a-aeba-68fdbc3cc9f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:57.559906 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-4f2a03a5-dfc9-4c6a-aeba-68fdbc3cc9f2 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:38:57.561644 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-4f2a03a5-dfc9-4c6a-aeba-68fdbc3cc9f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:57.633292 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1012/2008] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:38:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:38:57.656762 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a4d42f-43d0-4c62-9c51-59722e38d063 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:57.663326 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-a2a4d42f-43d0-4c62-9c51-59722e38d063 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:57.694605 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:38:57.743876 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a4d42f-43d0-4c62-9c51-59722e38d063 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:57.750710 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb23061-d498-4dd3-9aa4-e268b01cbabc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e4a5a8965e4802a9055d332179b7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:57.751791 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb23061-d498-4dd3-9aa4-e268b01cbabc service neutron] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:57.752276 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb23061-d498-4dd3-9aa4-e268b01cbabc service neutron] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:57.752706 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb23061-d498-4dd3-9aa4-e268b01cbabc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:57.764323 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb23061-d498-4dd3-9aa4-e268b01cbabc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:57.766051 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb23061-d498-4dd3-9aa4-e268b01cbabc service neutron] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:57.778345 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 997/2009] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:38:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:38:58.198309 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2a03a5-dfc9-4c6a-aeba-68fdbc3cc9f2 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:58.200425 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-4f2a03a5-dfc9-4c6a-aeba-68fdbc3cc9f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:58.214020 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2a03a5-dfc9-4c6a-aeba-68fdbc3cc9f2 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:58.220065 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1890fe4-101b-4c6d-9f7f-a7d43c2df1a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:58.220995 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1890fe4-101b-4c6d-9f7f-a7d43c2df1a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:58.221284 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1890fe4-101b-4c6d-9f7f-a7d43c2df1a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:58.221581 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1890fe4-101b-4c6d-9f7f-a7d43c2df1a2 admin admin] PATH_INFO: `/v3/projects/3bba8dbdcb334750a0dcfdd5b76f1daa` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:58.223271 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1890fe4-101b-4c6d-9f7f-a7d43c2df1a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3bba8dbdcb334750a0dcfdd5b76f1daa)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:58.225385 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1890fe4-101b-4c6d-9f7f-a7d43c2df1a2 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:58.277911 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-a1890fe4-101b-4c6d-9f7f-a7d43c2df1a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3bba8dbdcb334750a0dcfdd5b76f1daa', 'request_id': 'req-a1890fe4-101b-4c6d-9f7f-a7d43c2df1a2'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:58.284274 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-a1890fe4-101b-4c6d-9f7f-a7d43c2df1a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3bba8dbdcb334750a0dcfdd5b76f1daa', 'request_id': 'req-a1890fe4-101b-4c6d-9f7f-a7d43c2df1a2'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:58.291571 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-a1890fe4-101b-4c6d-9f7f-a7d43c2df1a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3bba8dbdcb334750a0dcfdd5b76f1daa', 'request_id': 'req-a1890fe4-101b-4c6d-9f7f-a7d43c2df1a2'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:58.306241 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-a1890fe4-101b-4c6d-9f7f-a7d43c2df1a2 admin admin] The token cache is being invalidate because project 3bba8dbdcb334750a0dcfdd5b76f1daa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 09:38:58.306535 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-a1890fe4-101b-4c6d-9f7f-a7d43c2df1a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:58.307164 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-a1890fe4-101b-4c6d-9f7f-a7d43c2df1a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:58.309656 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1013/2010] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 14 09:38:58 2022] DELETE /identity/v3/projects/3bba8dbdcb334750a0dcfdd5b76f1daa => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:38:58.313386 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb23061-d498-4dd3-9aa4-e268b01cbabc service neutron] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:58.323725 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb23061-d498-4dd3-9aa4-e268b01cbabc service neutron] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:58.413829 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a166b014-c135-4f55-9d92-589207f7bea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:58.415068 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a166b014-c135-4f55-9d92-589207f7bea6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:58.415365 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a166b014-c135-4f55-9d92-589207f7bea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:58.415701 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a166b014-c135-4f55-9d92-589207f7bea6 admin admin] PATH_INFO: `/v3/users/34c52a0272c648f08060eba7a8193565` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:58.416993 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a166b014-c135-4f55-9d92-589207f7bea6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=34c52a0272c648f08060eba7a8193565)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:58.419322 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a166b014-c135-4f55-9d92-589207f7bea6 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:58.478228 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-a166b014-c135-4f55-9d92-589207f7bea6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34c52a0272c648f08060eba7a8193565'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:58.485400 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-a166b014-c135-4f55-9d92-589207f7bea6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34c52a0272c648f08060eba7a8193565'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:58.486244 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-a166b014-c135-4f55-9d92-589207f7bea6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34c52a0272c648f08060eba7a8193565'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:58.495428 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-a166b014-c135-4f55-9d92-589207f7bea6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34c52a0272c648f08060eba7a8193565'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:58.496673 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-a166b014-c135-4f55-9d92-589207f7bea6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34c52a0272c648f08060eba7a8193565'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:58.516885 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 998/2011] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 14 09:38:58 2022] DELETE /identity/v3/users/34c52a0272c648f08060eba7a8193565 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:38:58.838850 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1890fe4-101b-4c6d-9f7f-a7d43c2df1a2 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:58.848079 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-a1890fe4-101b-4c6d-9f7f-a7d43c2df1a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:58.880764 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1890fe4-101b-4c6d-9f7f-a7d43c2df1a2 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:58.902952 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:38:58.963887 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8882ea7d-2674-4505-ba6e-4f98a2690d56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:58.965430 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8882ea7d-2674-4505-ba6e-4f98a2690d56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:58.965991 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8882ea7d-2674-4505-ba6e-4f98a2690d56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:58.966543 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8882ea7d-2674-4505-ba6e-4f98a2690d56 admin admin] PATH_INFO: `/v3/projects/eccaf23ab2c8430dbb4be7e15949bc96` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:58.968082 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8882ea7d-2674-4505-ba6e-4f98a2690d56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eccaf23ab2c8430dbb4be7e15949bc96)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:58.970578 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8882ea7d-2674-4505-ba6e-4f98a2690d56 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:59.040746 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-8882ea7d-2674-4505-ba6e-4f98a2690d56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eccaf23ab2c8430dbb4be7e15949bc96', 'request_id': 'req-8882ea7d-2674-4505-ba6e-4f98a2690d56'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:59.050405 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-8882ea7d-2674-4505-ba6e-4f98a2690d56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eccaf23ab2c8430dbb4be7e15949bc96', 'request_id': 'req-8882ea7d-2674-4505-ba6e-4f98a2690d56'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:59.057205 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-8882ea7d-2674-4505-ba6e-4f98a2690d56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eccaf23ab2c8430dbb4be7e15949bc96', 'request_id': 'req-8882ea7d-2674-4505-ba6e-4f98a2690d56'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:59.072282 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-8882ea7d-2674-4505-ba6e-4f98a2690d56 admin admin] The token cache is being invalidate because project eccaf23ab2c8430dbb4be7e15949bc96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 09:38:59.072761 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-8882ea7d-2674-4505-ba6e-4f98a2690d56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:59.073639 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-8882ea7d-2674-4505-ba6e-4f98a2690d56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:38:59.075459 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1014/2012] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 14 09:38:58 2022] DELETE /identity/v3/projects/eccaf23ab2c8430dbb4be7e15949bc96 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:38:59.080525 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd0a783-2457-40a1-900a-df0c01375e4d None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:59.080822 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd0a783-2457-40a1-900a-df0c01375e4d None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:59.081104 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd0a783-2457-40a1-900a-df0c01375e4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:59.099790 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-9cd0a783-2457-40a1-900a-df0c01375e4d None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:38:59.101132 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-9cd0a783-2457-40a1-900a-df0c01375e4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:59.145371 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:38:59.167265 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 999/2013] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:38:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:38:59.176645 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad513dbe-f377-466f-9294-faa73d46defd None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:59.176944 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad513dbe-f377-466f-9294-faa73d46defd None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:59.177227 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad513dbe-f377-466f-9294-faa73d46defd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:59.195798 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-ad513dbe-f377-466f-9294-faa73d46defd None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:38:59.197006 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-ad513dbe-f377-466f-9294-faa73d46defd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:59.206230 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1015/2014] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:38:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:38:59.209853 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd0a783-2457-40a1-900a-df0c01375e4d None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:59.220179 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd0a783-2457-40a1-900a-df0c01375e4d None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:59.224820 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e72a73f-298e-440f-a8cc-2c4b7092a747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:59.225485 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e72a73f-298e-440f-a8cc-2c4b7092a747 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:59.225773 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e72a73f-298e-440f-a8cc-2c4b7092a747 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:59.226054 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e72a73f-298e-440f-a8cc-2c4b7092a747 admin admin] PATH_INFO: `/v3/domains` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:59.226830 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e72a73f-298e-440f-a8cc-2c4b7092a747 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:38:59.227149 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e72a73f-298e-440f-a8cc-2c4b7092a747 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:59.228737 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e72a73f-298e-440f-a8cc-2c4b7092a747 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:59.241301 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1000/2015] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jul 14 09:38:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:38:59.245895 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad513dbe-f377-466f-9294-faa73d46defd None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:59.255247 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad513dbe-f377-466f-9294-faa73d46defd None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:59.259933 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465df215-a237-4656-981b-335631261999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:59.260596 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465df215-a237-4656-981b-335631261999 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:59.260879 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465df215-a237-4656-981b-335631261999 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:59.261179 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465df215-a237-4656-981b-335631261999 admin admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:59.261873 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465df215-a237-4656-981b-335631261999 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:59.263807 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465df215-a237-4656-981b-335631261999 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:59.290602 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1016/2016] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 14 09:38:59 2022] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:38:59.295356 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e72a73f-298e-440f-a8cc-2c4b7092a747 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:59.305559 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e72a73f-298e-440f-a8cc-2c4b7092a747 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:59.365015 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c12d09-63bb-4f88-82b2-42f0e7313742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:59.365712 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c12d09-63bb-4f88-82b2-42f0e7313742 admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:59.366013 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c12d09-63bb-4f88-82b2-42f0e7313742 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:59.366735 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c12d09-63bb-4f88-82b2-42f0e7313742 admin admin] PATH_INFO: `/v3/users` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:59.367458 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c12d09-63bb-4f88-82b2-42f0e7313742 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:59.369389 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c12d09-63bb-4f88-82b2-42f0e7313742 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:59.394269 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1001/2017] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 14 09:38:59 2022] POST /identity/v3/users => generated 287 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:38:59.395602 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465df215-a237-4656-981b-335631261999 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:59.407736 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465df215-a237-4656-981b-335631261999 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:59.412351 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad44cb7e-b274-49bb-b0ad-33864f32508a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:59.413172 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad44cb7e-b274-49bb-b0ad-33864f32508a admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:59.413459 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad44cb7e-b274-49bb-b0ad-33864f32508a admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:59.413734 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad44cb7e-b274-49bb-b0ad-33864f32508a admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:59.414496 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad44cb7e-b274-49bb-b0ad-33864f32508a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:59.416081 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad44cb7e-b274-49bb-b0ad-33864f32508a admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:59.431569 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1017/2018] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 09:38:59 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:38:59.433501 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c12d09-63bb-4f88-82b2-42f0e7313742 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:59.444734 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c12d09-63bb-4f88-82b2-42f0e7313742 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:59.450146 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36e6581-c3f1-4931-a64f-18dff92c2e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:59.450915 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36e6581-c3f1-4931-a64f-18dff92c2e2d admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:59.451267 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36e6581-c3f1-4931-a64f-18dff92c2e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:59.451553 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36e6581-c3f1-4931-a64f-18dff92c2e2d admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:59.452293 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36e6581-c3f1-4931-a64f-18dff92c2e2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:59.454013 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36e6581-c3f1-4931-a64f-18dff92c2e2d admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:59.465374 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1002/2019] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 09:38:59 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:38:59.469624 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad44cb7e-b274-49bb-b0ad-33864f32508a admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:59.480594 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad44cb7e-b274-49bb-b0ad-33864f32508a admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:59.487391 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceb4b97-acae-4c19-99f0-8d5c6a3c3aaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:59.488309 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceb4b97-acae-4c19-99f0-8d5c6a3c3aaf admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:59.488591 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceb4b97-acae-4c19-99f0-8d5c6a3c3aaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:59.488865 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceb4b97-acae-4c19-99f0-8d5c6a3c3aaf admin admin] PATH_INFO: `/v3/projects/491b36ad031b4330832b24dd08713d7a/users/5dd61163f2be4d7db90e58d5e347e3ab/roles/17dfac38a2e540fea229af7de99911bb` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:59.503710 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ceb4b97-acae-4c19-99f0-8d5c6a3c3aaf admin admin] RBAC: Authorizing `identity:create_grant(project_id=491b36ad031b4330832b24dd08713d7a, user_id=5dd61163f2be4d7db90e58d5e347e3ab, role_id=17dfac38a2e540fea229af7de99911bb)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:59.506487 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ceb4b97-acae-4c19-99f0-8d5c6a3c3aaf admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:59.522116 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1018/2020] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 14 09:38:59 2022] PUT /identity/v3/projects/491b36ad031b4330832b24dd08713d7a/users/5dd61163f2be4d7db90e58d5e347e3ab/roles/17dfac38a2e540fea229af7de99911bb => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:38:59.536957 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c698b54e-cc59-4147-afd7-c7088384e672 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:59.537382 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c698b54e-cc59-4147-afd7-c7088384e672 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:59.537675 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c698b54e-cc59-4147-afd7-c7088384e672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:59.570387 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-c698b54e-cc59-4147-afd7-c7088384e672 None None] MFA Rules not processed for user `5dd61163f2be4d7db90e58d5e347e3ab`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:38:59.571686 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-c698b54e-cc59-4147-afd7-c7088384e672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:59.655213 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1003/2021] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:38:59 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:38:59.672166 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceb4b97-acae-4c19-99f0-8d5c6a3c3aaf admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:38:59.674242 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-6ceb4b97-acae-4c19-99f0-8d5c6a3c3aaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:38:59.759645 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:38:59.775225 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceb4b97-acae-4c19-99f0-8d5c6a3c3aaf admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:38:59.786998 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686d1769-e745-4d86-a5fd-a3df1c763f92 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25048b29787d482783ebc944f1a7df65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:38:59.788144 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686d1769-e745-4d86-a5fd-a3df1c763f92 service cinder] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:38:59.788428 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686d1769-e745-4d86-a5fd-a3df1c763f92 service cinder] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:38:59.788742 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686d1769-e745-4d86-a5fd-a3df1c763f92 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:38:59.801891 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686d1769-e745-4d86-a5fd-a3df1c763f92 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:38:59.807716 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686d1769-e745-4d86-a5fd-a3df1c763f92 service cinder] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:38:59.817403 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1019/2022] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:38:59 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:39:02.437517 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c698b54e-cc59-4147-afd7-c7088384e672 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:39:02.439136 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-c698b54e-cc59-4147-afd7-c7088384e672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:39:02.493955 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:39:02.532380 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c698b54e-cc59-4147-afd7-c7088384e672 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:39:02.534735 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3785c86e-5953-480a-815f-5a13b328a2a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:39:02.535744 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3785c86e-5953-480a-815f-5a13b328a2a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:39:02.536037 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3785c86e-5953-480a-815f-5a13b328a2a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:39:02.537374 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3785c86e-5953-480a-815f-5a13b328a2a4 admin admin] PATH_INFO: `/v3/users/12e3d71497cf438bbb270488b41c1fa1` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:39:02.538845 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3785c86e-5953-480a-815f-5a13b328a2a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=12e3d71497cf438bbb270488b41c1fa1)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:39:02.541507 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3785c86e-5953-480a-815f-5a13b328a2a4 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:39:02.634522 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-3785c86e-5953-480a-815f-5a13b328a2a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12e3d71497cf438bbb270488b41c1fa1'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:39:02.648316 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-3785c86e-5953-480a-815f-5a13b328a2a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12e3d71497cf438bbb270488b41c1fa1'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:39:02.649081 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-3785c86e-5953-480a-815f-5a13b328a2a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12e3d71497cf438bbb270488b41c1fa1'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:39:02.659833 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-3785c86e-5953-480a-815f-5a13b328a2a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12e3d71497cf438bbb270488b41c1fa1'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:39:02.660915 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-3785c86e-5953-480a-815f-5a13b328a2a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12e3d71497cf438bbb270488b41c1fa1'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:39:02.685050 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1004/2023] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 14 09:39:02 2022] DELETE /identity/v3/users/12e3d71497cf438bbb270488b41c1fa1 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:39:02.689569 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60950c70-bf0f-4b26-8b3f-16cb42fff9c1 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:39:02.690467 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60950c70-bf0f-4b26-8b3f-16cb42fff9c1 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:39:02.690759 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60950c70-bf0f-4b26-8b3f-16cb42fff9c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:39:02.709650 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-60950c70-bf0f-4b26-8b3f-16cb42fff9c1 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:39:02.710910 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-60950c70-bf0f-4b26-8b3f-16cb42fff9c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:39:02.785313 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1020/2024] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:39:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:39:02.794803 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3785c86e-5953-480a-815f-5a13b328a2a4 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:39:02.796301 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-3785c86e-5953-480a-815f-5a13b328a2a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:39:02.875687 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3785c86e-5953-480a-815f-5a13b328a2a4 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:39:02.881714 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fc6db1-3613-42a5-bbba-02a3deeac291 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e4a5a8965e4802a9055d332179b7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:39:02.882875 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fc6db1-3613-42a5-bbba-02a3deeac291 service neutron] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:39:02.883270 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fc6db1-3613-42a5-bbba-02a3deeac291 service neutron] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:39:02.883655 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fc6db1-3613-42a5-bbba-02a3deeac291 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:39:02.895560 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fc6db1-3613-42a5-bbba-02a3deeac291 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:39:02.897126 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fc6db1-3613-42a5-bbba-02a3deeac291 service neutron] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:39:02.910100 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1005/2025] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:39:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:39:03.227021 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60950c70-bf0f-4b26-8b3f-16cb42fff9c1 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:39:03.228539 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-60950c70-bf0f-4b26-8b3f-16cb42fff9c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:39:03.247713 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60950c70-bf0f-4b26-8b3f-16cb42fff9c1 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:39:03.253604 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f05b1e4-9cda-407d-bd34-b0f3d471d30f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:39:03.254555 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f05b1e4-9cda-407d-bd34-b0f3d471d30f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:39:03.254843 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f05b1e4-9cda-407d-bd34-b0f3d471d30f admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:39:03.255253 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f05b1e4-9cda-407d-bd34-b0f3d471d30f admin admin] PATH_INFO: `/v3/projects/43f9d20b5d7746698d16b0a43dafb756` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:39:03.256476 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f05b1e4-9cda-407d-bd34-b0f3d471d30f admin admin] RBAC: Authorizing `identity:delete_project(project_id=43f9d20b5d7746698d16b0a43dafb756)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:39:03.258419 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f05b1e4-9cda-407d-bd34-b0f3d471d30f admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:39:03.321480 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-2f05b1e4-9cda-407d-bd34-b0f3d471d30f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43f9d20b5d7746698d16b0a43dafb756', 'request_id': 'req-2f05b1e4-9cda-407d-bd34-b0f3d471d30f'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:39:03.328393 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-2f05b1e4-9cda-407d-bd34-b0f3d471d30f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43f9d20b5d7746698d16b0a43dafb756', 'request_id': 'req-2f05b1e4-9cda-407d-bd34-b0f3d471d30f'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:39:03.336490 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-2f05b1e4-9cda-407d-bd34-b0f3d471d30f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43f9d20b5d7746698d16b0a43dafb756', 'request_id': 'req-2f05b1e4-9cda-407d-bd34-b0f3d471d30f'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:39:03.359206 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-2f05b1e4-9cda-407d-bd34-b0f3d471d30f admin admin] The token cache is being invalidate because project 43f9d20b5d7746698d16b0a43dafb756 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 09:39:03.359504 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-2f05b1e4-9cda-407d-bd34-b0f3d471d30f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:39:03.360177 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-2f05b1e4-9cda-407d-bd34-b0f3d471d30f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:39:03.364663 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1021/2026] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 14 09:39:03 2022] DELETE /identity/v3/projects/43f9d20b5d7746698d16b0a43dafb756 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:39:03.365830 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fc6db1-3613-42a5-bbba-02a3deeac291 service neutron] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:39:03.377832 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fc6db1-3613-42a5-bbba-02a3deeac291 service neutron] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:39:03.457334 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9ab81e-2a55-46ed-8e40-6542461785f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:39:03.458572 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9ab81e-2a55-46ed-8e40-6542461785f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:39:03.458935 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9ab81e-2a55-46ed-8e40-6542461785f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:39:03.459229 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9ab81e-2a55-46ed-8e40-6542461785f0 admin admin] PATH_INFO: `/v3/users/299fa45e679c45a992292456eaa3d378` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:39:03.460573 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9ab81e-2a55-46ed-8e40-6542461785f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=299fa45e679c45a992292456eaa3d378)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:39:03.462746 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9ab81e-2a55-46ed-8e40-6542461785f0 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:39:03.469651 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:39:03.538000 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-9f9ab81e-2a55-46ed-8e40-6542461785f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '299fa45e679c45a992292456eaa3d378'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:39:03.550115 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-9f9ab81e-2a55-46ed-8e40-6542461785f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '299fa45e679c45a992292456eaa3d378'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:39:03.559497 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-9f9ab81e-2a55-46ed-8e40-6542461785f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '299fa45e679c45a992292456eaa3d378'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:39:03.571388 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-9f9ab81e-2a55-46ed-8e40-6542461785f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '299fa45e679c45a992292456eaa3d378'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:39:03.572024 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-9f9ab81e-2a55-46ed-8e40-6542461785f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '299fa45e679c45a992292456eaa3d378'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:39:03.610990 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1006/2027] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 14 09:39:03 2022] DELETE /identity/v3/users/299fa45e679c45a992292456eaa3d378 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:39:03.925086 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f05b1e4-9cda-407d-bd34-b0f3d471d30f admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:39:03.926758 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-2f05b1e4-9cda-407d-bd34-b0f3d471d30f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:39:03.942624 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f05b1e4-9cda-407d-bd34-b0f3d471d30f admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:39:04.028229 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dfd85b-ee31-4986-b741-0e8b898d20ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:39:04.029124 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dfd85b-ee31-4986-b741-0e8b898d20ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:39:04.029416 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dfd85b-ee31-4986-b741-0e8b898d20ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:39:04.029697 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dfd85b-ee31-4986-b741-0e8b898d20ed admin admin] PATH_INFO: `/v3/projects/8746e7dde2814041a7e20d3236dce391` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:39:04.031104 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dfd85b-ee31-4986-b741-0e8b898d20ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=8746e7dde2814041a7e20d3236dce391)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:39:04.033733 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dfd85b-ee31-4986-b741-0e8b898d20ed admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:39:04.056212 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:39:04.101317 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-95dfd85b-ee31-4986-b741-0e8b898d20ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8746e7dde2814041a7e20d3236dce391', 'request_id': 'req-95dfd85b-ee31-4986-b741-0e8b898d20ed'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:39:04.114646 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-95dfd85b-ee31-4986-b741-0e8b898d20ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8746e7dde2814041a7e20d3236dce391', 'request_id': 'req-95dfd85b-ee31-4986-b741-0e8b898d20ed'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:39:04.122730 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-95dfd85b-ee31-4986-b741-0e8b898d20ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8746e7dde2814041a7e20d3236dce391', 'request_id': 'req-95dfd85b-ee31-4986-b741-0e8b898d20ed'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:39:04.146626 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-95dfd85b-ee31-4986-b741-0e8b898d20ed admin admin] The token cache is being invalidate because project 8746e7dde2814041a7e20d3236dce391 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 09:39:04.146923 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-95dfd85b-ee31-4986-b741-0e8b898d20ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:39:04.147846 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-95dfd85b-ee31-4986-b741-0e8b898d20ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:39:04.152663 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1022/2028] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 14 09:39:03 2022] DELETE /identity/v3/projects/8746e7dde2814041a7e20d3236dce391 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:39:04.154304 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9ab81e-2a55-46ed-8e40-6542461785f0 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:39:04.155991 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-9f9ab81e-2a55-46ed-8e40-6542461785f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:39:04.172295 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9ab81e-2a55-46ed-8e40-6542461785f0 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:39:04.238494 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ce8f1f-be1f-4956-9e5c-05dac5032c8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:39:04.239357 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ce8f1f-be1f-4956-9e5c-05dac5032c8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:39:04.239357 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ce8f1f-be1f-4956-9e5c-05dac5032c8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:39:04.239751 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ce8f1f-be1f-4956-9e5c-05dac5032c8c admin admin] PATH_INFO: `/v3/users/1f8ec56d66774f00a09422b79e63d390` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:39:04.241774 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ce8f1f-be1f-4956-9e5c-05dac5032c8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f8ec56d66774f00a09422b79e63d390)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:39:04.244010 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ce8f1f-be1f-4956-9e5c-05dac5032c8c admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:39:04.310717 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-22ce8f1f-be1f-4956-9e5c-05dac5032c8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f8ec56d66774f00a09422b79e63d390'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:39:04.318100 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-22ce8f1f-be1f-4956-9e5c-05dac5032c8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f8ec56d66774f00a09422b79e63d390'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:39:04.318855 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-22ce8f1f-be1f-4956-9e5c-05dac5032c8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f8ec56d66774f00a09422b79e63d390'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:39:04.328273 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-22ce8f1f-be1f-4956-9e5c-05dac5032c8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f8ec56d66774f00a09422b79e63d390'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:39:04.328979 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-22ce8f1f-be1f-4956-9e5c-05dac5032c8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f8ec56d66774f00a09422b79e63d390'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:39:04.352827 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:39:04.358061 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1007/2029] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 14 09:39:04 2022] DELETE /identity/v3/users/1f8ec56d66774f00a09422b79e63d390 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:39:04.650551 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dfd85b-ee31-4986-b741-0e8b898d20ed admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:39:04.652898 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-95dfd85b-ee31-4986-b741-0e8b898d20ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:39:04.668751 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dfd85b-ee31-4986-b741-0e8b898d20ed admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:39:04.734236 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74ba124-b552-4f8e-8ae9-08046cc85269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:39:04.735297 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74ba124-b552-4f8e-8ae9-08046cc85269 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:39:04.735665 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74ba124-b552-4f8e-8ae9-08046cc85269 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:39:04.736181 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74ba124-b552-4f8e-8ae9-08046cc85269 admin admin] PATH_INFO: `/v3/projects/2668dfe6b53d44a48bbfa9fd452a3115` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:39:04.737401 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74ba124-b552-4f8e-8ae9-08046cc85269 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2668dfe6b53d44a48bbfa9fd452a3115)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:39:04.739414 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74ba124-b552-4f8e-8ae9-08046cc85269 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:39:04.795110 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-c74ba124-b552-4f8e-8ae9-08046cc85269 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2668dfe6b53d44a48bbfa9fd452a3115', 'request_id': 'req-c74ba124-b552-4f8e-8ae9-08046cc85269'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:39:04.801318 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-c74ba124-b552-4f8e-8ae9-08046cc85269 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2668dfe6b53d44a48bbfa9fd452a3115', 'request_id': 'req-c74ba124-b552-4f8e-8ae9-08046cc85269'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:39:04.807918 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-c74ba124-b552-4f8e-8ae9-08046cc85269 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2668dfe6b53d44a48bbfa9fd452a3115', 'request_id': 'req-c74ba124-b552-4f8e-8ae9-08046cc85269'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:39:04.829574 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-c74ba124-b552-4f8e-8ae9-08046cc85269 admin admin] The token cache is being invalidate because project 2668dfe6b53d44a48bbfa9fd452a3115 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 09:39:04.829857 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-c74ba124-b552-4f8e-8ae9-08046cc85269 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:39:04.834815 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-c74ba124-b552-4f8e-8ae9-08046cc85269 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:39:04.837422 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1023/2030] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 14 09:39:04 2022] DELETE /identity/v3/projects/2668dfe6b53d44a48bbfa9fd452a3115 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:39:04.844479 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3ef177-b8a1-4958-840e-cc960001b083 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:39:04.844899 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3ef177-b8a1-4958-840e-cc960001b083 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:39:04.845160 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3ef177-b8a1-4958-840e-cc960001b083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:39:04.866118 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-ae3ef177-b8a1-4958-840e-cc960001b083 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:39:04.867368 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-ae3ef177-b8a1-4958-840e-cc960001b083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:39:04.937065 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1008/2031] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:39:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 09:39:04.948163 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249c56da-5d39-41a0-b38f-2ec096124aa8 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:39:04.949547 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249c56da-5d39-41a0-b38f-2ec096124aa8 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:39:04.949983 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249c56da-5d39-41a0-b38f-2ec096124aa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:39:04.973256 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-249c56da-5d39-41a0-b38f-2ec096124aa8 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:39:04.974527 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-249c56da-5d39-41a0-b38f-2ec096124aa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:39:04.983223 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1024/2032] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:39:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:39:04.987588 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3ef177-b8a1-4958-840e-cc960001b083 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:39:05.003427 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3ef177-b8a1-4958-840e-cc960001b083 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:39:05.008584 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8549252-7f34-491e-82f5-fc494e0446c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:39:05.009266 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8549252-7f34-491e-82f5-fc494e0446c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:39:05.009552 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8549252-7f34-491e-82f5-fc494e0446c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:39:05.009831 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8549252-7f34-491e-82f5-fc494e0446c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:39:05.010606 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8549252-7f34-491e-82f5-fc494e0446c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:39:05.011776 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8549252-7f34-491e-82f5-fc494e0446c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:39:05.013389 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8549252-7f34-491e-82f5-fc494e0446c2 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:39:05.025607 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1009/2033] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jul 14 09:39:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:39:05.029900 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249c56da-5d39-41a0-b38f-2ec096124aa8 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:39:05.039923 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249c56da-5d39-41a0-b38f-2ec096124aa8 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:39:05.045650 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f6a5b3-1749-49e4-908c-c8ac1759a846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:39:05.046398 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f6a5b3-1749-49e4-908c-c8ac1759a846 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:39:05.046687 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f6a5b3-1749-49e4-908c-c8ac1759a846 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:39:05.046962 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f6a5b3-1749-49e4-908c-c8ac1759a846 admin admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:39:05.047836 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f6a5b3-1749-49e4-908c-c8ac1759a846 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:39:05.049788 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f6a5b3-1749-49e4-908c-c8ac1759a846 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:39:05.097492 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1025/2034] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 14 09:39:05 2022] POST /identity/v3/projects => generated 383 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:39:05.101314 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8549252-7f34-491e-82f5-fc494e0446c2 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:39:05.113927 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8549252-7f34-491e-82f5-fc494e0446c2 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:39:05.204778 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd9d339-3c8f-4ba1-ae13-f1e7b96cc6cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:39:05.205620 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd9d339-3c8f-4ba1-ae13-f1e7b96cc6cb admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:39:05.206219 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd9d339-3c8f-4ba1-ae13-f1e7b96cc6cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:39:05.206615 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd9d339-3c8f-4ba1-ae13-f1e7b96cc6cb admin admin] PATH_INFO: `/v3/users` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:39:05.207468 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd9d339-3c8f-4ba1-ae13-f1e7b96cc6cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:39:05.208389 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f6a5b3-1749-49e4-908c-c8ac1759a846 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:39:05.209969 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd9d339-3c8f-4ba1-ae13-f1e7b96cc6cb admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:39:05.210563 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-76f6a5b3-1749-49e4-908c-c8ac1759a846 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:39:05.220282 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:39:05.228685 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f6a5b3-1749-49e4-908c-c8ac1759a846 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:39:05.240799 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1010/2035] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 14 09:39:05 2022] POST /identity/v3/users => generated 292 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:39:05.241009 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13fbdbf-821a-4c6d-aac2-8921fc0451f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:39:05.241992 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13fbdbf-821a-4c6d-aac2-8921fc0451f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:39:05.242394 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13fbdbf-821a-4c6d-aac2-8921fc0451f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:39:05.242873 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13fbdbf-821a-4c6d-aac2-8921fc0451f5 admin admin] PATH_INFO: `/v3/users/5dd61163f2be4d7db90e58d5e347e3ab` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:39:05.244706 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd9d339-3c8f-4ba1-ae13-f1e7b96cc6cb admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:39:05.245019 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13fbdbf-821a-4c6d-aac2-8921fc0451f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5dd61163f2be4d7db90e58d5e347e3ab)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:39:05.248182 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13fbdbf-821a-4c6d-aac2-8921fc0451f5 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:39:05.262585 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd9d339-3c8f-4ba1-ae13-f1e7b96cc6cb admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:39:05.269953 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5d1a8c-045b-440b-bac3-e1be43d92749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:39:05.271131 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5d1a8c-045b-440b-bac3-e1be43d92749 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:39:05.271421 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5d1a8c-045b-440b-bac3-e1be43d92749 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:39:05.271756 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5d1a8c-045b-440b-bac3-e1be43d92749 admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:39:05.273855 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5d1a8c-045b-440b-bac3-e1be43d92749 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:39:05.276541 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5d1a8c-045b-440b-bac3-e1be43d92749 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:39:05.293452 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1011/2036] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 09:39:05 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 09:39:05.295070 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5d1a8c-045b-440b-bac3-e1be43d92749 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:39:05.310286 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5d1a8c-045b-440b-bac3-e1be43d92749 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:39:05.313239 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-d13fbdbf-821a-4c6d-aac2-8921fc0451f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5dd61163f2be4d7db90e58d5e347e3ab'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:39:05.315330 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ac2762-dc80-49a3-bc4d-3fdd609add48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:39:05.315995 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ac2762-dc80-49a3-bc4d-3fdd609add48 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:39:05.316282 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ac2762-dc80-49a3-bc4d-3fdd609add48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:39:05.316561 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ac2762-dc80-49a3-bc4d-3fdd609add48 admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:39:05.317297 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ac2762-dc80-49a3-bc4d-3fdd609add48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:39:05.318954 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ac2762-dc80-49a3-bc4d-3fdd609add48 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:39:05.330040 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-d13fbdbf-821a-4c6d-aac2-8921fc0451f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5dd61163f2be4d7db90e58d5e347e3ab'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:39:05.331311 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-d13fbdbf-821a-4c6d-aac2-8921fc0451f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5dd61163f2be4d7db90e58d5e347e3ab'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:39:05.334129 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1012/2037] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 09:39:05 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 09:39:05.338353 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ac2762-dc80-49a3-bc4d-3fdd609add48 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:39:05.343128 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-d13fbdbf-821a-4c6d-aac2-8921fc0451f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5dd61163f2be4d7db90e58d5e347e3ab'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:39:05.358361 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ac2762-dc80-49a3-bc4d-3fdd609add48 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:39:05.359588 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-d13fbdbf-821a-4c6d-aac2-8921fc0451f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5dd61163f2be4d7db90e58d5e347e3ab'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:39:05.373584 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c074fa09-5490-4717-9983-587268e0b59c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:39:05.374722 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c074fa09-5490-4717-9983-587268e0b59c admin admin] REQUEST_METHOD: `PUT` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:39:05.375107 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c074fa09-5490-4717-9983-587268e0b59c admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:39:05.375615 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c074fa09-5490-4717-9983-587268e0b59c admin admin] PATH_INFO: `/v3/projects/75a7b85682854750b4609d61bae30adc/users/8c3e934881b145548667afa8edbcea64/roles/17dfac38a2e540fea229af7de99911bb` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:39:05.391327 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1026/2038] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 14 09:39:05 2022] DELETE /identity/v3/users/5dd61163f2be4d7db90e58d5e347e3ab => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 09:39:05.393989 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba6056f-8b47-41cd-b06a-68062768157c None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:39:05.393989 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba6056f-8b47-41cd-b06a-68062768157c None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:39:05.394205 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba6056f-8b47-41cd-b06a-68062768157c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:39:05.423767 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-9ba6056f-8b47-41cd-b06a-68062768157c None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:39:05.425151 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-9ba6056f-8b47-41cd-b06a-68062768157c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:39:05.447393 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c074fa09-5490-4717-9983-587268e0b59c admin admin] RBAC: Authorizing `identity:create_grant(project_id=75a7b85682854750b4609d61bae30adc, user_id=8c3e934881b145548667afa8edbcea64, role_id=17dfac38a2e540fea229af7de99911bb)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:39:05.452844 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c074fa09-5490-4717-9983-587268e0b59c admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:39:05.494287 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1013/2039] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 14 09:39:05 2022] PUT /identity/v3/projects/75a7b85682854750b4609d61bae30adc/users/8c3e934881b145548667afa8edbcea64/roles/17dfac38a2e540fea229af7de99911bb => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 09:39:05.514581 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d14292-cfc7-49e6-8fda-56ed36968fa0 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:39:05.516185 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d14292-cfc7-49e6-8fda-56ed36968fa0 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:39:05.516185 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d14292-cfc7-49e6-8fda-56ed36968fa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:39:05.527554 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1027/2040] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:39:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:39:05.537422 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba6056f-8b47-41cd-b06a-68062768157c None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:39:05.538847 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-9ba6056f-8b47-41cd-b06a-68062768157c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:39:05.574515 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-a2d14292-cfc7-49e6-8fda-56ed36968fa0 None None] MFA Rules not processed for user `8c3e934881b145548667afa8edbcea64`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:39:05.575456 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-a2d14292-cfc7-49e6-8fda-56ed36968fa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:39:05.616657 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:39:05.622260 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba6056f-8b47-41cd-b06a-68062768157c None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:39:05.655487 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:39:05.682284 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1014/2041] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:39:05 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:39:05.713940 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c387cd5-c878-4337-876a-d585f0b5d7aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e4a5a8965e4802a9055d332179b7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:39:05.715466 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c387cd5-c878-4337-876a-d585f0b5d7aa service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:39:05.715954 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c387cd5-c878-4337-876a-d585f0b5d7aa service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:39:05.717512 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c387cd5-c878-4337-876a-d585f0b5d7aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:39:05.767648 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d14292-cfc7-49e6-8fda-56ed36968fa0 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:39:05.769644 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-a2d14292-cfc7-49e6-8fda-56ed36968fa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:39:05.809872 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c387cd5-c878-4337-876a-d585f0b5d7aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:39:05.811452 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c387cd5-c878-4337-876a-d585f0b5d7aa service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:39:05.827805 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1028/2042] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:39:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:39:05.883892 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d14292-cfc7-49e6-8fda-56ed36968fa0 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:39:05.897241 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceed548-c34a-4777-8671-8f30f752a7e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25048b29787d482783ebc944f1a7df65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:39:05.898039 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceed548-c34a-4777-8671-8f30f752a7e6 service cinder] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:39:05.898463 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceed548-c34a-4777-8671-8f30f752a7e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:39:05.898703 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceed548-c34a-4777-8671-8f30f752a7e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:39:05.924268 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cceed548-c34a-4777-8671-8f30f752a7e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:39:05.925951 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cceed548-c34a-4777-8671-8f30f752a7e6 service cinder] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:39:05.945987 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1015/2043] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:39:05 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 09:39:06.201250 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c387cd5-c878-4337-876a-d585f0b5d7aa service neutron] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:39:06.203435 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-6c387cd5-c878-4337-876a-d585f0b5d7aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:39:06.224625 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c387cd5-c878-4337-876a-d585f0b5d7aa service neutron] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:39:06.250083 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef11391-dff2-4b1a-91ab-d0daf05a49f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:39:06.251024 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef11391-dff2-4b1a-91ab-d0daf05a49f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:39:06.251311 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef11391-dff2-4b1a-91ab-d0daf05a49f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:39:06.251730 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef11391-dff2-4b1a-91ab-d0daf05a49f2 admin admin] PATH_INFO: `/v3/projects/491b36ad031b4330832b24dd08713d7a` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:39:06.252882 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef11391-dff2-4b1a-91ab-d0daf05a49f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=491b36ad031b4330832b24dd08713d7a)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:39:06.255779 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef11391-dff2-4b1a-91ab-d0daf05a49f2 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:39:06.375573 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-6ef11391-dff2-4b1a-91ab-d0daf05a49f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '491b36ad031b4330832b24dd08713d7a', 'request_id': 'req-6ef11391-dff2-4b1a-91ab-d0daf05a49f2'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:39:06.383234 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-6ef11391-dff2-4b1a-91ab-d0daf05a49f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '491b36ad031b4330832b24dd08713d7a', 'request_id': 'req-6ef11391-dff2-4b1a-91ab-d0daf05a49f2'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:39:06.398920 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-6ef11391-dff2-4b1a-91ab-d0daf05a49f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '491b36ad031b4330832b24dd08713d7a', 'request_id': 'req-6ef11391-dff2-4b1a-91ab-d0daf05a49f2'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:39:06.432627 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-6ef11391-dff2-4b1a-91ab-d0daf05a49f2 admin admin] The token cache is being invalidate because project 491b36ad031b4330832b24dd08713d7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 09:39:06.433438 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-6ef11391-dff2-4b1a-91ab-d0daf05a49f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:39:06.434120 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-6ef11391-dff2-4b1a-91ab-d0daf05a49f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:39:06.436489 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1029/2044] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 14 09:39:06 2022] DELETE /identity/v3/projects/491b36ad031b4330832b24dd08713d7a => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:39:15.932639 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=44 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:39:16.420426 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=63,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:39:21.878319 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceed548-c34a-4777-8671-8f30f752a7e6 service cinder] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:39:21.879801 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-cceed548-c34a-4777-8671-8f30f752a7e6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:39:21.893824 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceed548-c34a-4777-8671-8f30f752a7e6 service cinder] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:39:21.960273 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d2b58e-a33d-47b3-b6be-460dd159fffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:39:21.961430 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d2b58e-a33d-47b3-b6be-460dd159fffb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:39:21.961720 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d2b58e-a33d-47b3-b6be-460dd159fffb admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:39:21.962029 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d2b58e-a33d-47b3-b6be-460dd159fffb admin admin] PATH_INFO: `/v3/users/8c3e934881b145548667afa8edbcea64` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:39:21.963356 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d2b58e-a33d-47b3-b6be-460dd159fffb admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c3e934881b145548667afa8edbcea64)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:39:21.965346 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d2b58e-a33d-47b3-b6be-460dd159fffb admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:39:22.014010 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-36d2b58e-a33d-47b3-b6be-460dd159fffb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c3e934881b145548667afa8edbcea64'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:39:22.021057 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-36d2b58e-a33d-47b3-b6be-460dd159fffb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c3e934881b145548667afa8edbcea64'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:39:22.021862 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-36d2b58e-a33d-47b3-b6be-460dd159fffb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c3e934881b145548667afa8edbcea64'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:39:22.030237 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-36d2b58e-a33d-47b3-b6be-460dd159fffb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c3e934881b145548667afa8edbcea64'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:39:22.031001 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-36d2b58e-a33d-47b3-b6be-460dd159fffb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c3e934881b145548667afa8edbcea64'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:39:22.052205 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1016/2045] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 14 09:39:21 2022] DELETE /identity/v3/users/8c3e934881b145548667afa8edbcea64 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 09:39:22.056778 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8312f6-0f82-4019-9fe1-ea2ca44abda1 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:39:22.057324 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8312f6-0f82-4019-9fe1-ea2ca44abda1 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:39:22.057943 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8312f6-0f82-4019-9fe1-ea2ca44abda1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:39:22.076162 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-4d8312f6-0f82-4019-9fe1-ea2ca44abda1 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:39:22.077396 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-4d8312f6-0f82-4019-9fe1-ea2ca44abda1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:39:22.139847 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1030/2046] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:39:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:39:22.149740 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d2b58e-a33d-47b3-b6be-460dd159fffb admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:39:22.151235 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-36d2b58e-a33d-47b3-b6be-460dd159fffb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:39:22.212267 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d2b58e-a33d-47b3-b6be-460dd159fffb admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:39:22.216927 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7f8007-3d47-4436-9a13-6214a1d41d9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e4a5a8965e4802a9055d332179b7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:39:22.217819 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7f8007-3d47-4436-9a13-6214a1d41d9c service neutron] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:39:22.218345 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7f8007-3d47-4436-9a13-6214a1d41d9c service neutron] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:39:22.218622 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7f8007-3d47-4436-9a13-6214a1d41d9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:39:22.228600 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7f8007-3d47-4436-9a13-6214a1d41d9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:39:22.230720 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7f8007-3d47-4436-9a13-6214a1d41d9c service neutron] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:39:22.241304 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1017/2047] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:39:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 09:39:22.521793 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8312f6-0f82-4019-9fe1-ea2ca44abda1 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:39:22.523258 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-4d8312f6-0f82-4019-9fe1-ea2ca44abda1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:39:22.536280 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8312f6-0f82-4019-9fe1-ea2ca44abda1 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:39:22.541028 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e854a22-e2a9-445e-b817-9df4ae23f5e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:39:22.542542 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e854a22-e2a9-445e-b817-9df4ae23f5e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:39:22.542829 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e854a22-e2a9-445e-b817-9df4ae23f5e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:39:22.543110 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e854a22-e2a9-445e-b817-9df4ae23f5e3 admin admin] PATH_INFO: `/v3/projects/75a7b85682854750b4609d61bae30adc` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:39:22.544381 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e854a22-e2a9-445e-b817-9df4ae23f5e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=75a7b85682854750b4609d61bae30adc)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:39:22.546349 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e854a22-e2a9-445e-b817-9df4ae23f5e3 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:39:22.593834 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-8e854a22-e2a9-445e-b817-9df4ae23f5e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75a7b85682854750b4609d61bae30adc', 'request_id': 'req-8e854a22-e2a9-445e-b817-9df4ae23f5e3'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:39:22.599752 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-8e854a22-e2a9-445e-b817-9df4ae23f5e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75a7b85682854750b4609d61bae30adc', 'request_id': 'req-8e854a22-e2a9-445e-b817-9df4ae23f5e3'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:39:22.605292 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-8e854a22-e2a9-445e-b817-9df4ae23f5e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75a7b85682854750b4609d61bae30adc', 'request_id': 'req-8e854a22-e2a9-445e-b817-9df4ae23f5e3'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:39:22.617301 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-8e854a22-e2a9-445e-b817-9df4ae23f5e3 admin admin] The token cache is being invalidate because project 75a7b85682854750b4609d61bae30adc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 09:39:22.617590 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-8e854a22-e2a9-445e-b817-9df4ae23f5e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:39:22.618265 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-8e854a22-e2a9-445e-b817-9df4ae23f5e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:39:22.619937 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1031/2048] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 14 09:39:22 2022] DELETE /identity/v3/projects/75a7b85682854750b4609d61bae30adc => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:39:22.626381 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d81780-5552-47cd-9ab9-0d6801b2cfd1 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:39:22.626677 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d81780-5552-47cd-9ab9-0d6801b2cfd1 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:39:22.626955 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d81780-5552-47cd-9ab9-0d6801b2cfd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:39:22.644909 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-b1d81780-5552-47cd-9ab9-0d6801b2cfd1 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:39:22.646112 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-b1d81780-5552-47cd-9ab9-0d6801b2cfd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:39:22.663605 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:39:22.707047 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1018/2049] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:39:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:39:22.716724 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920144b2-88e6-4f09-8b1c-81503cec2ed2 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:39:22.717020 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920144b2-88e6-4f09-8b1c-81503cec2ed2 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:39:22.717307 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920144b2-88e6-4f09-8b1c-81503cec2ed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:39:22.735160 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-920144b2-88e6-4f09-8b1c-81503cec2ed2 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:39:22.736363 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-920144b2-88e6-4f09-8b1c-81503cec2ed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:39:22.744611 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1032/2050] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:39:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:39:22.748549 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d81780-5552-47cd-9ab9-0d6801b2cfd1 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:39:22.758360 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d81780-5552-47cd-9ab9-0d6801b2cfd1 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:39:22.763474 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774ea71a-725a-48a6-8a72-3fb24b812d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:39:22.764129 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774ea71a-725a-48a6-8a72-3fb24b812d8b admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:39:22.764420 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774ea71a-725a-48a6-8a72-3fb24b812d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:39:22.764699 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774ea71a-725a-48a6-8a72-3fb24b812d8b admin admin] PATH_INFO: `/v3/domains` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:39:22.765426 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774ea71a-725a-48a6-8a72-3fb24b812d8b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:39:22.765735 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774ea71a-725a-48a6-8a72-3fb24b812d8b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:39:22.767343 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774ea71a-725a-48a6-8a72-3fb24b812d8b admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:39:22.779232 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1019/2051] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jul 14 09:39:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:39:22.783286 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920144b2-88e6-4f09-8b1c-81503cec2ed2 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:39:22.792660 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920144b2-88e6-4f09-8b1c-81503cec2ed2 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:39:22.797373 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfe155b-c2d4-4d71-b774-1f73989a4f9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:39:22.798032 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfe155b-c2d4-4d71-b774-1f73989a4f9d admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:39:22.798359 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfe155b-c2d4-4d71-b774-1f73989a4f9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:39:22.798646 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfe155b-c2d4-4d71-b774-1f73989a4f9d admin admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:39:22.799343 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfe155b-c2d4-4d71-b774-1f73989a4f9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:39:22.801288 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfe155b-c2d4-4d71-b774-1f73989a4f9d admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:39:22.826574 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1033/2052] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 14 09:39:22 2022] POST /identity/v3/projects => generated 385 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:39:22.830498 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774ea71a-725a-48a6-8a72-3fb24b812d8b admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:39:22.841328 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774ea71a-725a-48a6-8a72-3fb24b812d8b admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:39:22.896405 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4fc3a5-b17e-47ae-9b16-30932aa6ac47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:39:22.897001 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4fc3a5-b17e-47ae-9b16-30932aa6ac47 admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:39:22.897297 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4fc3a5-b17e-47ae-9b16-30932aa6ac47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:39:22.897580 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4fc3a5-b17e-47ae-9b16-30932aa6ac47 admin admin] PATH_INFO: `/v3/users` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:39:22.898327 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4fc3a5-b17e-47ae-9b16-30932aa6ac47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:39:22.900281 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4fc3a5-b17e-47ae-9b16-30932aa6ac47 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:39:22.920072 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1020/2053] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 14 09:39:22 2022] POST /identity/v3/users => generated 293 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:39:22.924174 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfe155b-c2d4-4d71-b774-1f73989a4f9d admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:39:22.934723 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfe155b-c2d4-4d71-b774-1f73989a4f9d admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:39:22.939352 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fbcc0c-c8b5-41b2-8a9d-f00fe60dba2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:39:22.940135 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fbcc0c-c8b5-41b2-8a9d-f00fe60dba2b admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:39:22.940430 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fbcc0c-c8b5-41b2-8a9d-f00fe60dba2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:39:22.940715 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fbcc0c-c8b5-41b2-8a9d-f00fe60dba2b admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:39:22.941487 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fbcc0c-c8b5-41b2-8a9d-f00fe60dba2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:39:22.943126 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fbcc0c-c8b5-41b2-8a9d-f00fe60dba2b admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:39:22.955043 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1034/2054] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 09:39:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 09:39:22.958835 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4fc3a5-b17e-47ae-9b16-30932aa6ac47 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:39:22.969978 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4fc3a5-b17e-47ae-9b16-30932aa6ac47 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:39:22.976194 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ee3738-e281-4322-9039-d2587b3a6885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:39:22.976866 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ee3738-e281-4322-9039-d2587b3a6885 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:39:22.977155 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ee3738-e281-4322-9039-d2587b3a6885 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:39:22.977438 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ee3738-e281-4322-9039-d2587b3a6885 admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:39:22.978180 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ee3738-e281-4322-9039-d2587b3a6885 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:39:22.979798 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ee3738-e281-4322-9039-d2587b3a6885 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:39:22.990357 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1021/2055] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 09:39:22 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:39:22.995316 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fbcc0c-c8b5-41b2-8a9d-f00fe60dba2b admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:39:23.005777 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fbcc0c-c8b5-41b2-8a9d-f00fe60dba2b admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:39:23.013132 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a56495-1d5b-4d94-b2b5-a4da43f3cd44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:39:23.014056 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a56495-1d5b-4d94-b2b5-a4da43f3cd44 admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:39:23.014373 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a56495-1d5b-4d94-b2b5-a4da43f3cd44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:39:23.014655 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a56495-1d5b-4d94-b2b5-a4da43f3cd44 admin admin] PATH_INFO: `/v3/projects/6d48c64f286a4510a83d07bd9eb9449e/users/93132e89a8ed42e58754ff9009d95a2b/roles/17dfac38a2e540fea229af7de99911bb` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:39:23.032098 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a56495-1d5b-4d94-b2b5-a4da43f3cd44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d48c64f286a4510a83d07bd9eb9449e, user_id=93132e89a8ed42e58754ff9009d95a2b, role_id=17dfac38a2e540fea229af7de99911bb)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:39:23.034808 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a56495-1d5b-4d94-b2b5-a4da43f3cd44 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:39:23.060370 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1035/2056] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 14 09:39:22 2022] PUT /identity/v3/projects/6d48c64f286a4510a83d07bd9eb9449e/users/93132e89a8ed42e58754ff9009d95a2b/roles/17dfac38a2e540fea229af7de99911bb => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 09:39:23.065489 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e5923b-b354-4df3-b4a1-b59fe1672986 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:39:23.065787 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e5923b-b354-4df3-b4a1-b59fe1672986 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:39:23.066073 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e5923b-b354-4df3-b4a1-b59fe1672986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:39:23.084267 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-54e5923b-b354-4df3-b4a1-b59fe1672986 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:39:23.085476 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-54e5923b-b354-4df3-b4a1-b59fe1672986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:39:23.148413 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1022/2057] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:39:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:39:23.157743 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a56495-1d5b-4d94-b2b5-a4da43f3cd44 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:39:23.159447 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-01a56495-1d5b-4d94-b2b5-a4da43f3cd44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:39:23.180728 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:39:23.217910 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a56495-1d5b-4d94-b2b5-a4da43f3cd44 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:39:23.221496 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9343429-43cc-4937-b25d-36a8ba3c5da8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e4a5a8965e4802a9055d332179b7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:39:23.222139 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9343429-43cc-4937-b25d-36a8ba3c5da8 service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:39:23.222455 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9343429-43cc-4937-b25d-36a8ba3c5da8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:39:23.222735 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9343429-43cc-4937-b25d-36a8ba3c5da8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:39:23.231716 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9343429-43cc-4937-b25d-36a8ba3c5da8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:39:23.233125 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9343429-43cc-4937-b25d-36a8ba3c5da8 service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:39:23.243011 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1036/2058] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:39:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:39:28.116053 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e5923b-b354-4df3-b4a1-b59fe1672986 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:39:28.117911 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-54e5923b-b354-4df3-b4a1-b59fe1672986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:39:28.135070 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e5923b-b354-4df3-b4a1-b59fe1672986 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:39:28.141063 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02f22b4-2713-4d90-8f94-3f91abf5d1b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:39:28.142090 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02f22b4-2713-4d90-8f94-3f91abf5d1b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:39:28.142638 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02f22b4-2713-4d90-8f94-3f91abf5d1b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:39:28.143016 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02f22b4-2713-4d90-8f94-3f91abf5d1b0 admin admin] PATH_INFO: `/v3/users/b20150b5de18430485429b4f72ee65a1` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:39:28.144374 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02f22b4-2713-4d90-8f94-3f91abf5d1b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b20150b5de18430485429b4f72ee65a1)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:39:28.146455 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02f22b4-2713-4d90-8f94-3f91abf5d1b0 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:39:28.218224 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:39:28.257902 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-f02f22b4-2713-4d90-8f94-3f91abf5d1b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b20150b5de18430485429b4f72ee65a1'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:39:28.274420 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-f02f22b4-2713-4d90-8f94-3f91abf5d1b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b20150b5de18430485429b4f72ee65a1'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:39:28.279424 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-f02f22b4-2713-4d90-8f94-3f91abf5d1b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b20150b5de18430485429b4f72ee65a1'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:39:28.301799 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-f02f22b4-2713-4d90-8f94-3f91abf5d1b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b20150b5de18430485429b4f72ee65a1'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:39:28.302641 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-f02f22b4-2713-4d90-8f94-3f91abf5d1b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b20150b5de18430485429b4f72ee65a1'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:39:28.340842 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1023/2059] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 14 09:39:28 2022] DELETE /identity/v3/users/b20150b5de18430485429b4f72ee65a1 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:39:28.345520 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b808ed-dcac-489a-9890-c94533abcc81 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:39:28.346478 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b808ed-dcac-489a-9890-c94533abcc81 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:39:28.346970 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b808ed-dcac-489a-9890-c94533abcc81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:39:28.367383 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-d2b808ed-dcac-489a-9890-c94533abcc81 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:39:28.368907 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-d2b808ed-dcac-489a-9890-c94533abcc81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:39:28.486627 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1037/2060] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:39:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:39:28.497018 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02f22b4-2713-4d90-8f94-3f91abf5d1b0 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:39:28.498554 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-f02f22b4-2713-4d90-8f94-3f91abf5d1b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:39:28.549141 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7790d4-4c3f-4f6b-b873-75ec540136ee None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:39:28.549433 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7790d4-4c3f-4f6b-b873-75ec540136ee None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:39:28.549713 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7790d4-4c3f-4f6b-b873-75ec540136ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:39:28.574432 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02f22b4-2713-4d90-8f94-3f91abf5d1b0 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:39:28.578385 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09a34f4-55cd-4d15-bb22-869d1e1bf9b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e4a5a8965e4802a9055d332179b7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:39:28.579191 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09a34f4-55cd-4d15-bb22-869d1e1bf9b3 service neutron] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:39:28.579552 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09a34f4-55cd-4d15-bb22-869d1e1bf9b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:39:28.580013 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09a34f4-55cd-4d15-bb22-869d1e1bf9b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:39:28.582770 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-1f7790d4-4c3f-4f6b-b873-75ec540136ee None None] MFA Rules not processed for user `93132e89a8ed42e58754ff9009d95a2b`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:39:28.583997 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-1f7790d4-4c3f-4f6b-b873-75ec540136ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:39:28.590747 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09a34f4-55cd-4d15-bb22-869d1e1bf9b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:39:28.592191 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09a34f4-55cd-4d15-bb22-869d1e1bf9b3 service neutron] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:39:28.602716 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1024/2061] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:39:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 09:39:28.669454 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1038/2062] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:39:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 09:39:28.674276 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09a34f4-55cd-4d15-bb22-869d1e1bf9b3 service neutron] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:39:28.675830 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-b09a34f4-55cd-4d15-bb22-869d1e1bf9b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:39:28.688711 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09a34f4-55cd-4d15-bb22-869d1e1bf9b3 service neutron] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:39:28.693329 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e4d83d-7ac3-4cf4-a50f-fec35bc895e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:39:28.693993 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e4d83d-7ac3-4cf4-a50f-fec35bc895e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:39:28.694326 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e4d83d-7ac3-4cf4-a50f-fec35bc895e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:39:28.694611 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e4d83d-7ac3-4cf4-a50f-fec35bc895e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:39:28.695455 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e4d83d-7ac3-4cf4-a50f-fec35bc895e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:39:28.698136 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e4d83d-7ac3-4cf4-a50f-fec35bc895e7 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:39:28.732329 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1025/2063] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 14 09:39:28 2022] POST /identity/v3/projects => generated 383 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:39:28.733469 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7790d4-4c3f-4f6b-b873-75ec540136ee None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:39:28.748732 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7790d4-4c3f-4f6b-b873-75ec540136ee None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:39:28.814992 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:39:28.825095 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c90b69-1d99-4bc2-a07f-e05ba9f7521b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:39:28.826271 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c90b69-1d99-4bc2-a07f-e05ba9f7521b admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:39:28.828445 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c90b69-1d99-4bc2-a07f-e05ba9f7521b admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:39:28.828884 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c90b69-1d99-4bc2-a07f-e05ba9f7521b admin admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:39:28.829735 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c90b69-1d99-4bc2-a07f-e05ba9f7521b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:39:28.832566 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c90b69-1d99-4bc2-a07f-e05ba9f7521b admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:39:28.858755 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1039/2064] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 14 09:39:28 2022] POST /identity/v3/users => generated 298 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 09:39:28.862695 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e4d83d-7ac3-4cf4-a50f-fec35bc895e7 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:39:28.876120 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e4d83d-7ac3-4cf4-a50f-fec35bc895e7 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:39:28.884133 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41d3d8f-2e30-44d4-a50b-10f051a9e766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:39:28.885047 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41d3d8f-2e30-44d4-a50b-10f051a9e766 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:39:28.885385 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41d3d8f-2e30-44d4-a50b-10f051a9e766 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:39:28.885772 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41d3d8f-2e30-44d4-a50b-10f051a9e766 admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:39:28.886621 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41d3d8f-2e30-44d4-a50b-10f051a9e766 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:39:28.888550 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41d3d8f-2e30-44d4-a50b-10f051a9e766 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:39:28.894735 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c90b69-1d99-4bc2-a07f-e05ba9f7521b admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:39:28.896527 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-29c90b69-1d99-4bc2-a07f-e05ba9f7521b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:39:28.903770 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1026/2065] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 09:39:28 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 09:39:28.905393 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41d3d8f-2e30-44d4-a50b-10f051a9e766 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:39:28.913715 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c90b69-1d99-4bc2-a07f-e05ba9f7521b admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:39:28.919995 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41d3d8f-2e30-44d4-a50b-10f051a9e766 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:39:28.927807 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7476c9c9-7ad7-437e-84c4-cdfa968146e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:39:28.928156 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5489fe8-520d-4eb8-924e-d492c98ff40e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:39:28.928697 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7476c9c9-7ad7-437e-84c4-cdfa968146e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:39:28.928981 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7476c9c9-7ad7-437e-84c4-cdfa968146e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:39:28.929098 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5489fe8-520d-4eb8-924e-d492c98ff40e admin admin] REQUEST_METHOD: `PUT` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:39:28.929259 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7476c9c9-7ad7-437e-84c4-cdfa968146e7 admin admin] PATH_INFO: `/v3/projects/335e467616a44ee6be811e7cdc57d435` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:39:28.929361 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5489fe8-520d-4eb8-924e-d492c98ff40e admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:39:28.929591 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5489fe8-520d-4eb8-924e-d492c98ff40e admin admin] PATH_INFO: `/v3/projects/badd2f59d0904d9a80c947eb8f50bce5/users/6f0537acb3d948dc8b756cf45c8347e1/roles/e3965bd0d5f1427a86a313c0c90bfef3` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:39:28.930604 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7476c9c9-7ad7-437e-84c4-cdfa968146e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=335e467616a44ee6be811e7cdc57d435)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:39:28.933046 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7476c9c9-7ad7-437e-84c4-cdfa968146e7 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:39:28.947594 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5489fe8-520d-4eb8-924e-d492c98ff40e admin admin] RBAC: Authorizing `identity:create_grant(project_id=badd2f59d0904d9a80c947eb8f50bce5, user_id=6f0537acb3d948dc8b756cf45c8347e1, role_id=e3965bd0d5f1427a86a313c0c90bfef3)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:39:28.950322 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5489fe8-520d-4eb8-924e-d492c98ff40e admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:39:28.970983 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1027/2066] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 14 09:39:28 2022] PUT /identity/v3/projects/badd2f59d0904d9a80c947eb8f50bce5/users/6f0537acb3d948dc8b756cf45c8347e1/roles/e3965bd0d5f1427a86a313c0c90bfef3 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 09:39:28.974939 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5489fe8-520d-4eb8-924e-d492c98ff40e admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:39:28.995707 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-7476c9c9-7ad7-437e-84c4-cdfa968146e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '335e467616a44ee6be811e7cdc57d435', 'request_id': 'req-7476c9c9-7ad7-437e-84c4-cdfa968146e7'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:39:29.007309 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-7476c9c9-7ad7-437e-84c4-cdfa968146e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '335e467616a44ee6be811e7cdc57d435', 'request_id': 'req-7476c9c9-7ad7-437e-84c4-cdfa968146e7'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:39:29.016838 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-7476c9c9-7ad7-437e-84c4-cdfa968146e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '335e467616a44ee6be811e7cdc57d435', 'request_id': 'req-7476c9c9-7ad7-437e-84c4-cdfa968146e7'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:39:29.032713 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=91,keystone:DELETE=6,keystone:INSERT=3 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:39:29.032906 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-7476c9c9-7ad7-437e-84c4-cdfa968146e7 admin admin] The token cache is being invalidate because project 335e467616a44ee6be811e7cdc57d435 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 09:39:29.033112 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-7476c9c9-7ad7-437e-84c4-cdfa968146e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:39:29.033912 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-7476c9c9-7ad7-437e-84c4-cdfa968146e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:39:29.036074 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1040/2067] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 14 09:39:28 2022] DELETE /identity/v3/projects/335e467616a44ee6be811e7cdc57d435 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 09:39:29.040712 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37f159a-5985-450e-9009-d647736b7ed5 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:39:29.041096 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37f159a-5985-450e-9009-d647736b7ed5 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:39:29.042592 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37f159a-5985-450e-9009-d647736b7ed5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:39:29.058473 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5489fe8-520d-4eb8-924e-d492c98ff40e admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:39:29.068669 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-a37f159a-5985-450e-9009-d647736b7ed5 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:39:29.070100 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-a37f159a-5985-450e-9009-d647736b7ed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:39:29.136581 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbce096-7b63-46e6-b770-cfa0b6a2bfbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:39:29.137263 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbce096-7b63-46e6-b770-cfa0b6a2bfbb admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:39:29.137543 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbce096-7b63-46e6-b770-cfa0b6a2bfbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:39:29.137822 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbce096-7b63-46e6-b770-cfa0b6a2bfbb admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:39:29.138599 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbce096-7b63-46e6-b770-cfa0b6a2bfbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:39:29.140188 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbce096-7b63-46e6-b770-cfa0b6a2bfbb admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:39:29.152360 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1041/2068] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:39:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 09:39:29.153225 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1028/2069] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 09:39:28 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 09:39:29.159180 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37f159a-5985-450e-9009-d647736b7ed5 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:39:29.159702 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2df2da-4ea9-42fc-a265-a81fd4a6afc3 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:39:29.160005 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2df2da-4ea9-42fc-a265-a81fd4a6afc3 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:39:29.160293 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2df2da-4ea9-42fc-a265-a81fd4a6afc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:39:29.164037 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-a37f159a-5985-450e-9009-d647736b7ed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:39:29.176514 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37f159a-5985-450e-9009-d647736b7ed5 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:39:29.180183 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-0d2df2da-4ea9-42fc-a265-a81fd4a6afc3 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:39:29.181114 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-0d2df2da-4ea9-42fc-a265-a81fd4a6afc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:39:29.181974 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39041365-2f64-4107-bf39-716e28d8ef34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:39:29.182905 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39041365-2f64-4107-bf39-716e28d8ef34 admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:39:29.183179 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39041365-2f64-4107-bf39-716e28d8ef34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:39:29.183479 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39041365-2f64-4107-bf39-716e28d8ef34 admin admin] PATH_INFO: `/v3/projects/badd2f59d0904d9a80c947eb8f50bce5/users/6f0537acb3d948dc8b756cf45c8347e1/roles/e3965bd0d5f1427a86a313c0c90bfef3` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:39:29.185745 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39041365-2f64-4107-bf39-716e28d8ef34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=badd2f59d0904d9a80c947eb8f50bce5, user_id=6f0537acb3d948dc8b756cf45c8347e1, role_id=e3965bd0d5f1427a86a313c0c90bfef3)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:39:29.189740 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39041365-2f64-4107-bf39-716e28d8ef34 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:39:29.189836 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1029/2070] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:39:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:39:29.194359 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2df2da-4ea9-42fc-a265-a81fd4a6afc3 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:39:29.202928 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1042/2071] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 14 09:39:29 2022] PUT /identity/v3/projects/badd2f59d0904d9a80c947eb8f50bce5/users/6f0537acb3d948dc8b756cf45c8347e1/roles/e3965bd0d5f1427a86a313c0c90bfef3 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:39:29.203897 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2df2da-4ea9-42fc-a265-a81fd4a6afc3 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:39:29.272719 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a35d02-9f55-46c7-96c6-c590736fbe16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:39:29.273441 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a35d02-9f55-46c7-96c6-c590736fbe16 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:39:29.273726 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a35d02-9f55-46c7-96c6-c590736fbe16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:39:29.274001 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a35d02-9f55-46c7-96c6-c590736fbe16 admin admin] PATH_INFO: `/v3/domains` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:39:29.274781 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a35d02-9f55-46c7-96c6-c590736fbe16 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:39:29.275143 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a35d02-9f55-46c7-96c6-c590736fbe16 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:39:29.277543 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a35d02-9f55-46c7-96c6-c590736fbe16 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:39:29.296143 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1030/2072] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jul 14 09:39:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 09:39:29.297367 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39041365-2f64-4107-bf39-716e28d8ef34 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:39:29.310908 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39041365-2f64-4107-bf39-716e28d8ef34 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:39:29.329080 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93dccc1-8ba7-4c96-acaf-18d38c019169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:39:29.329782 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93dccc1-8ba7-4c96-acaf-18d38c019169 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:39:29.330075 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93dccc1-8ba7-4c96-acaf-18d38c019169 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:39:29.330441 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93dccc1-8ba7-4c96-acaf-18d38c019169 admin admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:39:29.331341 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93dccc1-8ba7-4c96-acaf-18d38c019169 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:39:29.334221 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93dccc1-8ba7-4c96-acaf-18d38c019169 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:39:29.373541 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1043/2073] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 14 09:39:29 2022] POST /identity/v3/projects => generated 359 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 09:39:29.374685 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a35d02-9f55-46c7-96c6-c590736fbe16 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:39:29.393648 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a35d02-9f55-46c7-96c6-c590736fbe16 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:39:29.482948 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f5a69d-7859-4976-849a-98f757510e38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:39:29.483737 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f5a69d-7859-4976-849a-98f757510e38 admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:39:29.484233 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f5a69d-7859-4976-849a-98f757510e38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:39:29.484765 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f5a69d-7859-4976-849a-98f757510e38 admin admin] PATH_INFO: `/v3/users` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:39:29.485612 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f5a69d-7859-4976-849a-98f757510e38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:39:29.487984 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f5a69d-7859-4976-849a-98f757510e38 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:39:29.526632 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1031/2074] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 14 09:39:29 2022] POST /identity/v3/users => generated 280 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 09:39:29.530823 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93dccc1-8ba7-4c96-acaf-18d38c019169 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:39:29.549453 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93dccc1-8ba7-4c96-acaf-18d38c019169 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:39:29.558171 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5e7ee9-8a9e-4bd9-b288-27998462e0ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:39:29.559027 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5e7ee9-8a9e-4bd9-b288-27998462e0ac admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:39:29.559444 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5e7ee9-8a9e-4bd9-b288-27998462e0ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:39:29.559737 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5e7ee9-8a9e-4bd9-b288-27998462e0ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:39:29.560565 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5e7ee9-8a9e-4bd9-b288-27998462e0ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:39:29.562800 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5e7ee9-8a9e-4bd9-b288-27998462e0ac admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:39:29.596254 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1044/2075] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 09:39:29 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 09:39:29.600391 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f5a69d-7859-4976-849a-98f757510e38 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:39:29.614390 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f5a69d-7859-4976-849a-98f757510e38 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:39:29.625608 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16a7def-4a64-4316-81d1-6b12d45a0171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:39:29.626324 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16a7def-4a64-4316-81d1-6b12d45a0171 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:39:29.626612 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16a7def-4a64-4316-81d1-6b12d45a0171 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:39:29.626900 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16a7def-4a64-4316-81d1-6b12d45a0171 admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:39:29.627654 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16a7def-4a64-4316-81d1-6b12d45a0171 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:39:29.630603 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16a7def-4a64-4316-81d1-6b12d45a0171 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:39:29.632432 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:39:29.661405 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1032/2076] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 09:39:29 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:39:29.665546 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5e7ee9-8a9e-4bd9-b288-27998462e0ac admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:39:29.691646 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5e7ee9-8a9e-4bd9-b288-27998462e0ac admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:39:29.700576 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3ea9a2-161b-4fdc-974e-137422b29dd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:39:29.701491 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3ea9a2-161b-4fdc-974e-137422b29dd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:39:29.702026 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3ea9a2-161b-4fdc-974e-137422b29dd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:39:29.702143 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3ea9a2-161b-4fdc-974e-137422b29dd1 admin admin] PATH_INFO: `/v3/projects/c9d56a35da534cfebb1ad179265b1e85/users/231ef82e43f44940bb17761b5d986c44/roles/17dfac38a2e540fea229af7de99911bb` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:39:29.756892 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3ea9a2-161b-4fdc-974e-137422b29dd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9d56a35da534cfebb1ad179265b1e85, user_id=231ef82e43f44940bb17761b5d986c44, role_id=17dfac38a2e540fea229af7de99911bb)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:39:29.759637 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3ea9a2-161b-4fdc-974e-137422b29dd1 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:39:29.769403 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=86,keystone:INSERT=7,keystone:DELETE=7 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:39:29.789925 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1045/2077] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 14 09:39:29 2022] PUT /identity/v3/projects/c9d56a35da534cfebb1ad179265b1e85/users/231ef82e43f44940bb17761b5d986c44/roles/17dfac38a2e540fea229af7de99911bb => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:39:29.801247 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92f6be2-6553-45db-b099-3fa420ca60b2 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:39:29.801894 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92f6be2-6553-45db-b099-3fa420ca60b2 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:39:29.802419 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92f6be2-6553-45db-b099-3fa420ca60b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:39:29.834601 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-b92f6be2-6553-45db-b099-3fa420ca60b2 None None] MFA Rules not processed for user `231ef82e43f44940bb17761b5d986c44`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:39:29.836563 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-b92f6be2-6553-45db-b099-3fa420ca60b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:39:29.958448 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1033/2078] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:39:29 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:39:29.993692 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3ea9a2-161b-4fdc-974e-137422b29dd1 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:39:29.996786 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-7f3ea9a2-161b-4fdc-974e-137422b29dd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:39:30.064858 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3ea9a2-161b-4fdc-974e-137422b29dd1 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:39:30.069368 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae516f3-6236-4489-99ee-9006602d396d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25048b29787d482783ebc944f1a7df65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:39:30.070126 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae516f3-6236-4489-99ee-9006602d396d service cinder] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:39:30.071295 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae516f3-6236-4489-99ee-9006602d396d service cinder] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:39:30.071295 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae516f3-6236-4489-99ee-9006602d396d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:39:30.083510 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae516f3-6236-4489-99ee-9006602d396d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:39:30.085149 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae516f3-6236-4489-99ee-9006602d396d service cinder] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:39:30.096818 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1046/2079] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:39:29 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:39:30.118225 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92f6be2-6553-45db-b099-3fa420ca60b2 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:39:30.198224 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92f6be2-6553-45db-b099-3fa420ca60b2 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:39:30.203390 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79e5517-9da7-4c97-9fe4-a0bc036197e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:39:30.204450 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79e5517-9da7-4c97-9fe4-a0bc036197e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:39:30.204833 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79e5517-9da7-4c97-9fe4-a0bc036197e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:39:30.205258 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79e5517-9da7-4c97-9fe4-a0bc036197e1 admin admin] PATH_INFO: `/v3/users/231ef82e43f44940bb17761b5d986c44` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:39:30.206647 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79e5517-9da7-4c97-9fe4-a0bc036197e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=231ef82e43f44940bb17761b5d986c44)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:39:30.208685 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79e5517-9da7-4c97-9fe4-a0bc036197e1 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:39:30.276212 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-e79e5517-9da7-4c97-9fe4-a0bc036197e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '231ef82e43f44940bb17761b5d986c44'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:39:30.284940 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-e79e5517-9da7-4c97-9fe4-a0bc036197e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '231ef82e43f44940bb17761b5d986c44'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:39:30.285883 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-e79e5517-9da7-4c97-9fe4-a0bc036197e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '231ef82e43f44940bb17761b5d986c44'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:39:30.296360 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-e79e5517-9da7-4c97-9fe4-a0bc036197e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '231ef82e43f44940bb17761b5d986c44'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:39:30.297827 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-e79e5517-9da7-4c97-9fe4-a0bc036197e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '231ef82e43f44940bb17761b5d986c44'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:39:30.324108 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1034/2080] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 14 09:39:30 2022] DELETE /identity/v3/users/231ef82e43f44940bb17761b5d986c44 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:39:30.326320 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39a5cc8-540a-44eb-af88-0abf1535f35f None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:39:30.326816 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39a5cc8-540a-44eb-af88-0abf1535f35f None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:39:30.327491 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39a5cc8-540a-44eb-af88-0abf1535f35f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:39:30.351843 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-b39a5cc8-540a-44eb-af88-0abf1535f35f None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:39:30.353323 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-b39a5cc8-540a-44eb-af88-0abf1535f35f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:39:30.439574 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1047/2081] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:39:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:39:30.445551 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79e5517-9da7-4c97-9fe4-a0bc036197e1 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:39:30.448588 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-e79e5517-9da7-4c97-9fe4-a0bc036197e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:39:30.457818 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:39:30.524090 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79e5517-9da7-4c97-9fe4-a0bc036197e1 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:39:30.529001 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603c27e7-0281-4436-bf87-fe4161b69738 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e4a5a8965e4802a9055d332179b7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:39:30.529670 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603c27e7-0281-4436-bf87-fe4161b69738 service neutron] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:39:30.529954 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603c27e7-0281-4436-bf87-fe4161b69738 service neutron] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:39:30.530256 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603c27e7-0281-4436-bf87-fe4161b69738 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:39:30.542010 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603c27e7-0281-4436-bf87-fe4161b69738 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:39:30.543513 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603c27e7-0281-4436-bf87-fe4161b69738 service neutron] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:39:30.566055 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1035/2082] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:39:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:39:31.029886 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39a5cc8-540a-44eb-af88-0abf1535f35f None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:39:31.031404 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-b39a5cc8-540a-44eb-af88-0abf1535f35f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:39:31.047776 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39a5cc8-540a-44eb-af88-0abf1535f35f None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:39:31.053963 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aac087-5cd4-489f-b9e6-a21c822e601d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:39:31.055306 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aac087-5cd4-489f-b9e6-a21c822e601d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:39:31.055598 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aac087-5cd4-489f-b9e6-a21c822e601d admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:39:31.055881 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aac087-5cd4-489f-b9e6-a21c822e601d admin admin] PATH_INFO: `/v3/projects/c9d56a35da534cfebb1ad179265b1e85` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:39:31.057761 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22aac087-5cd4-489f-b9e6-a21c822e601d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9d56a35da534cfebb1ad179265b1e85)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:39:31.059790 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22aac087-5cd4-489f-b9e6-a21c822e601d admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:39:31.141566 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-22aac087-5cd4-489f-b9e6-a21c822e601d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9d56a35da534cfebb1ad179265b1e85', 'request_id': 'req-22aac087-5cd4-489f-b9e6-a21c822e601d'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:39:31.149071 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-22aac087-5cd4-489f-b9e6-a21c822e601d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9d56a35da534cfebb1ad179265b1e85', 'request_id': 'req-22aac087-5cd4-489f-b9e6-a21c822e601d'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:39:31.157468 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-22aac087-5cd4-489f-b9e6-a21c822e601d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9d56a35da534cfebb1ad179265b1e85', 'request_id': 'req-22aac087-5cd4-489f-b9e6-a21c822e601d'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:39:31.184411 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-22aac087-5cd4-489f-b9e6-a21c822e601d admin admin] The token cache is being invalidate because project c9d56a35da534cfebb1ad179265b1e85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 09:39:31.184711 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-22aac087-5cd4-489f-b9e6-a21c822e601d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:39:31.186702 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-22aac087-5cd4-489f-b9e6-a21c822e601d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:39:31.188343 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1048/2083] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 14 09:39:31 2022] DELETE /identity/v3/projects/c9d56a35da534cfebb1ad179265b1e85 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:39:31.193337 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fca989-2cbe-4342-a912-0dee1e64d62e None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:39:31.194401 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fca989-2cbe-4342-a912-0dee1e64d62e None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:39:31.194913 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fca989-2cbe-4342-a912-0dee1e64d62e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:39:31.217788 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-f7fca989-2cbe-4342-a912-0dee1e64d62e None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:39:31.220073 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-f7fca989-2cbe-4342-a912-0dee1e64d62e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:39:31.312780 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1036/2084] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:39:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:39:31.321701 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076a850d-4c4f-4499-ba8d-155d50afac5d None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:39:31.322722 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076a850d-4c4f-4499-ba8d-155d50afac5d None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:39:31.322946 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076a850d-4c4f-4499-ba8d-155d50afac5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:39:31.345723 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-076a850d-4c4f-4499-ba8d-155d50afac5d None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:39:31.347021 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-076a850d-4c4f-4499-ba8d-155d50afac5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:39:31.357762 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1049/2085] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:39:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:39:31.362111 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fca989-2cbe-4342-a912-0dee1e64d62e None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:39:31.373574 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fca989-2cbe-4342-a912-0dee1e64d62e None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:39:31.378852 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed0dea8-97ff-4a93-8b81-b1138f338336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:39:31.379605 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed0dea8-97ff-4a93-8b81-b1138f338336 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:39:31.379969 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed0dea8-97ff-4a93-8b81-b1138f338336 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:39:31.380349 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed0dea8-97ff-4a93-8b81-b1138f338336 admin admin] PATH_INFO: `/v3/domains` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:39:31.381278 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed0dea8-97ff-4a93-8b81-b1138f338336 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:39:31.381666 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed0dea8-97ff-4a93-8b81-b1138f338336 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:39:31.383422 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed0dea8-97ff-4a93-8b81-b1138f338336 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:39:31.398238 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1037/2086] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jul 14 09:39:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:39:31.402363 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076a850d-4c4f-4499-ba8d-155d50afac5d None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:39:31.417376 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076a850d-4c4f-4499-ba8d-155d50afac5d None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:39:31.423055 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4ab3b3-553c-4800-aad1-9dceb5a96202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:39:31.425015 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4ab3b3-553c-4800-aad1-9dceb5a96202 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:39:31.425421 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4ab3b3-553c-4800-aad1-9dceb5a96202 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:39:31.425804 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4ab3b3-553c-4800-aad1-9dceb5a96202 admin admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:39:31.426653 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4ab3b3-553c-4800-aad1-9dceb5a96202 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:39:31.429611 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4ab3b3-553c-4800-aad1-9dceb5a96202 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:39:31.451762 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:39:31.476944 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1050/2087] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 14 09:39:31 2022] POST /identity/v3/projects => generated 371 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 09:39:31.477365 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed0dea8-97ff-4a93-8b81-b1138f338336 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:39:31.489861 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed0dea8-97ff-4a93-8b81-b1138f338336 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:39:31.604604 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f736e7-91e7-45d5-b337-f352804f242b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:39:31.605426 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f736e7-91e7-45d5-b337-f352804f242b admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:39:31.606142 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f736e7-91e7-45d5-b337-f352804f242b admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:39:31.606505 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f736e7-91e7-45d5-b337-f352804f242b admin admin] PATH_INFO: `/v3/users` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:39:31.607285 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f736e7-91e7-45d5-b337-f352804f242b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:39:31.610969 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f736e7-91e7-45d5-b337-f352804f242b admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:39:31.650163 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1038/2088] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 14 09:39:31 2022] POST /identity/v3/users => generated 286 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:39:31.654959 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4ab3b3-553c-4800-aad1-9dceb5a96202 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:39:31.669570 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4ab3b3-553c-4800-aad1-9dceb5a96202 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:39:31.681544 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ac9d18-2d72-4df9-80fd-c42c21170c14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:39:31.682764 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ac9d18-2d72-4df9-80fd-c42c21170c14 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:39:31.683278 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ac9d18-2d72-4df9-80fd-c42c21170c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:39:31.683736 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ac9d18-2d72-4df9-80fd-c42c21170c14 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:39:31.684778 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ac9d18-2d72-4df9-80fd-c42c21170c14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:39:31.686876 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ac9d18-2d72-4df9-80fd-c42c21170c14 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:39:31.704236 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1051/2089] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 09:39:31 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:39:31.708278 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f736e7-91e7-45d5-b337-f352804f242b admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:39:31.724021 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f736e7-91e7-45d5-b337-f352804f242b admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:39:31.731116 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8eee1c-1bb5-4798-8299-158aa4c00cec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:39:31.731817 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8eee1c-1bb5-4798-8299-158aa4c00cec admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:39:31.732153 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8eee1c-1bb5-4798-8299-158aa4c00cec admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:39:31.732441 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8eee1c-1bb5-4798-8299-158aa4c00cec admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:39:31.733243 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8eee1c-1bb5-4798-8299-158aa4c00cec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:39:31.734997 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8eee1c-1bb5-4798-8299-158aa4c00cec admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:39:31.749799 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1039/2090] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 09:39:31 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 09:39:31.754216 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ac9d18-2d72-4df9-80fd-c42c21170c14 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:39:31.769017 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ac9d18-2d72-4df9-80fd-c42c21170c14 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:39:31.780733 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d03f1f-cec7-441b-9adc-38bc5ccba81a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:39:31.782161 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d03f1f-cec7-441b-9adc-38bc5ccba81a admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:39:31.782792 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d03f1f-cec7-441b-9adc-38bc5ccba81a admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:39:31.783328 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d03f1f-cec7-441b-9adc-38bc5ccba81a admin admin] PATH_INFO: `/v3/projects/8912a4453d094df58486417ebacfa14c/users/0b818be48fe94da3b7b0c1585d1a376b/roles/17dfac38a2e540fea229af7de99911bb` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:39:31.805910 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d03f1f-cec7-441b-9adc-38bc5ccba81a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8912a4453d094df58486417ebacfa14c, user_id=0b818be48fe94da3b7b0c1585d1a376b, role_id=17dfac38a2e540fea229af7de99911bb)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:39:31.813492 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d03f1f-cec7-441b-9adc-38bc5ccba81a admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:39:31.867985 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1052/2091] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 14 09:39:31 2022] PUT /identity/v3/projects/8912a4453d094df58486417ebacfa14c/users/0b818be48fe94da3b7b0c1585d1a376b/roles/17dfac38a2e540fea229af7de99911bb => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:39:31.873667 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e992be1d-dbb8-469a-b27e-cda86d3618b3 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:39:31.873960 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e992be1d-dbb8-469a-b27e-cda86d3618b3 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:39:31.874268 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e992be1d-dbb8-469a-b27e-cda86d3618b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:39:31.892746 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-e992be1d-dbb8-469a-b27e-cda86d3618b3 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:39:31.893991 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-e992be1d-dbb8-469a-b27e-cda86d3618b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:39:31.903581 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:39:32.019367 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1040/2092] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:39:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:39:32.038308 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d03f1f-cec7-441b-9adc-38bc5ccba81a admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:39:32.040730 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-c6d03f1f-cec7-441b-9adc-38bc5ccba81a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:39:32.187466 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d03f1f-cec7-441b-9adc-38bc5ccba81a admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:39:32.193378 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e966f4eb-0b44-40db-8ac4-a3e7a2ccbb0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e4a5a8965e4802a9055d332179b7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:39:32.194341 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e966f4eb-0b44-40db-8ac4-a3e7a2ccbb0f service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:39:32.195949 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e966f4eb-0b44-40db-8ac4-a3e7a2ccbb0f service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:39:32.195949 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e966f4eb-0b44-40db-8ac4-a3e7a2ccbb0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:39:32.212517 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e966f4eb-0b44-40db-8ac4-a3e7a2ccbb0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:39:32.215411 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e966f4eb-0b44-40db-8ac4-a3e7a2ccbb0f service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:39:32.227855 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1053/2093] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:39:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 09:39:33.263264 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3cf3bd-f6a9-40d1-b6ad-5267aee718e7 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:39:33.263749 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3cf3bd-f6a9-40d1-b6ad-5267aee718e7 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:39:33.263913 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3cf3bd-f6a9-40d1-b6ad-5267aee718e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:39:33.328797 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-fc3cf3bd-f6a9-40d1-b6ad-5267aee718e7 None None] MFA Rules not processed for user `0b818be48fe94da3b7b0c1585d1a376b`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:39:33.330029 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-fc3cf3bd-f6a9-40d1-b6ad-5267aee718e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:39:33.433452 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1041/2094] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:39:33 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:39:33.442117 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e966f4eb-0b44-40db-8ac4-a3e7a2ccbb0f service neutron] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:39:33.444345 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-e966f4eb-0b44-40db-8ac4-a3e7a2ccbb0f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:39:33.563428 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e966f4eb-0b44-40db-8ac4-a3e7a2ccbb0f service neutron] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:39:33.571761 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc82244-ea86-4d69-a0a8-5e994a434e0d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25048b29787d482783ebc944f1a7df65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:39:33.572496 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc82244-ea86-4d69-a0a8-5e994a434e0d service cinder] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:39:33.572783 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc82244-ea86-4d69-a0a8-5e994a434e0d service cinder] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:39:33.573062 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc82244-ea86-4d69-a0a8-5e994a434e0d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:39:33.596694 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc82244-ea86-4d69-a0a8-5e994a434e0d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:39:33.598202 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc82244-ea86-4d69-a0a8-5e994a434e0d service cinder] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:39:33.632061 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1054/2095] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:39:33 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:39:34.984435 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c23bf4c-871e-43f0-8f7d-9f09afd0c56c None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:39:34.984910 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c23bf4c-871e-43f0-8f7d-9f09afd0c56c None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:39:34.985000 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c23bf4c-871e-43f0-8f7d-9f09afd0c56c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:39:35.014153 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-8c23bf4c-871e-43f0-8f7d-9f09afd0c56c None None] MFA Rules not processed for user `6f0537acb3d948dc8b756cf45c8347e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:39:35.015452 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-8c23bf4c-871e-43f0-8f7d-9f09afd0c56c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:39:35.090411 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1042/2096] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:39:34 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:39:35.103797 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc82244-ea86-4d69-a0a8-5e994a434e0d service cinder] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:39:35.105201 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-dcc82244-ea86-4d69-a0a8-5e994a434e0d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:39:35.167335 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc82244-ea86-4d69-a0a8-5e994a434e0d service cinder] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:39:35.170954 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db25bc52-408d-40ac-bd35-7c05ce58d028 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba461800d6845e6a767c83777ae5213', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:39:35.171610 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db25bc52-408d-40ac-bd35-7c05ce58d028 service glance] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:39:35.171901 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db25bc52-408d-40ac-bd35-7c05ce58d028 service glance] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:39:35.172183 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db25bc52-408d-40ac-bd35-7c05ce58d028 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:39:35.174008 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-db25bc52-408d-40ac-bd35-7c05ce58d028 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:39:35.196293 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:39:35.265138 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db25bc52-408d-40ac-bd35-7c05ce58d028 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:39:35.266646 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db25bc52-408d-40ac-bd35-7c05ce58d028 service glance] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:39:35.275777 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1055/2097] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:39:35 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:39:35.413470 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e50d8b-8c24-41e1-8235-50498cf10e1b None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:39:35.413735 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e50d8b-8c24-41e1-8235-50498cf10e1b None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:39:35.414063 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e50d8b-8c24-41e1-8235-50498cf10e1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:39:35.436622 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-f8e50d8b-8c24-41e1-8235-50498cf10e1b None None] MFA Rules not processed for user `6cf35868f9ff46e2835a6cc023641da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:39:35.437845 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-f8e50d8b-8c24-41e1-8235-50498cf10e1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:39:35.464028 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:39:35.497069 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1043/2098] 10.222.0.40 () {58 vars in 1009 bytes} [Thu Jul 14 09:39:35 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:39:35.542360 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db25bc52-408d-40ac-bd35-7c05ce58d028 service glance] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:39:35.543811 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-db25bc52-408d-40ac-bd35-7c05ce58d028 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:39:35.620379 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db25bc52-408d-40ac-bd35-7c05ce58d028 service glance] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:39:35.625406 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d3a3c8-6172-49f6-a876-0a2462d1bc58 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '302c0f7dd3bf4829aad0b29bd0c091a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:39:35.626052 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d3a3c8-6172-49f6-a876-0a2462d1bc58 service swift] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:39:35.626367 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d3a3c8-6172-49f6-a876-0a2462d1bc58 service swift] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:39:35.626647 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d3a3c8-6172-49f6-a876-0a2462d1bc58 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:39:35.634841 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d3a3c8-6172-49f6-a876-0a2462d1bc58 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:39:35.636411 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d3a3c8-6172-49f6-a876-0a2462d1bc58 service swift] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:39:35.644517 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1056/2099] 10.222.0.40 () {60 vars in 1384 bytes} [Thu Jul 14 09:39:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 09:39:37.472525 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2ba976-eeca-407d-ae33-77eb4a1ba600 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:39:37.473586 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2ba976-eeca-407d-ae33-77eb4a1ba600 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:39:37.473869 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2ba976-eeca-407d-ae33-77eb4a1ba600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:39:37.508612 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-da2ba976-eeca-407d-ae33-77eb4a1ba600 None None] MFA Rules not processed for user `0b818be48fe94da3b7b0c1585d1a376b`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:39:37.509907 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-da2ba976-eeca-407d-ae33-77eb4a1ba600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:39:37.549476 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1044/2100] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:39:37 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:39:43.031669 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b7f376-e87c-49b0-ae9c-aa34665a0011 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:39:43.031669 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b7f376-e87c-49b0-ae9c-aa34665a0011 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:39:43.032198 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b7f376-e87c-49b0-ae9c-aa34665a0011 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:39:43.033441 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1057/2101] 10.222.0.40 () {54 vars in 921 bytes} [Thu Jul 14 09:39:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:39:43.075911 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849ebc58-8cb5-4af6-910b-2bc76a547c00 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:39:43.076477 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849ebc58-8cb5-4af6-910b-2bc76a547c00 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:39:43.076477 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849ebc58-8cb5-4af6-910b-2bc76a547c00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:39:43.117849 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-849ebc58-8cb5-4af6-910b-2bc76a547c00 None None] MFA Rules not processed for user `6fc5a80144b84c609944a51a84fd5e6e`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:39:43.119990 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-849ebc58-8cb5-4af6-910b-2bc76a547c00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:39:43.135864 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b7f376-e87c-49b0-ae9c-aa34665a0011 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:39:43.138084 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-c7b7f376-e87c-49b0-ae9c-aa34665a0011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:39:43.184302 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b7f376-e87c-49b0-ae9c-aa34665a0011 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:39:43.193306 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda5bcef-23c5-4860-aef5-42f0e45b413c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:39:43.194440 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda5bcef-23c5-4860-aef5-42f0e45b413c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:39:43.195620 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda5bcef-23c5-4860-aef5-42f0e45b413c admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:39:43.196008 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda5bcef-23c5-4860-aef5-42f0e45b413c admin admin] PATH_INFO: `/v3/users/9b6ae4ed064a44c882b44b07d5595665` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:39:43.199105 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda5bcef-23c5-4860-aef5-42f0e45b413c admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b6ae4ed064a44c882b44b07d5595665)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:39:43.200607 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda5bcef-23c5-4860-aef5-42f0e45b413c admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:39:43.281968 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-bda5bcef-23c5-4860-aef5-42f0e45b413c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b6ae4ed064a44c882b44b07d5595665'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:39:43.288215 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1045/2102] 10.222.0.40 () {58 vars in 1018 bytes} [Thu Jul 14 09:39:43 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:39:43.310281 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849ebc58-8cb5-4af6-910b-2bc76a547c00 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:39:43.312290 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-849ebc58-8cb5-4af6-910b-2bc76a547c00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:39:43.338033 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-bda5bcef-23c5-4860-aef5-42f0e45b413c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b6ae4ed064a44c882b44b07d5595665'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:39:43.338782 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849ebc58-8cb5-4af6-910b-2bc76a547c00 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:39:43.339901 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-bda5bcef-23c5-4860-aef5-42f0e45b413c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b6ae4ed064a44c882b44b07d5595665'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:39:43.347637 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d194c209-a699-4521-9f85-28ccbb8f2dc7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc5a80144b84c609944a51a84fd5e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:39:43.348482 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d194c209-a699-4521-9f85-28ccbb8f2dc7 service placement] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:39:43.348620 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d194c209-a699-4521-9f85-28ccbb8f2dc7 service placement] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:39:43.348903 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d194c209-a699-4521-9f85-28ccbb8f2dc7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:39:43.350811 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-bda5bcef-23c5-4860-aef5-42f0e45b413c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b6ae4ed064a44c882b44b07d5595665'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:39:43.359686 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d194c209-a699-4521-9f85-28ccbb8f2dc7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:39:43.360589 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-bda5bcef-23c5-4860-aef5-42f0e45b413c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b6ae4ed064a44c882b44b07d5595665'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:39:43.361293 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d194c209-a699-4521-9f85-28ccbb8f2dc7 service placement] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:39:43.374827 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1058/2103] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 14 09:39:43 2022] DELETE /identity/v3/users/9b6ae4ed064a44c882b44b07d5595665 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 09:39:43.375048 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1046/2104] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:39:43 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:39:43.650974 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda5bcef-23c5-4860-aef5-42f0e45b413c admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:39:43.654313 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-bda5bcef-23c5-4860-aef5-42f0e45b413c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:39:43.694872 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:39:43.758164 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda5bcef-23c5-4860-aef5-42f0e45b413c admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:39:43.769216 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11d6fe0-4a69-4cc0-91ec-8fb81ae73d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:39:43.770964 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11d6fe0-4a69-4cc0-91ec-8fb81ae73d5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:39:43.770964 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11d6fe0-4a69-4cc0-91ec-8fb81ae73d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:39:43.770964 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11d6fe0-4a69-4cc0-91ec-8fb81ae73d5c admin admin] PATH_INFO: `/v3/projects/84ed99374b3b42b3b4cc3d68b2a67ed5` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:39:43.772270 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11d6fe0-4a69-4cc0-91ec-8fb81ae73d5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=84ed99374b3b42b3b4cc3d68b2a67ed5)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:39:43.779319 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11d6fe0-4a69-4cc0-91ec-8fb81ae73d5c admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:39:43.891384 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-b11d6fe0-4a69-4cc0-91ec-8fb81ae73d5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84ed99374b3b42b3b4cc3d68b2a67ed5', 'request_id': 'req-b11d6fe0-4a69-4cc0-91ec-8fb81ae73d5c'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:39:43.905354 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-b11d6fe0-4a69-4cc0-91ec-8fb81ae73d5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84ed99374b3b42b3b4cc3d68b2a67ed5', 'request_id': 'req-b11d6fe0-4a69-4cc0-91ec-8fb81ae73d5c'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:39:43.913128 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-b11d6fe0-4a69-4cc0-91ec-8fb81ae73d5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84ed99374b3b42b3b4cc3d68b2a67ed5', 'request_id': 'req-b11d6fe0-4a69-4cc0-91ec-8fb81ae73d5c'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:39:43.936328 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-b11d6fe0-4a69-4cc0-91ec-8fb81ae73d5c admin admin] The token cache is being invalidate because project 84ed99374b3b42b3b4cc3d68b2a67ed5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 09:39:43.936636 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-b11d6fe0-4a69-4cc0-91ec-8fb81ae73d5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:39:43.937290 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-b11d6fe0-4a69-4cc0-91ec-8fb81ae73d5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:39:43.942267 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1059/2105] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 14 09:39:43 2022] DELETE /identity/v3/projects/84ed99374b3b42b3b4cc3d68b2a67ed5 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:39:43.944162 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cb8446-e5d1-4243-b067-c8cd4b3a94cb None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:39:43.944451 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cb8446-e5d1-4243-b067-c8cd4b3a94cb None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:39:43.944733 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cb8446-e5d1-4243-b067-c8cd4b3a94cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:39:43.979239 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-68cb8446-e5d1-4243-b067-c8cd4b3a94cb None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:39:43.980753 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-68cb8446-e5d1-4243-b067-c8cd4b3a94cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:39:44.079938 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1047/2106] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:39:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:39:44.089173 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f630a1a2-0712-4dfe-acde-12eeedffb023 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:39:44.091110 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f630a1a2-0712-4dfe-acde-12eeedffb023 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:39:44.091582 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f630a1a2-0712-4dfe-acde-12eeedffb023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:39:44.111010 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-f630a1a2-0712-4dfe-acde-12eeedffb023 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:39:44.112259 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-f630a1a2-0712-4dfe-acde-12eeedffb023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:39:44.147813 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1060/2107] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:39:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:39:44.148955 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cb8446-e5d1-4243-b067-c8cd4b3a94cb None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:39:44.159271 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cb8446-e5d1-4243-b067-c8cd4b3a94cb None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:39:44.165755 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135fcae3-13ce-4e25-ab11-4923383178fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:39:44.166496 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135fcae3-13ce-4e25-ab11-4923383178fe admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:39:44.166785 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135fcae3-13ce-4e25-ab11-4923383178fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:39:44.167067 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135fcae3-13ce-4e25-ab11-4923383178fe admin admin] PATH_INFO: `/v3/domains` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:39:44.167830 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135fcae3-13ce-4e25-ab11-4923383178fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:39:44.168143 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135fcae3-13ce-4e25-ab11-4923383178fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:39:44.169808 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135fcae3-13ce-4e25-ab11-4923383178fe admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:39:44.191233 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1048/2108] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jul 14 09:39:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:39:44.199439 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f630a1a2-0712-4dfe-acde-12eeedffb023 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:39:44.209589 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f630a1a2-0712-4dfe-acde-12eeedffb023 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:39:44.215689 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659a2998-a13d-4f05-92ff-22393895c29d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:39:44.216383 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659a2998-a13d-4f05-92ff-22393895c29d admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:39:44.216673 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659a2998-a13d-4f05-92ff-22393895c29d admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:39:44.216953 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659a2998-a13d-4f05-92ff-22393895c29d admin admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:39:44.217663 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659a2998-a13d-4f05-92ff-22393895c29d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:39:44.219654 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659a2998-a13d-4f05-92ff-22393895c29d admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:39:44.267694 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1061/2109] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 14 09:39:44 2022] POST /identity/v3/projects => generated 383 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:39:44.271993 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135fcae3-13ce-4e25-ab11-4923383178fe admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:39:44.282698 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135fcae3-13ce-4e25-ab11-4923383178fe admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:39:44.348972 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:39:44.377853 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0d0bb7-e994-43db-93e0-02c24af03d2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:39:44.378585 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0d0bb7-e994-43db-93e0-02c24af03d2d admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:39:44.378874 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0d0bb7-e994-43db-93e0-02c24af03d2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:39:44.379321 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0d0bb7-e994-43db-93e0-02c24af03d2d admin admin] PATH_INFO: `/v3/users` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:39:44.380034 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0d0bb7-e994-43db-93e0-02c24af03d2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:39:44.382019 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0d0bb7-e994-43db-93e0-02c24af03d2d admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:39:44.406566 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1049/2110] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 14 09:39:44 2022] POST /identity/v3/users => generated 292 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:39:44.407616 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659a2998-a13d-4f05-92ff-22393895c29d admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:39:44.421025 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659a2998-a13d-4f05-92ff-22393895c29d admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:39:44.426178 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308c4bd8-bc88-4606-8bc3-522bd57ebf8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:39:44.426899 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308c4bd8-bc88-4606-8bc3-522bd57ebf8e admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:39:44.427185 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308c4bd8-bc88-4606-8bc3-522bd57ebf8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:39:44.427517 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308c4bd8-bc88-4606-8bc3-522bd57ebf8e admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:39:44.428268 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308c4bd8-bc88-4606-8bc3-522bd57ebf8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:39:44.429884 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308c4bd8-bc88-4606-8bc3-522bd57ebf8e admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:39:44.444519 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1062/2111] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 09:39:44 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:39:44.446348 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0d0bb7-e994-43db-93e0-02c24af03d2d admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:39:44.457000 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0d0bb7-e994-43db-93e0-02c24af03d2d admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:39:44.462291 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ef4cc3-806f-4015-8820-4cab7bcd485e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:39:44.463001 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ef4cc3-806f-4015-8820-4cab7bcd485e admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:39:44.463289 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ef4cc3-806f-4015-8820-4cab7bcd485e admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:39:44.463567 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ef4cc3-806f-4015-8820-4cab7bcd485e admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:39:44.464320 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ef4cc3-806f-4015-8820-4cab7bcd485e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:39:44.466747 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ef4cc3-806f-4015-8820-4cab7bcd485e admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:39:44.478224 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1050/2112] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 09:39:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:39:44.482228 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308c4bd8-bc88-4606-8bc3-522bd57ebf8e admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:39:44.495405 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308c4bd8-bc88-4606-8bc3-522bd57ebf8e admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:39:44.502122 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a6e2d4-cfe6-41f9-8164-7f4feeabf448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:39:44.502122 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a6e2d4-cfe6-41f9-8164-7f4feeabf448 admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:39:44.502122 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a6e2d4-cfe6-41f9-8164-7f4feeabf448 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:39:44.502122 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a6e2d4-cfe6-41f9-8164-7f4feeabf448 admin admin] PATH_INFO: `/v3/projects/52acfca03c3e45cfb2e8d3d4f391b281/users/1d7ae3d2f56a491baf26a83a34d86ccf/roles/17dfac38a2e540fea229af7de99911bb` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:39:44.519534 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a6e2d4-cfe6-41f9-8164-7f4feeabf448 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52acfca03c3e45cfb2e8d3d4f391b281, user_id=1d7ae3d2f56a491baf26a83a34d86ccf, role_id=17dfac38a2e540fea229af7de99911bb)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:39:44.522594 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a6e2d4-cfe6-41f9-8164-7f4feeabf448 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:39:44.545384 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1063/2113] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 14 09:39:44 2022] PUT /identity/v3/projects/52acfca03c3e45cfb2e8d3d4f391b281/users/1d7ae3d2f56a491baf26a83a34d86ccf/roles/17dfac38a2e540fea229af7de99911bb => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 09:39:44.550399 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178d14cf-96bb-4565-8404-3249f2d04faf None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:39:44.550763 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178d14cf-96bb-4565-8404-3249f2d04faf None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:39:44.551115 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178d14cf-96bb-4565-8404-3249f2d04faf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:39:44.576453 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-178d14cf-96bb-4565-8404-3249f2d04faf None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:39:44.577751 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-178d14cf-96bb-4565-8404-3249f2d04faf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:39:44.651471 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1051/2114] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:39:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:39:44.663313 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a6e2d4-cfe6-41f9-8164-7f4feeabf448 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:39:44.665603 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-68a6e2d4-cfe6-41f9-8164-7f4feeabf448 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:39:44.732103 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:39:44.738481 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a6e2d4-cfe6-41f9-8164-7f4feeabf448 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:39:44.745445 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b507047a-6ab4-45c5-9a8d-69a1d099b873 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e4a5a8965e4802a9055d332179b7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:39:44.746150 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b507047a-6ab4-45c5-9a8d-69a1d099b873 service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:39:44.746612 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b507047a-6ab4-45c5-9a8d-69a1d099b873 service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:39:44.747029 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b507047a-6ab4-45c5-9a8d-69a1d099b873 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:39:44.763095 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b507047a-6ab4-45c5-9a8d-69a1d099b873 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:39:44.764648 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b507047a-6ab4-45c5-9a8d-69a1d099b873 service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:39:44.778819 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1064/2115] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:39:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:39:48.526903 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e887b6-96b1-49c1-af02-249e0c6b28cb None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:39:48.527462 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e887b6-96b1-49c1-af02-249e0c6b28cb None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:39:48.527757 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e887b6-96b1-49c1-af02-249e0c6b28cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:39:48.556072 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-a2e887b6-96b1-49c1-af02-249e0c6b28cb None None] MFA Rules not processed for user `93132e89a8ed42e58754ff9009d95a2b`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:39:48.557344 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-a2e887b6-96b1-49c1-af02-249e0c6b28cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:39:48.647856 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1052/2116] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:39:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:39:52.272178 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993be228-8512-4df2-ab3b-c220b5b10eb9 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:39:52.272659 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993be228-8512-4df2-ab3b-c220b5b10eb9 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:39:52.272807 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993be228-8512-4df2-ab3b-c220b5b10eb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:39:52.307786 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-993be228-8512-4df2-ab3b-c220b5b10eb9 None None] MFA Rules not processed for user `1d7ae3d2f56a491baf26a83a34d86ccf`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:39:52.308988 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-993be228-8512-4df2-ab3b-c220b5b10eb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:39:52.388781 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1065/2117] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:39:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:39:52.407091 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e887b6-96b1-49c1-af02-249e0c6b28cb None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:39:52.409060 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-a2e887b6-96b1-49c1-af02-249e0c6b28cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:39:52.515780 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:39:52.538956 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e887b6-96b1-49c1-af02-249e0c6b28cb None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:39:52.548367 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe14c17-d53b-47e7-b0fc-18038b49d71a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f6962106dfa4c4c9af551053f8095e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:39:52.549349 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe14c17-d53b-47e7-b0fc-18038b49d71a service nova] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:39:52.549807 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe14c17-d53b-47e7-b0fc-18038b49d71a service nova] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:39:52.550286 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe14c17-d53b-47e7-b0fc-18038b49d71a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:39:52.563811 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe14c17-d53b-47e7-b0fc-18038b49d71a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:39:52.565922 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe14c17-d53b-47e7-b0fc-18038b49d71a service nova] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:39:52.578639 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1053/2118] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:39:52 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:39:53.522986 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993be228-8512-4df2-ab3b-c220b5b10eb9 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:39:53.524569 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-993be228-8512-4df2-ab3b-c220b5b10eb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:39:53.554840 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993be228-8512-4df2-ab3b-c220b5b10eb9 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:39:53.564976 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf0d0fb-3ea2-4a6b-a84f-6ff2bfe2ffcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:39:53.566272 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf0d0fb-3ea2-4a6b-a84f-6ff2bfe2ffcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:39:53.566643 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf0d0fb-3ea2-4a6b-a84f-6ff2bfe2ffcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:39:53.567072 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf0d0fb-3ea2-4a6b-a84f-6ff2bfe2ffcf admin admin] PATH_INFO: `/v3/users/87ec9d3d45574e1d88f62d9d90191bc1` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:39:53.568506 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf0d0fb-3ea2-4a6b-a84f-6ff2bfe2ffcf admin admin] RBAC: Authorizing `identity:delete_user(user_id=87ec9d3d45574e1d88f62d9d90191bc1)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:39:53.571522 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf0d0fb-3ea2-4a6b-a84f-6ff2bfe2ffcf admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:39:53.656918 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-9cf0d0fb-3ea2-4a6b-a84f-6ff2bfe2ffcf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87ec9d3d45574e1d88f62d9d90191bc1'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:39:53.683928 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-9cf0d0fb-3ea2-4a6b-a84f-6ff2bfe2ffcf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87ec9d3d45574e1d88f62d9d90191bc1'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:39:53.686588 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-9cf0d0fb-3ea2-4a6b-a84f-6ff2bfe2ffcf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87ec9d3d45574e1d88f62d9d90191bc1'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:39:53.706087 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-9cf0d0fb-3ea2-4a6b-a84f-6ff2bfe2ffcf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87ec9d3d45574e1d88f62d9d90191bc1'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:39:53.724447 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-9cf0d0fb-3ea2-4a6b-a84f-6ff2bfe2ffcf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87ec9d3d45574e1d88f62d9d90191bc1'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:39:53.732630 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1066/2119] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 14 09:39:53 2022] DELETE /identity/v3/users/87ec9d3d45574e1d88f62d9d90191bc1 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:39:53.737169 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd2ed45-6de4-481b-abf2-849a8b08393e None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:39:53.737706 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd2ed45-6de4-481b-abf2-849a8b08393e None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:39:53.738851 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd2ed45-6de4-481b-abf2-849a8b08393e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:39:53.766763 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-0fd2ed45-6de4-481b-abf2-849a8b08393e None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:39:53.768914 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-0fd2ed45-6de4-481b-abf2-849a8b08393e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:39:53.875832 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1054/2120] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:39:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 09:39:53.884227 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf0d0fb-3ea2-4a6b-a84f-6ff2bfe2ffcf admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:39:53.885871 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-9cf0d0fb-3ea2-4a6b-a84f-6ff2bfe2ffcf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:39:54.025112 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf0d0fb-3ea2-4a6b-a84f-6ff2bfe2ffcf admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:39:54.040839 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b276d3d-c808-40c3-ab53-b957ed25a793 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e4a5a8965e4802a9055d332179b7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:39:54.041719 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b276d3d-c808-40c3-ab53-b957ed25a793 service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:39:54.042156 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b276d3d-c808-40c3-ab53-b957ed25a793 service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:39:54.042790 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b276d3d-c808-40c3-ab53-b957ed25a793 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:39:54.049787 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:39:54.054454 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b276d3d-c808-40c3-ab53-b957ed25a793 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:39:54.056797 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b276d3d-c808-40c3-ab53-b957ed25a793 service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:39:54.087288 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1067/2121] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:39:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:39:54.410995 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd2ed45-6de4-481b-abf2-849a8b08393e None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:39:54.412475 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-0fd2ed45-6de4-481b-abf2-849a8b08393e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:39:54.430124 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd2ed45-6de4-481b-abf2-849a8b08393e None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:39:54.435460 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9192ef8f-1b96-4ebf-a25e-35ab9f6ab8fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:39:54.437490 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9192ef8f-1b96-4ebf-a25e-35ab9f6ab8fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:39:54.437874 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9192ef8f-1b96-4ebf-a25e-35ab9f6ab8fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:39:54.438399 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9192ef8f-1b96-4ebf-a25e-35ab9f6ab8fc admin admin] PATH_INFO: `/v3/projects/d93cfa479b474c508c67869a48db9a1d` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:39:54.440396 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9192ef8f-1b96-4ebf-a25e-35ab9f6ab8fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=d93cfa479b474c508c67869a48db9a1d)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:39:54.442732 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9192ef8f-1b96-4ebf-a25e-35ab9f6ab8fc admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:39:54.499676 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-9192ef8f-1b96-4ebf-a25e-35ab9f6ab8fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd93cfa479b474c508c67869a48db9a1d', 'request_id': 'req-9192ef8f-1b96-4ebf-a25e-35ab9f6ab8fc'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:39:54.512515 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-9192ef8f-1b96-4ebf-a25e-35ab9f6ab8fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd93cfa479b474c508c67869a48db9a1d', 'request_id': 'req-9192ef8f-1b96-4ebf-a25e-35ab9f6ab8fc'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:39:54.520233 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-9192ef8f-1b96-4ebf-a25e-35ab9f6ab8fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd93cfa479b474c508c67869a48db9a1d', 'request_id': 'req-9192ef8f-1b96-4ebf-a25e-35ab9f6ab8fc'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:39:54.537317 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-9192ef8f-1b96-4ebf-a25e-35ab9f6ab8fc admin admin] The token cache is being invalidate because project d93cfa479b474c508c67869a48db9a1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 09:39:54.537705 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-9192ef8f-1b96-4ebf-a25e-35ab9f6ab8fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:39:54.538514 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-9192ef8f-1b96-4ebf-a25e-35ab9f6ab8fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:39:54.540551 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1055/2122] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 14 09:39:54 2022] DELETE /identity/v3/projects/d93cfa479b474c508c67869a48db9a1d => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:39:54.545262 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b77f9f-cf57-43eb-a815-a288f393b87a None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:39:54.545758 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b77f9f-cf57-43eb-a815-a288f393b87a None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:39:54.545837 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b77f9f-cf57-43eb-a815-a288f393b87a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:39:54.567781 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-45b77f9f-cf57-43eb-a815-a288f393b87a None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:39:54.569229 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-45b77f9f-cf57-43eb-a815-a288f393b87a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:39:54.657088 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1068/2123] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:39:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:39:54.665499 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1052ab6f-93c7-41aa-9f73-0775578b1207 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:39:54.665898 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1052ab6f-93c7-41aa-9f73-0775578b1207 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:39:54.666298 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1052ab6f-93c7-41aa-9f73-0775578b1207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:39:54.687062 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-1052ab6f-93c7-41aa-9f73-0775578b1207 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:39:54.688433 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-1052ab6f-93c7-41aa-9f73-0775578b1207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:39:54.700211 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1056/2124] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:39:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 09:39:54.701552 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b77f9f-cf57-43eb-a815-a288f393b87a None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:39:54.713445 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b77f9f-cf57-43eb-a815-a288f393b87a None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:39:54.718338 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1425aa48-f46b-4154-9a80-3caf5fb8a7ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:39:54.719085 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1425aa48-f46b-4154-9a80-3caf5fb8a7ef admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:39:54.719449 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1425aa48-f46b-4154-9a80-3caf5fb8a7ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:39:54.719952 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1425aa48-f46b-4154-9a80-3caf5fb8a7ef admin admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:39:54.720781 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1425aa48-f46b-4154-9a80-3caf5fb8a7ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:39:54.721173 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1425aa48-f46b-4154-9a80-3caf5fb8a7ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:39:54.723015 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1425aa48-f46b-4154-9a80-3caf5fb8a7ef admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:39:54.737656 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1069/2125] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jul 14 09:39:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:39:54.742077 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1052ab6f-93c7-41aa-9f73-0775578b1207 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:39:54.753517 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1052ab6f-93c7-41aa-9f73-0775578b1207 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:39:54.759585 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73687c3c-7298-41d0-899e-444ec5feb5ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:39:54.760264 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73687c3c-7298-41d0-899e-444ec5feb5ff admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:39:54.760597 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73687c3c-7298-41d0-899e-444ec5feb5ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:39:54.760880 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73687c3c-7298-41d0-899e-444ec5feb5ff admin admin] PATH_INFO: `/v3/projects` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:39:54.761598 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73687c3c-7298-41d0-899e-444ec5feb5ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:39:54.763783 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73687c3c-7298-41d0-899e-444ec5feb5ff admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:39:54.796545 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1057/2126] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 14 09:39:54 2022] POST /identity/v3/projects => generated 383 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 09:39:54.801015 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1425aa48-f46b-4154-9a80-3caf5fb8a7ef admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:39:54.812557 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1425aa48-f46b-4154-9a80-3caf5fb8a7ef admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:39:54.905933 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fde4ba-478c-467c-951c-d4fc13f4f89f None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:39:54.906590 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fde4ba-478c-467c-951c-d4fc13f4f89f None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:39:54.906968 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fde4ba-478c-467c-951c-d4fc13f4f89f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:39:54.956493 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4212caa-a707-4dec-86f5-aa848d5f594a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:39:54.957232 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4212caa-a707-4dec-86f5-aa848d5f594a admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:39:54.957527 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4212caa-a707-4dec-86f5-aa848d5f594a admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:39:54.957813 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4212caa-a707-4dec-86f5-aa848d5f594a admin admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:39:54.958576 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4212caa-a707-4dec-86f5-aa848d5f594a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:39:54.959112 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-a8fde4ba-478c-467c-951c-d4fc13f4f89f None None] MFA Rules not processed for user `6cf35868f9ff46e2835a6cc023641da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:39:54.961035 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4212caa-a707-4dec-86f5-aa848d5f594a admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:39:54.962528 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-a8fde4ba-478c-467c-951c-d4fc13f4f89f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:39:54.988020 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1070/2127] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 14 09:39:54 2022] POST /identity/v3/users => generated 292 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 09:39:54.991784 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4212caa-a707-4dec-86f5-aa848d5f594a admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:39:55.014454 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4212caa-a707-4dec-86f5-aa848d5f594a admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:39:55.033571 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eaec9e-f45b-40d8-bf12-23cd43fc9f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:39:55.034365 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eaec9e-f45b-40d8-bf12-23cd43fc9f9a admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:39:55.034564 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eaec9e-f45b-40d8-bf12-23cd43fc9f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:39:55.034844 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eaec9e-f45b-40d8-bf12-23cd43fc9f9a admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:39:55.039759 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5eaec9e-f45b-40d8-bf12-23cd43fc9f9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:39:55.043960 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5eaec9e-f45b-40d8-bf12-23cd43fc9f9a admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:39:55.059128 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:39:55.071366 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1071/2128] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 09:39:54 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:39:55.073012 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eaec9e-f45b-40d8-bf12-23cd43fc9f9a admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:39:55.087396 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eaec9e-f45b-40d8-bf12-23cd43fc9f9a admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:39:55.097891 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf6dfac-2dbf-437d-a002-54cc93577ca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:39:55.098643 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf6dfac-2dbf-437d-a002-54cc93577ca2 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:39:55.098895 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf6dfac-2dbf-437d-a002-54cc93577ca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:39:55.099172 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf6dfac-2dbf-437d-a002-54cc93577ca2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:39:55.099911 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf6dfac-2dbf-437d-a002-54cc93577ca2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:39:55.101525 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf6dfac-2dbf-437d-a002-54cc93577ca2 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:39:55.102431 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1058/2129] 10.222.0.40 () {58 vars in 1009 bytes} [Thu Jul 14 09:39:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 09:39:55.104166 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112ce223-7252-442b-98ab-46c17707234c None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:39:55.105048 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112ce223-7252-442b-98ab-46c17707234c None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:39:55.105602 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112ce223-7252-442b-98ab-46c17707234c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:39:55.123916 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1072/2130] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 09:39:55 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:39:55.127952 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf6dfac-2dbf-437d-a002-54cc93577ca2 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:39:55.129640 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-6bf6dfac-2dbf-437d-a002-54cc93577ca2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:39:55.132142 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-112ce223-7252-442b-98ab-46c17707234c None None] MFA Rules not processed for user `1d7ae3d2f56a491baf26a83a34d86ccf`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:39:55.134677 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-112ce223-7252-442b-98ab-46c17707234c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:39:55.199433 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:39:55.234404 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1059/2131] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:39:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:39:55.234404 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112ce223-7252-442b-98ab-46c17707234c None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:39:55.251308 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112ce223-7252-442b-98ab-46c17707234c None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:39:55.255606 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf6dfac-2dbf-437d-a002-54cc93577ca2 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:39:55.256965 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e692c0-b3c0-4f0b-9811-a54e6e560cb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:39:55.257885 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e692c0-b3c0-4f0b-9811-a54e6e560cb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:39:55.259657 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e692c0-b3c0-4f0b-9811-a54e6e560cb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:39:55.259657 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e692c0-b3c0-4f0b-9811-a54e6e560cb3 admin admin] PATH_INFO: `/v3/projects/2e18e0502552493e944f4c39b198de47/users/a837eae4d5c94f86a7adfbe848ed18be/roles/17dfac38a2e540fea229af7de99911bb` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:39:55.278471 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02c7d7c-6dce-4aca-b4c0-9976720178af service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '302c0f7dd3bf4829aad0b29bd0c091a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:39:55.284576 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e692c0-b3c0-4f0b-9811-a54e6e560cb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e18e0502552493e944f4c39b198de47, user_id=a837eae4d5c94f86a7adfbe848ed18be, role_id=17dfac38a2e540fea229af7de99911bb)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:39:55.287310 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e692c0-b3c0-4f0b-9811-a54e6e560cb3 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:39:55.294077 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02c7d7c-6dce-4aca-b4c0-9976720178af service swift] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:39:55.294396 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02c7d7c-6dce-4aca-b4c0-9976720178af service swift] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:39:55.297673 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02c7d7c-6dce-4aca-b4c0-9976720178af service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:39:55.304677 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1060/2132] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 14 09:39:55 2022] PUT /identity/v3/projects/2e18e0502552493e944f4c39b198de47/users/a837eae4d5c94f86a7adfbe848ed18be/roles/17dfac38a2e540fea229af7de99911bb => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:39:55.317441 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a0f933-6d10-4595-abe2-629804f79cb4 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:39:55.317896 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a0f933-6d10-4595-abe2-629804f79cb4 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:39:55.318356 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a0f933-6d10-4595-abe2-629804f79cb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:39:55.339645 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02c7d7c-6dce-4aca-b4c0-9976720178af service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:39:55.347127 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02c7d7c-6dce-4aca-b4c0-9976720178af service swift] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:39:55.351610 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-54a0f933-6d10-4595-abe2-629804f79cb4 None None] MFA Rules not processed for user `a837eae4d5c94f86a7adfbe848ed18be`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:39:55.354645 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-54a0f933-6d10-4595-abe2-629804f79cb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:39:55.370876 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1073/2133] 10.222.0.40 () {60 vars in 1384 bytes} [Thu Jul 14 09:39:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 09:39:55.442241 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1061/2134] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:39:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:39:55.451741 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02c7d7c-6dce-4aca-b4c0-9976720178af service swift] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:39:55.453160 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-c02c7d7c-6dce-4aca-b4c0-9976720178af service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:39:55.534977 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02c7d7c-6dce-4aca-b4c0-9976720178af service swift] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:39:55.611599 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7c8bcc-37cd-4348-adc0-5790b8d83c29 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25048b29787d482783ebc944f1a7df65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:39:55.613042 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7c8bcc-37cd-4348-adc0-5790b8d83c29 service cinder] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:39:55.613517 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7c8bcc-37cd-4348-adc0-5790b8d83c29 service cinder] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:39:55.613951 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7c8bcc-37cd-4348-adc0-5790b8d83c29 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:39:55.627798 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7c8bcc-37cd-4348-adc0-5790b8d83c29 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:39:55.630070 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7c8bcc-37cd-4348-adc0-5790b8d83c29 service cinder] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:39:55.650652 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1074/2135] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:39:55 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:39:59.628589 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a0f933-6d10-4595-abe2-629804f79cb4 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:39:59.705318 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:39:59.710116 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a0f933-6d10-4595-abe2-629804f79cb4 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:39:59.716504 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c802a40-3e67-44a6-a2a2-5bab78b8882e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:39:59.717527 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c802a40-3e67-44a6-a2a2-5bab78b8882e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:39:59.718024 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c802a40-3e67-44a6-a2a2-5bab78b8882e admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:39:59.718432 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c802a40-3e67-44a6-a2a2-5bab78b8882e admin admin] PATH_INFO: `/v3/users/a837eae4d5c94f86a7adfbe848ed18be` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:39:59.720155 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c802a40-3e67-44a6-a2a2-5bab78b8882e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a837eae4d5c94f86a7adfbe848ed18be)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:39:59.722438 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c802a40-3e67-44a6-a2a2-5bab78b8882e admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:39:59.785957 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-9c802a40-3e67-44a6-a2a2-5bab78b8882e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a837eae4d5c94f86a7adfbe848ed18be'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:39:59.793679 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-9c802a40-3e67-44a6-a2a2-5bab78b8882e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a837eae4d5c94f86a7adfbe848ed18be'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:39:59.794445 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-9c802a40-3e67-44a6-a2a2-5bab78b8882e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a837eae4d5c94f86a7adfbe848ed18be'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:39:59.803561 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-9c802a40-3e67-44a6-a2a2-5bab78b8882e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a837eae4d5c94f86a7adfbe848ed18be'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:39:59.804319 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-9c802a40-3e67-44a6-a2a2-5bab78b8882e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a837eae4d5c94f86a7adfbe848ed18be'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:39:59.824508 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1062/2136] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 14 09:39:59 2022] DELETE /identity/v3/users/a837eae4d5c94f86a7adfbe848ed18be => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:39:59.829266 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430165b8-5037-437e-a6e2-2de4216a8373 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:39:59.829869 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430165b8-5037-437e-a6e2-2de4216a8373 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:39:59.829869 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430165b8-5037-437e-a6e2-2de4216a8373 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:39:59.849229 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-430165b8-5037-437e-a6e2-2de4216a8373 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:39:59.850610 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-430165b8-5037-437e-a6e2-2de4216a8373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:39:59.918242 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1075/2137] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:39:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:39:59.929139 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c802a40-3e67-44a6-a2a2-5bab78b8882e admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:39:59.930792 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-9c802a40-3e67-44a6-a2a2-5bab78b8882e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:39:59.990832 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c802a40-3e67-44a6-a2a2-5bab78b8882e admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:39:59.994921 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00648d98-c399-4c85-b2d3-c4a370148f93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e4a5a8965e4802a9055d332179b7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:39:59.995787 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00648d98-c399-4c85-b2d3-c4a370148f93 service neutron] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:39:59.996123 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00648d98-c399-4c85-b2d3-c4a370148f93 service neutron] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:39:59.996474 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00648d98-c399-4c85-b2d3-c4a370148f93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:40:00.014983 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00648d98-c399-4c85-b2d3-c4a370148f93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:40:00.016422 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00648d98-c399-4c85-b2d3-c4a370148f93 service neutron] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:40:00.027664 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1063/2138] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:39:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:40:00.391116 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430165b8-5037-437e-a6e2-2de4216a8373 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:40:00.393040 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-430165b8-5037-437e-a6e2-2de4216a8373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:40:00.412484 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430165b8-5037-437e-a6e2-2de4216a8373 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:40:00.431799 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a640325-973f-4bea-a012-989c244eaea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:40:00.432798 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a640325-973f-4bea-a012-989c244eaea6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:40:00.433162 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a640325-973f-4bea-a012-989c244eaea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:40:00.433521 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a640325-973f-4bea-a012-989c244eaea6 admin admin] PATH_INFO: `/v3/projects/2e18e0502552493e944f4c39b198de47` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:40:00.434967 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a640325-973f-4bea-a012-989c244eaea6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e18e0502552493e944f4c39b198de47)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:40:00.437127 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a640325-973f-4bea-a012-989c244eaea6 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:40:00.489564 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:40:00.509651 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-8a640325-973f-4bea-a012-989c244eaea6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e18e0502552493e944f4c39b198de47', 'request_id': 'req-8a640325-973f-4bea-a012-989c244eaea6'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:40:00.516832 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-8a640325-973f-4bea-a012-989c244eaea6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e18e0502552493e944f4c39b198de47', 'request_id': 'req-8a640325-973f-4bea-a012-989c244eaea6'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:40:00.523046 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-8a640325-973f-4bea-a012-989c244eaea6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e18e0502552493e944f4c39b198de47', 'request_id': 'req-8a640325-973f-4bea-a012-989c244eaea6'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:40:00.539748 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-8a640325-973f-4bea-a012-989c244eaea6 admin admin] The token cache is being invalidate because project 2e18e0502552493e944f4c39b198de47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 09:40:00.540043 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-8a640325-973f-4bea-a012-989c244eaea6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:40:00.540732 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-8a640325-973f-4bea-a012-989c244eaea6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:40:00.545706 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1076/2139] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 14 09:40:00 2022] DELETE /identity/v3/projects/2e18e0502552493e944f4c39b198de47 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:40:00.547585 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa81750-da15-4ab3-9875-d6b439e80495 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:40:00.547895 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa81750-da15-4ab3-9875-d6b439e80495 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:40:00.548176 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa81750-da15-4ab3-9875-d6b439e80495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:40:00.571748 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-3aa81750-da15-4ab3-9875-d6b439e80495 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:40:00.573336 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-3aa81750-da15-4ab3-9875-d6b439e80495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:40:00.666431 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1064/2140] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:40:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:40:00.674852 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a036a57-d8a5-4f95-9fa2-f7ce1c5fed59 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:40:00.675325 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a036a57-d8a5-4f95-9fa2-f7ce1c5fed59 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:40:00.675804 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a036a57-d8a5-4f95-9fa2-f7ce1c5fed59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:40:00.702969 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-5a036a57-d8a5-4f95-9fa2-f7ce1c5fed59 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:40:00.704356 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-5a036a57-d8a5-4f95-9fa2-f7ce1c5fed59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:40:00.715938 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1077/2141] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:40:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:40:00.718856 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa81750-da15-4ab3-9875-d6b439e80495 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:40:00.733881 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa81750-da15-4ab3-9875-d6b439e80495 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:40:00.743442 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932cd20f-5469-4f17-a7bf-836bccbfbb6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:40:00.744052 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932cd20f-5469-4f17-a7bf-836bccbfbb6e admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:40:00.744339 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932cd20f-5469-4f17-a7bf-836bccbfbb6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:40:00.744618 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932cd20f-5469-4f17-a7bf-836bccbfbb6e admin admin] PATH_INFO: `/v3/domains` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:40:00.745368 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932cd20f-5469-4f17-a7bf-836bccbfbb6e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:40:00.745671 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932cd20f-5469-4f17-a7bf-836bccbfbb6e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:40:00.747320 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932cd20f-5469-4f17-a7bf-836bccbfbb6e admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:40:00.766803 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1065/2142] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jul 14 09:40:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:40:00.767902 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a036a57-d8a5-4f95-9fa2-f7ce1c5fed59 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:40:00.777371 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a036a57-d8a5-4f95-9fa2-f7ce1c5fed59 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:40:00.782388 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6548b958-18c3-42f9-ada9-749797490310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:40:00.783083 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6548b958-18c3-42f9-ada9-749797490310 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:40:00.783403 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6548b958-18c3-42f9-ada9-749797490310 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:40:00.783685 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6548b958-18c3-42f9-ada9-749797490310 admin admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:40:00.784544 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6548b958-18c3-42f9-ada9-749797490310 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:40:00.788444 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6548b958-18c3-42f9-ada9-749797490310 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:40:00.818231 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1078/2143] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 14 09:40:00 2022] POST /identity/v3/projects => generated 375 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:40:00.822328 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932cd20f-5469-4f17-a7bf-836bccbfbb6e admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:40:00.832609 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932cd20f-5469-4f17-a7bf-836bccbfbb6e admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:40:00.836565 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:40:00.894248 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4662ae86-18c6-415b-9f55-7b6420e9f69b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:40:00.895230 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4662ae86-18c6-415b-9f55-7b6420e9f69b admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:40:00.895516 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4662ae86-18c6-415b-9f55-7b6420e9f69b admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:40:00.895800 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4662ae86-18c6-415b-9f55-7b6420e9f69b admin admin] PATH_INFO: `/v3/users` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:40:00.896507 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4662ae86-18c6-415b-9f55-7b6420e9f69b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:40:00.898499 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4662ae86-18c6-415b-9f55-7b6420e9f69b admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:40:00.921687 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1066/2144] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 14 09:40:00 2022] POST /identity/v3/users => generated 288 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:40:00.925451 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6548b958-18c3-42f9-ada9-749797490310 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:40:00.936835 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6548b958-18c3-42f9-ada9-749797490310 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:40:00.942027 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbec3670-1d43-4872-859e-73264ee20490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:40:00.942900 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbec3670-1d43-4872-859e-73264ee20490 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:40:00.943282 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbec3670-1d43-4872-859e-73264ee20490 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:40:00.943566 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbec3670-1d43-4872-859e-73264ee20490 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:40:00.944527 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbec3670-1d43-4872-859e-73264ee20490 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:40:00.946377 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbec3670-1d43-4872-859e-73264ee20490 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:40:00.962077 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1079/2145] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 09:40:00 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:40:00.963400 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4662ae86-18c6-415b-9f55-7b6420e9f69b admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:40:00.974035 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4662ae86-18c6-415b-9f55-7b6420e9f69b admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:40:00.979445 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b54ad2-e9e7-4c28-8d2f-7103a9bddddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:40:00.980214 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b54ad2-e9e7-4c28-8d2f-7103a9bddddc admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:40:00.980579 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b54ad2-e9e7-4c28-8d2f-7103a9bddddc admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:40:00.980931 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b54ad2-e9e7-4c28-8d2f-7103a9bddddc admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:40:00.981753 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b54ad2-e9e7-4c28-8d2f-7103a9bddddc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:40:00.983476 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b54ad2-e9e7-4c28-8d2f-7103a9bddddc admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:40:00.994882 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1067/2146] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 09:40:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:40:00.998929 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbec3670-1d43-4872-859e-73264ee20490 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:40:01.009295 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbec3670-1d43-4872-859e-73264ee20490 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:40:01.014242 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282e3aa5-b415-47b0-b442-1e548a1acb77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:40:01.015253 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282e3aa5-b415-47b0-b442-1e548a1acb77 admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:40:01.015610 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282e3aa5-b415-47b0-b442-1e548a1acb77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:40:01.015966 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282e3aa5-b415-47b0-b442-1e548a1acb77 admin admin] PATH_INFO: `/v3/projects/ae6c8bc52c6745da83ee66ce1e1312ab/users/400f6821a94b4eb9af46eb44fbb54dcb/roles/17dfac38a2e540fea229af7de99911bb` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:40:01.030932 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282e3aa5-b415-47b0-b442-1e548a1acb77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae6c8bc52c6745da83ee66ce1e1312ab, user_id=400f6821a94b4eb9af46eb44fbb54dcb, role_id=17dfac38a2e540fea229af7de99911bb)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:40:01.033617 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282e3aa5-b415-47b0-b442-1e548a1acb77 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:40:01.048010 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1080/2147] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 14 09:40:00 2022] PUT /identity/v3/projects/ae6c8bc52c6745da83ee66ce1e1312ab/users/400f6821a94b4eb9af46eb44fbb54dcb/roles/17dfac38a2e540fea229af7de99911bb => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:40:01.059167 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57ef00a-1506-431c-a1ee-2c58f4a75373 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:40:01.059462 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57ef00a-1506-431c-a1ee-2c58f4a75373 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:40:01.059747 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57ef00a-1506-431c-a1ee-2c58f4a75373 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:40:01.087718 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-d57ef00a-1506-431c-a1ee-2c58f4a75373 None None] MFA Rules not processed for user `400f6821a94b4eb9af46eb44fbb54dcb`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:40:01.088966 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-d57ef00a-1506-431c-a1ee-2c58f4a75373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:40:01.166113 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1068/2148] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:40:01 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:40:01.176938 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282e3aa5-b415-47b0-b442-1e548a1acb77 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:40:01.178720 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-282e3aa5-b415-47b0-b442-1e548a1acb77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:40:01.241394 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282e3aa5-b415-47b0-b442-1e548a1acb77 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:40:01.245411 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c83226-1d02-487a-9183-51e3eded30a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25048b29787d482783ebc944f1a7df65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:40:01.246019 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c83226-1d02-487a-9183-51e3eded30a8 service cinder] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:40:01.246393 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c83226-1d02-487a-9183-51e3eded30a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:40:01.246924 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c83226-1d02-487a-9183-51e3eded30a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:40:01.258706 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c83226-1d02-487a-9183-51e3eded30a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:40:01.260286 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c83226-1d02-487a-9183-51e3eded30a8 service cinder] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:40:01.273073 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1081/2149] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:40:01 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:40:11.162410 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=63,keystone:INSERT=3 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:40:11.267552 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=65,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:40:12.523278 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57ef00a-1506-431c-a1ee-2c58f4a75373 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:40:12.594599 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57ef00a-1506-431c-a1ee-2c58f4a75373 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:40:12.599213 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10718107-7dfe-4b54-9845-bc233cd7a65b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:40:12.600097 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10718107-7dfe-4b54-9845-bc233cd7a65b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:40:12.600404 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10718107-7dfe-4b54-9845-bc233cd7a65b admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:40:12.600683 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10718107-7dfe-4b54-9845-bc233cd7a65b admin admin] PATH_INFO: `/v3/users/400f6821a94b4eb9af46eb44fbb54dcb` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:40:12.601911 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10718107-7dfe-4b54-9845-bc233cd7a65b admin admin] RBAC: Authorizing `identity:delete_user(user_id=400f6821a94b4eb9af46eb44fbb54dcb)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:40:12.603907 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10718107-7dfe-4b54-9845-bc233cd7a65b admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:40:12.653752 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-10718107-7dfe-4b54-9845-bc233cd7a65b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '400f6821a94b4eb9af46eb44fbb54dcb'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:40:12.660954 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-10718107-7dfe-4b54-9845-bc233cd7a65b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '400f6821a94b4eb9af46eb44fbb54dcb'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:40:12.661799 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-10718107-7dfe-4b54-9845-bc233cd7a65b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '400f6821a94b4eb9af46eb44fbb54dcb'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:40:12.670972 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-10718107-7dfe-4b54-9845-bc233cd7a65b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '400f6821a94b4eb9af46eb44fbb54dcb'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:40:12.671298 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-10718107-7dfe-4b54-9845-bc233cd7a65b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '400f6821a94b4eb9af46eb44fbb54dcb'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:40:12.689814 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1069/2150] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 14 09:40:12 2022] DELETE /identity/v3/users/400f6821a94b4eb9af46eb44fbb54dcb => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 09:40:12.694309 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fc6f3f-5fed-41f4-810c-46c840173a4c None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:40:12.694804 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fc6f3f-5fed-41f4-810c-46c840173a4c None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:40:12.695446 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fc6f3f-5fed-41f4-810c-46c840173a4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:40:12.712783 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-23fc6f3f-5fed-41f4-810c-46c840173a4c None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:40:12.713987 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-23fc6f3f-5fed-41f4-810c-46c840173a4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:40:12.771410 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1082/2151] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:40:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:40:12.781214 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10718107-7dfe-4b54-9845-bc233cd7a65b admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:40:12.782674 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-10718107-7dfe-4b54-9845-bc233cd7a65b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:40:12.840706 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10718107-7dfe-4b54-9845-bc233cd7a65b admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:40:12.844476 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ca2955-2b15-4041-8df9-b483a8fe2a57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e4a5a8965e4802a9055d332179b7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:40:12.845122 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ca2955-2b15-4041-8df9-b483a8fe2a57 service neutron] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:40:12.845409 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ca2955-2b15-4041-8df9-b483a8fe2a57 service neutron] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:40:12.845762 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ca2955-2b15-4041-8df9-b483a8fe2a57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:40:12.855796 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ca2955-2b15-4041-8df9-b483a8fe2a57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:40:12.857222 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ca2955-2b15-4041-8df9-b483a8fe2a57 service neutron] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:40:12.868100 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1070/2152] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:40:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 09:40:13.130851 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fc6f3f-5fed-41f4-810c-46c840173a4c None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:40:13.132317 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-23fc6f3f-5fed-41f4-810c-46c840173a4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:40:13.145257 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fc6f3f-5fed-41f4-810c-46c840173a4c None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:40:13.149954 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0211d33-fda4-4fd7-b3e0-c21bd4621dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:40:13.150860 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0211d33-fda4-4fd7-b3e0-c21bd4621dbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:40:13.151150 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0211d33-fda4-4fd7-b3e0-c21bd4621dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:40:13.151433 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0211d33-fda4-4fd7-b3e0-c21bd4621dbe admin admin] PATH_INFO: `/v3/projects/ae6c8bc52c6745da83ee66ce1e1312ab` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:40:13.152647 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0211d33-fda4-4fd7-b3e0-c21bd4621dbe admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae6c8bc52c6745da83ee66ce1e1312ab)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:40:13.154701 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0211d33-fda4-4fd7-b3e0-c21bd4621dbe admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:40:13.205145 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-b0211d33-fda4-4fd7-b3e0-c21bd4621dbe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae6c8bc52c6745da83ee66ce1e1312ab', 'request_id': 'req-b0211d33-fda4-4fd7-b3e0-c21bd4621dbe'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:40:13.212368 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-b0211d33-fda4-4fd7-b3e0-c21bd4621dbe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae6c8bc52c6745da83ee66ce1e1312ab', 'request_id': 'req-b0211d33-fda4-4fd7-b3e0-c21bd4621dbe'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:40:13.218752 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-b0211d33-fda4-4fd7-b3e0-c21bd4621dbe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae6c8bc52c6745da83ee66ce1e1312ab', 'request_id': 'req-b0211d33-fda4-4fd7-b3e0-c21bd4621dbe'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:40:13.234313 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-b0211d33-fda4-4fd7-b3e0-c21bd4621dbe admin admin] The token cache is being invalidate because project ae6c8bc52c6745da83ee66ce1e1312ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 09:40:13.234608 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-b0211d33-fda4-4fd7-b3e0-c21bd4621dbe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:40:13.235255 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-b0211d33-fda4-4fd7-b3e0-c21bd4621dbe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:40:13.236804 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1083/2153] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 14 09:40:13 2022] DELETE /identity/v3/projects/ae6c8bc52c6745da83ee66ce1e1312ab => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:40:13.241695 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb0cec4-d390-4449-b89a-cc685a943458 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:40:13.244080 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb0cec4-d390-4449-b89a-cc685a943458 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:40:13.244080 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb0cec4-d390-4449-b89a-cc685a943458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:40:13.261102 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-2bb0cec4-d390-4449-b89a-cc685a943458 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:40:13.262368 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-2bb0cec4-d390-4449-b89a-cc685a943458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:40:13.282207 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:40:13.336190 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1071/2154] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:40:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 09:40:13.345049 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca097e1-c8df-42cf-ba93-87f68ac99dcb None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:40:13.345345 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca097e1-c8df-42cf-ba93-87f68ac99dcb None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:40:13.345634 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca097e1-c8df-42cf-ba93-87f68ac99dcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:40:13.378593 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-8ca097e1-c8df-42cf-ba93-87f68ac99dcb None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:40:13.378593 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-8ca097e1-c8df-42cf-ba93-87f68ac99dcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:40:13.384781 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1084/2155] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:40:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:40:13.388926 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb0cec4-d390-4449-b89a-cc685a943458 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:40:13.399114 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb0cec4-d390-4449-b89a-cc685a943458 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:40:13.403665 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95053046-66fb-4923-a177-ec55299e6b45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:40:13.404326 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95053046-66fb-4923-a177-ec55299e6b45 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:40:13.404644 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95053046-66fb-4923-a177-ec55299e6b45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:40:13.404926 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95053046-66fb-4923-a177-ec55299e6b45 admin admin] PATH_INFO: `/v3/domains` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:40:13.405663 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95053046-66fb-4923-a177-ec55299e6b45 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:40:13.405974 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95053046-66fb-4923-a177-ec55299e6b45 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:40:13.407612 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95053046-66fb-4923-a177-ec55299e6b45 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:40:13.419732 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1072/2156] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jul 14 09:40:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:40:13.423823 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca097e1-c8df-42cf-ba93-87f68ac99dcb None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:40:13.433392 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca097e1-c8df-42cf-ba93-87f68ac99dcb None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:40:13.438137 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1098bff-b6bc-46bc-b23a-778f939f3b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:40:13.438833 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1098bff-b6bc-46bc-b23a-778f939f3b98 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:40:13.439124 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1098bff-b6bc-46bc-b23a-778f939f3b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:40:13.439408 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1098bff-b6bc-46bc-b23a-778f939f3b98 admin admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:40:13.440238 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1098bff-b6bc-46bc-b23a-778f939f3b98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:40:13.442144 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1098bff-b6bc-46bc-b23a-778f939f3b98 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:40:13.473808 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1085/2157] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 14 09:40:13 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:40:13.474983 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95053046-66fb-4923-a177-ec55299e6b45 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:40:13.485916 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95053046-66fb-4923-a177-ec55299e6b45 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:40:13.543458 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c867715c-e4e0-413c-8127-09642d75ceaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:40:13.544141 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c867715c-e4e0-413c-8127-09642d75ceaf admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:40:13.544431 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c867715c-e4e0-413c-8127-09642d75ceaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:40:13.544718 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c867715c-e4e0-413c-8127-09642d75ceaf admin admin] PATH_INFO: `/v3/users` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:40:13.545424 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c867715c-e4e0-413c-8127-09642d75ceaf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:40:13.547393 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c867715c-e4e0-413c-8127-09642d75ceaf admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:40:13.568322 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1073/2158] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 14 09:40:13 2022] POST /identity/v3/users => generated 287 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:40:13.573041 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1098bff-b6bc-46bc-b23a-778f939f3b98 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:40:13.583451 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1098bff-b6bc-46bc-b23a-778f939f3b98 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:40:13.589027 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e3e2f5-da8d-4cbb-977f-e920610a3cc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:40:13.589701 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e3e2f5-da8d-4cbb-977f-e920610a3cc4 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:40:13.590152 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e3e2f5-da8d-4cbb-977f-e920610a3cc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:40:13.590422 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e3e2f5-da8d-4cbb-977f-e920610a3cc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:40:13.591167 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e3e2f5-da8d-4cbb-977f-e920610a3cc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:40:13.592772 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e3e2f5-da8d-4cbb-977f-e920610a3cc4 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:40:13.603405 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1086/2159] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 09:40:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 09:40:13.607396 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c867715c-e4e0-413c-8127-09642d75ceaf admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:40:13.617306 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c867715c-e4e0-413c-8127-09642d75ceaf admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:40:13.621992 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122db5ad-65e6-4bdf-819f-e3c2d2f43787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:40:13.622683 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122db5ad-65e6-4bdf-819f-e3c2d2f43787 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:40:13.622978 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122db5ad-65e6-4bdf-819f-e3c2d2f43787 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:40:13.623262 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122db5ad-65e6-4bdf-819f-e3c2d2f43787 admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:40:13.623997 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122db5ad-65e6-4bdf-819f-e3c2d2f43787 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:40:13.625591 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122db5ad-65e6-4bdf-819f-e3c2d2f43787 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:40:13.636076 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1074/2160] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 09:40:13 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:40:13.639932 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e3e2f5-da8d-4cbb-977f-e920610a3cc4 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:40:13.650407 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e3e2f5-da8d-4cbb-977f-e920610a3cc4 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:40:13.655005 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2709833c-ab66-40ae-878c-e1c4d9b49972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:40:13.655879 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2709833c-ab66-40ae-878c-e1c4d9b49972 admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:40:13.656156 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2709833c-ab66-40ae-878c-e1c4d9b49972 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:40:13.656430 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2709833c-ab66-40ae-878c-e1c4d9b49972 admin admin] PATH_INFO: `/v3/projects/a28617ad1f8d40faa7d2e317b32951ab/users/27cfaef90a5048569453430e75c4c42b/roles/17dfac38a2e540fea229af7de99911bb` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:40:13.670618 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2709833c-ab66-40ae-878c-e1c4d9b49972 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a28617ad1f8d40faa7d2e317b32951ab, user_id=27cfaef90a5048569453430e75c4c42b, role_id=17dfac38a2e540fea229af7de99911bb)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:40:13.673317 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2709833c-ab66-40ae-878c-e1c4d9b49972 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:40:13.686300 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1087/2161] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 14 09:40:13 2022] PUT /identity/v3/projects/a28617ad1f8d40faa7d2e317b32951ab/users/27cfaef90a5048569453430e75c4c42b/roles/17dfac38a2e540fea229af7de99911bb => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:40:13.691262 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec31119-1b36-4899-9294-ff3a11c814c7 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:40:13.691562 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec31119-1b36-4899-9294-ff3a11c814c7 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:40:13.691843 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec31119-1b36-4899-9294-ff3a11c814c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:40:13.711236 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-1ec31119-1b36-4899-9294-ff3a11c814c7 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:40:13.712459 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-1ec31119-1b36-4899-9294-ff3a11c814c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:40:13.771992 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1075/2162] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:40:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:40:13.783474 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2709833c-ab66-40ae-878c-e1c4d9b49972 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:40:13.786252 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-2709833c-ab66-40ae-878c-e1c4d9b49972 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:40:13.808719 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:40:13.850268 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2709833c-ab66-40ae-878c-e1c4d9b49972 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:40:13.853973 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a34a9f2-0261-4ea8-b214-a6e5d44f8836 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e4a5a8965e4802a9055d332179b7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:40:13.854668 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a34a9f2-0261-4ea8-b214-a6e5d44f8836 service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:40:13.854962 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a34a9f2-0261-4ea8-b214-a6e5d44f8836 service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:40:13.855248 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a34a9f2-0261-4ea8-b214-a6e5d44f8836 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:40:13.864403 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a34a9f2-0261-4ea8-b214-a6e5d44f8836 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:40:13.865834 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a34a9f2-0261-4ea8-b214-a6e5d44f8836 service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:40:13.875467 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1088/2163] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:40:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:40:19.498902 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ce284e-4ec6-4ac5-a029-3a8fc1a35bcb None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:40:19.499633 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ce284e-4ec6-4ac5-a029-3a8fc1a35bcb None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:40:19.499732 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ce284e-4ec6-4ac5-a029-3a8fc1a35bcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:40:19.560762 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-44ce284e-4ec6-4ac5-a029-3a8fc1a35bcb None None] MFA Rules not processed for user `27cfaef90a5048569453430e75c4c42b`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:40:19.562031 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-44ce284e-4ec6-4ac5-a029-3a8fc1a35bcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:40:19.592029 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:40:19.648623 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1076/2164] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:40:19 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:40:19.652831 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a34a9f2-0261-4ea8-b214-a6e5d44f8836 service neutron] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:40:19.666469 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a34a9f2-0261-4ea8-b214-a6e5d44f8836 service neutron] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:40:19.671341 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b9045e-aa15-4954-a7e8-fdbb6c9cd25d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:40:19.676141 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b9045e-aa15-4954-a7e8-fdbb6c9cd25d admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:40:19.676499 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b9045e-aa15-4954-a7e8-fdbb6c9cd25d admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:40:19.676789 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b9045e-aa15-4954-a7e8-fdbb6c9cd25d admin admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:40:19.677555 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b9045e-aa15-4954-a7e8-fdbb6c9cd25d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:40:19.680161 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b9045e-aa15-4954-a7e8-fdbb6c9cd25d admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:40:19.719466 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1089/2165] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 14 09:40:19 2022] POST /identity/v3/projects => generated 373 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:40:19.727035 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ce284e-4ec6-4ac5-a029-3a8fc1a35bcb None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:40:19.751240 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ce284e-4ec6-4ac5-a029-3a8fc1a35bcb None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:40:19.813679 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be124eb6-9113-41ba-ac9a-63c12dd07faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:40:19.814396 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be124eb6-9113-41ba-ac9a-63c12dd07faf admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:40:19.814684 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be124eb6-9113-41ba-ac9a-63c12dd07faf admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:40:19.814962 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be124eb6-9113-41ba-ac9a-63c12dd07faf admin admin] PATH_INFO: `/v3/users` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:40:19.815670 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be124eb6-9113-41ba-ac9a-63c12dd07faf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:40:19.817677 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be124eb6-9113-41ba-ac9a-63c12dd07faf admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:40:19.840601 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1077/2166] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 14 09:40:19 2022] POST /identity/v3/users => generated 293 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:40:19.844499 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b9045e-aa15-4954-a7e8-fdbb6c9cd25d admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:40:19.856523 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b9045e-aa15-4954-a7e8-fdbb6c9cd25d admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:40:19.861382 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b412a9f7-8784-4900-ae11-ec0da5dab478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:40:19.862078 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b412a9f7-8784-4900-ae11-ec0da5dab478 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:40:19.862395 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b412a9f7-8784-4900-ae11-ec0da5dab478 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:40:19.862683 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b412a9f7-8784-4900-ae11-ec0da5dab478 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:40:19.863422 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b412a9f7-8784-4900-ae11-ec0da5dab478 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:40:19.865036 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b412a9f7-8784-4900-ae11-ec0da5dab478 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:40:19.876867 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1090/2167] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 09:40:19 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 09:40:19.881164 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be124eb6-9113-41ba-ac9a-63c12dd07faf admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:40:19.899488 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be124eb6-9113-41ba-ac9a-63c12dd07faf admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:40:19.904374 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b5423b-0872-42aa-8f50-c5a3ae0b52a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:40:19.905319 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b5423b-0872-42aa-8f50-c5a3ae0b52a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:40:19.905758 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b5423b-0872-42aa-8f50-c5a3ae0b52a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:40:19.906053 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b5423b-0872-42aa-8f50-c5a3ae0b52a1 admin admin] PATH_INFO: `/v3/projects/765528ef03b54a86ac8764641a42efe1/users/6d631379146b4fe98570bcda7714b500/roles/e3965bd0d5f1427a86a313c0c90bfef3` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:40:19.929322 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b5423b-0872-42aa-8f50-c5a3ae0b52a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=765528ef03b54a86ac8764641a42efe1, user_id=6d631379146b4fe98570bcda7714b500, role_id=e3965bd0d5f1427a86a313c0c90bfef3)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:40:19.932059 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b5423b-0872-42aa-8f50-c5a3ae0b52a1 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:40:19.946605 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1078/2168] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 14 09:40:19 2022] PUT /identity/v3/projects/765528ef03b54a86ac8764641a42efe1/users/6d631379146b4fe98570bcda7714b500/roles/e3965bd0d5f1427a86a313c0c90bfef3 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:40:19.950646 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b412a9f7-8784-4900-ae11-ec0da5dab478 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:40:19.962351 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b412a9f7-8784-4900-ae11-ec0da5dab478 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:40:20.025912 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae26aad5-9e8c-4c78-9525-b0ed95cf1a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:40:20.025912 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae26aad5-9e8c-4c78-9525-b0ed95cf1a0a admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:40:20.026182 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae26aad5-9e8c-4c78-9525-b0ed95cf1a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:40:20.026341 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae26aad5-9e8c-4c78-9525-b0ed95cf1a0a admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:40:20.027085 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae26aad5-9e8c-4c78-9525-b0ed95cf1a0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:40:20.028954 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae26aad5-9e8c-4c78-9525-b0ed95cf1a0a admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:40:20.061814 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1091/2169] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 09:40:19 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:40:20.065905 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b5423b-0872-42aa-8f50-c5a3ae0b52a1 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:40:20.080863 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b5423b-0872-42aa-8f50-c5a3ae0b52a1 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:40:20.086854 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fa8827-c439-4ef8-816b-224ca1971096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:40:20.087851 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fa8827-c439-4ef8-816b-224ca1971096 admin admin] REQUEST_METHOD: `PUT` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:40:20.088136 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fa8827-c439-4ef8-816b-224ca1971096 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:40:20.088418 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fa8827-c439-4ef8-816b-224ca1971096 admin admin] PATH_INFO: `/v3/projects/765528ef03b54a86ac8764641a42efe1/users/6d631379146b4fe98570bcda7714b500/roles/e3965bd0d5f1427a86a313c0c90bfef3` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:40:20.090874 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fa8827-c439-4ef8-816b-224ca1971096 admin admin] RBAC: Authorizing `identity:create_grant(project_id=765528ef03b54a86ac8764641a42efe1, user_id=6d631379146b4fe98570bcda7714b500, role_id=e3965bd0d5f1427a86a313c0c90bfef3)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:40:20.093683 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fa8827-c439-4ef8-816b-224ca1971096 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:40:20.130228 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1079/2170] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 14 09:40:20 2022] PUT /identity/v3/projects/765528ef03b54a86ac8764641a42efe1/users/6d631379146b4fe98570bcda7714b500/roles/e3965bd0d5f1427a86a313c0c90bfef3 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:40:21.518041 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddc23f9-ca00-4c1e-abf6-183f7829dafb None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:40:21.518650 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddc23f9-ca00-4c1e-abf6-183f7829dafb None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:40:21.518650 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddc23f9-ca00-4c1e-abf6-183f7829dafb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:40:21.545318 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-9ddc23f9-ca00-4c1e-abf6-183f7829dafb None None] MFA Rules not processed for user `0b818be48fe94da3b7b0c1585d1a376b`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:40:21.546945 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-9ddc23f9-ca00-4c1e-abf6-183f7829dafb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:40:21.627321 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1092/2171] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:40:21 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:40:26.551839 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e86bbc3-5c61-4628-bafd-a5451edd3a51 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:40:26.552871 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e86bbc3-5c61-4628-bafd-a5451edd3a51 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:40:26.554037 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e86bbc3-5c61-4628-bafd-a5451edd3a51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:40:26.634136 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-3e86bbc3-5c61-4628-bafd-a5451edd3a51 None None] MFA Rules not processed for user `6d631379146b4fe98570bcda7714b500`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:40:26.635990 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-3e86bbc3-5c61-4628-bafd-a5451edd3a51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:40:26.732361 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:40:26.749999 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1080/2172] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:40:26 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:40:26.759017 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddc23f9-ca00-4c1e-abf6-183f7829dafb None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:40:26.761038 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-9ddc23f9-ca00-4c1e-abf6-183f7829dafb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:40:26.808461 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:40:26.868347 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddc23f9-ca00-4c1e-abf6-183f7829dafb None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:40:26.874643 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7ee4a5-2c54-4f2a-9bc9-5aabc03cff4b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f6962106dfa4c4c9af551053f8095e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:40:26.875431 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7ee4a5-2c54-4f2a-9bc9-5aabc03cff4b service nova] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:40:26.875923 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7ee4a5-2c54-4f2a-9bc9-5aabc03cff4b service nova] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:40:26.876271 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7ee4a5-2c54-4f2a-9bc9-5aabc03cff4b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:40:26.967370 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7ee4a5-2c54-4f2a-9bc9-5aabc03cff4b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:40:26.970986 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7ee4a5-2c54-4f2a-9bc9-5aabc03cff4b service nova] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:40:26.994954 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1093/2173] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:40:26 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:40:28.469122 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec835ae6-ccee-4347-895a-b038602a9e14 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:40:28.469642 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec835ae6-ccee-4347-895a-b038602a9e14 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:40:28.469739 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec835ae6-ccee-4347-895a-b038602a9e14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:40:28.493360 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-ec835ae6-ccee-4347-895a-b038602a9e14 None None] MFA Rules not processed for user `27cfaef90a5048569453430e75c4c42b`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:40:28.495127 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-ec835ae6-ccee-4347-895a-b038602a9e14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:40:28.503232 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1081/2174] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:40:28 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:40:36.978016 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=42 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:40:38.486942 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=5 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:40:39.500000 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7ee4a5-2c54-4f2a-9bc9-5aabc03cff4b service nova] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:40:39.501541 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-0e7ee4a5-2c54-4f2a-9bc9-5aabc03cff4b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:40:39.567469 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7ee4a5-2c54-4f2a-9bc9-5aabc03cff4b service nova] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:40:39.571130 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eb430b-5e03-42c9-a447-d7b2ddde5a19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e4a5a8965e4802a9055d332179b7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:40:39.571788 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eb430b-5e03-42c9-a447-d7b2ddde5a19 service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:40:39.572064 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eb430b-5e03-42c9-a447-d7b2ddde5a19 service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:40:39.572334 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eb430b-5e03-42c9-a447-d7b2ddde5a19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:40:39.574161 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-a4eb430b-5e03-42c9-a447-d7b2ddde5a19 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:40:39.643850 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4eb430b-5e03-42c9-a447-d7b2ddde5a19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:40:39.645287 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4eb430b-5e03-42c9-a447-d7b2ddde5a19 service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:40:39.655572 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1094/2175] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:40:39 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:40:47.220592 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994724a0-f609-452f-815e-f8620466b34a None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:40:47.221066 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994724a0-f609-452f-815e-f8620466b34a None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:40:47.221157 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994724a0-f609-452f-815e-f8620466b34a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:40:47.238664 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-994724a0-f609-452f-815e-f8620466b34a None None] MFA Rules not processed for user `f1d0b9390f474de79828a675d4e0646a`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:40:47.239881 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-994724a0-f609-452f-815e-f8620466b34a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:40:47.294577 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1082/2176] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:40:47 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:40:49.651063 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=50 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:40:57.287718 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=25 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:41:00.024198 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9322e110-7870-48f2-a427-ce46d4698f8d None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:41:00.024729 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9322e110-7870-48f2-a427-ce46d4698f8d None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:41:00.024827 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9322e110-7870-48f2-a427-ce46d4698f8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:41:00.043053 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-9322e110-7870-48f2-a427-ce46d4698f8d None None] MFA Rules not processed for user `6cf35868f9ff46e2835a6cc023641da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:41:00.044253 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-9322e110-7870-48f2-a427-ce46d4698f8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:41:00.099732 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1095/2177] 10.222.0.40 () {58 vars in 1009 bytes} [Thu Jul 14 09:41:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:41:00.141352 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994724a0-f609-452f-815e-f8620466b34a None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:41:00.142843 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-994724a0-f609-452f-815e-f8620466b34a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:41:00.215035 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994724a0-f609-452f-815e-f8620466b34a None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:41:00.219870 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dad4fe2-b4fa-41c6-be91-fef2e830a005 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '302c0f7dd3bf4829aad0b29bd0c091a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:41:00.220522 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dad4fe2-b4fa-41c6-be91-fef2e830a005 service swift] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:41:00.220806 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dad4fe2-b4fa-41c6-be91-fef2e830a005 service swift] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:41:00.221081 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dad4fe2-b4fa-41c6-be91-fef2e830a005 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:41:00.229185 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dad4fe2-b4fa-41c6-be91-fef2e830a005 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:41:00.230814 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dad4fe2-b4fa-41c6-be91-fef2e830a005 service swift] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:41:00.238876 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1083/2178] 10.222.0.40 () {60 vars in 1384 bytes} [Thu Jul 14 09:41:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 09:41:00.542340 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9322e110-7870-48f2-a427-ce46d4698f8d None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:41:00.544077 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-9322e110-7870-48f2-a427-ce46d4698f8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:41:00.735228 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9322e110-7870-48f2-a427-ce46d4698f8d None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:41:00.747503 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158ca378-01c0-4b54-ae00-b8a67994d89e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc5a80144b84c609944a51a84fd5e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:41:00.748715 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158ca378-01c0-4b54-ae00-b8a67994d89e service placement] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:41:00.749165 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158ca378-01c0-4b54-ae00-b8a67994d89e service placement] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:41:00.749596 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158ca378-01c0-4b54-ae00-b8a67994d89e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:41:00.751991 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-158ca378-01c0-4b54-ae00-b8a67994d89e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:41:00.767819 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158ca378-01c0-4b54-ae00-b8a67994d89e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:41:00.769718 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158ca378-01c0-4b54-ae00-b8a67994d89e service placement] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:41:00.793667 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1096/2179] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:41:00 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:41:10.235640 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=32 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:41:10.786768 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=57 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:41:17.402490 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff71bac-3c6d-436d-ac71-999778fd6d61 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:41:17.402987 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff71bac-3c6d-436d-ac71-999778fd6d61 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:41:17.403091 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff71bac-3c6d-436d-ac71-999778fd6d61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:41:17.421360 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-aff71bac-3c6d-436d-ac71-999778fd6d61 None None] MFA Rules not processed for user `6cf35868f9ff46e2835a6cc023641da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:41:17.422607 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-aff71bac-3c6d-436d-ac71-999778fd6d61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:41:17.429833 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1084/2180] 10.222.0.40 () {58 vars in 967 bytes} [Thu Jul 14 09:41:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:41:17.441924 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158ca378-01c0-4b54-ae00-b8a67994d89e service placement] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:41:17.453124 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158ca378-01c0-4b54-ae00-b8a67994d89e service placement] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:41:17.458850 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26d11ef-eb86-4cbb-9aa6-dfaa2e955cbc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '302c0f7dd3bf4829aad0b29bd0c091a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:41:17.459491 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26d11ef-eb86-4cbb-9aa6-dfaa2e955cbc service swift] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:41:17.459777 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26d11ef-eb86-4cbb-9aa6-dfaa2e955cbc service swift] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:41:17.460061 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26d11ef-eb86-4cbb-9aa6-dfaa2e955cbc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:41:17.468022 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26d11ef-eb86-4cbb-9aa6-dfaa2e955cbc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:41:17.469591 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26d11ef-eb86-4cbb-9aa6-dfaa2e955cbc service swift] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:41:17.478153 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1097/2181] 10.222.0.40 () {60 vars in 1384 bytes} [Thu Jul 14 09:41:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 14 09:41:19.445045 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff71bac-3c6d-436d-ac71-999778fd6d61 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:41:19.446762 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-aff71bac-3c6d-436d-ac71-999778fd6d61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:41:19.519475 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff71bac-3c6d-436d-ac71-999778fd6d61 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:41:19.529431 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914750f6-97c7-4b16-b79e-455171d1e992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:41:19.530355 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914750f6-97c7-4b16-b79e-455171d1e992 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:41:19.530631 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914750f6-97c7-4b16-b79e-455171d1e992 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:41:19.530922 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914750f6-97c7-4b16-b79e-455171d1e992 admin admin] PATH_INFO: `/v3/users/0b818be48fe94da3b7b0c1585d1a376b` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:41:19.532163 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914750f6-97c7-4b16-b79e-455171d1e992 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b818be48fe94da3b7b0c1585d1a376b)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:41:19.534105 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914750f6-97c7-4b16-b79e-455171d1e992 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:41:19.582079 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-914750f6-97c7-4b16-b79e-455171d1e992 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b818be48fe94da3b7b0c1585d1a376b'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:41:19.589346 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-914750f6-97c7-4b16-b79e-455171d1e992 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b818be48fe94da3b7b0c1585d1a376b'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:41:19.590005 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-914750f6-97c7-4b16-b79e-455171d1e992 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b818be48fe94da3b7b0c1585d1a376b'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:41:19.596964 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-914750f6-97c7-4b16-b79e-455171d1e992 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b818be48fe94da3b7b0c1585d1a376b'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:41:19.597672 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-914750f6-97c7-4b16-b79e-455171d1e992 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b818be48fe94da3b7b0c1585d1a376b'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:41:19.615879 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1085/2182] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 14 09:41:19 2022] DELETE /identity/v3/users/0b818be48fe94da3b7b0c1585d1a376b => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:41:19.793053 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26d11ef-eb86-4cbb-9aa6-dfaa2e955cbc service swift] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:41:19.804755 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26d11ef-eb86-4cbb-9aa6-dfaa2e955cbc service swift] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:41:19.863412 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c5ba1e-a4d1-4202-9ac7-aefb897d2992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:41:19.864306 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c5ba1e-a4d1-4202-9ac7-aefb897d2992 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:41:19.864605 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c5ba1e-a4d1-4202-9ac7-aefb897d2992 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:41:19.864872 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c5ba1e-a4d1-4202-9ac7-aefb897d2992 admin admin] PATH_INFO: `/v3/projects/8912a4453d094df58486417ebacfa14c` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:41:19.866058 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c5ba1e-a4d1-4202-9ac7-aefb897d2992 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8912a4453d094df58486417ebacfa14c)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:41:19.868021 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c5ba1e-a4d1-4202-9ac7-aefb897d2992 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:41:19.914315 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-c9c5ba1e-a4d1-4202-9ac7-aefb897d2992 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8912a4453d094df58486417ebacfa14c', 'request_id': 'req-c9c5ba1e-a4d1-4202-9ac7-aefb897d2992'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:41:19.920277 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-c9c5ba1e-a4d1-4202-9ac7-aefb897d2992 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8912a4453d094df58486417ebacfa14c', 'request_id': 'req-c9c5ba1e-a4d1-4202-9ac7-aefb897d2992'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:41:19.925920 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-c9c5ba1e-a4d1-4202-9ac7-aefb897d2992 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8912a4453d094df58486417ebacfa14c', 'request_id': 'req-c9c5ba1e-a4d1-4202-9ac7-aefb897d2992'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:41:19.939218 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-c9c5ba1e-a4d1-4202-9ac7-aefb897d2992 admin admin] The token cache is being invalidate because project 8912a4453d094df58486417ebacfa14c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 09:41:19.939504 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-c9c5ba1e-a4d1-4202-9ac7-aefb897d2992 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:41:19.940128 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-c9c5ba1e-a4d1-4202-9ac7-aefb897d2992 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:41:19.945567 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1098/2183] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 14 09:41:19 2022] DELETE /identity/v3/projects/8912a4453d094df58486417ebacfa14c => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:41:19.947650 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245e8fba-b8db-4ab6-aef4-a075c5a82ae3 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:41:19.947937 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245e8fba-b8db-4ab6-aef4-a075c5a82ae3 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:41:19.948215 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245e8fba-b8db-4ab6-aef4-a075c5a82ae3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:41:19.967237 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-245e8fba-b8db-4ab6-aef4-a075c5a82ae3 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:41:19.968628 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-245e8fba-b8db-4ab6-aef4-a075c5a82ae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:41:20.029775 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1086/2184] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:41:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:41:20.037395 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc377dca-4eb1-4c5e-b971-cedea0755c7e None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:41:20.037691 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc377dca-4eb1-4c5e-b971-cedea0755c7e None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:41:20.037991 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc377dca-4eb1-4c5e-b971-cedea0755c7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:41:20.056996 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-dc377dca-4eb1-4c5e-b971-cedea0755c7e None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:41:20.058245 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-dc377dca-4eb1-4c5e-b971-cedea0755c7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:41:20.068728 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1099/2185] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:41:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:41:20.072951 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245e8fba-b8db-4ab6-aef4-a075c5a82ae3 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:41:20.083497 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245e8fba-b8db-4ab6-aef4-a075c5a82ae3 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:41:20.088183 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60676988-ebc0-4a27-9303-c44810c81631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:41:20.088846 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60676988-ebc0-4a27-9303-c44810c81631 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:41:20.089130 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60676988-ebc0-4a27-9303-c44810c81631 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:41:20.089414 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60676988-ebc0-4a27-9303-c44810c81631 admin admin] PATH_INFO: `/v3/domains` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:41:20.090149 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60676988-ebc0-4a27-9303-c44810c81631 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:41:20.090492 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60676988-ebc0-4a27-9303-c44810c81631 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:41:20.092113 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60676988-ebc0-4a27-9303-c44810c81631 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:41:20.101241 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:41:20.106046 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1087/2186] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jul 14 09:41:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:41:20.109826 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc377dca-4eb1-4c5e-b971-cedea0755c7e None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:41:20.119922 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc377dca-4eb1-4c5e-b971-cedea0755c7e None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:41:20.124645 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89931a98-69e4-44e6-9f7e-b38780f15dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:41:20.125426 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89931a98-69e4-44e6-9f7e-b38780f15dc3 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:41:20.125599 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89931a98-69e4-44e6-9f7e-b38780f15dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:41:20.125877 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89931a98-69e4-44e6-9f7e-b38780f15dc3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:41:20.126620 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89931a98-69e4-44e6-9f7e-b38780f15dc3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:41:20.128524 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89931a98-69e4-44e6-9f7e-b38780f15dc3 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:41:20.159015 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1100/2187] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 14 09:41:20 2022] POST /identity/v3/projects => generated 371 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:41:20.163498 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60676988-ebc0-4a27-9303-c44810c81631 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:41:20.173661 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60676988-ebc0-4a27-9303-c44810c81631 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:41:20.267467 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be27c8b1-facb-4bb6-b6a9-d7a52dde59ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:41:20.268174 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be27c8b1-facb-4bb6-b6a9-d7a52dde59ae admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:41:20.268460 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be27c8b1-facb-4bb6-b6a9-d7a52dde59ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:41:20.268727 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be27c8b1-facb-4bb6-b6a9-d7a52dde59ae admin admin] PATH_INFO: `/v3/users` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:41:20.269435 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be27c8b1-facb-4bb6-b6a9-d7a52dde59ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:41:20.278527 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be27c8b1-facb-4bb6-b6a9-d7a52dde59ae admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:41:20.307810 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1088/2188] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 14 09:41:20 2022] POST /identity/v3/users => generated 286 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 09:41:20.309283 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89931a98-69e4-44e6-9f7e-b38780f15dc3 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:41:20.333116 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89931a98-69e4-44e6-9f7e-b38780f15dc3 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:41:20.338042 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369bfb7d-b27f-45b3-911e-2505b3f7ace8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:41:20.339322 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369bfb7d-b27f-45b3-911e-2505b3f7ace8 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:41:20.339322 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369bfb7d-b27f-45b3-911e-2505b3f7ace8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:41:20.339322 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369bfb7d-b27f-45b3-911e-2505b3f7ace8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:41:20.340266 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369bfb7d-b27f-45b3-911e-2505b3f7ace8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:41:20.341897 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369bfb7d-b27f-45b3-911e-2505b3f7ace8 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:41:20.357772 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1101/2189] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 09:41:20 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:41:20.361779 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be27c8b1-facb-4bb6-b6a9-d7a52dde59ae admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:41:20.373233 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be27c8b1-facb-4bb6-b6a9-d7a52dde59ae admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:41:20.378968 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050b5ec5-7dbc-4c76-82ff-f963625bd46b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:41:20.380976 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050b5ec5-7dbc-4c76-82ff-f963625bd46b admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:41:20.381280 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050b5ec5-7dbc-4c76-82ff-f963625bd46b admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:41:20.381704 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050b5ec5-7dbc-4c76-82ff-f963625bd46b admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:41:20.382503 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050b5ec5-7dbc-4c76-82ff-f963625bd46b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:41:20.384121 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050b5ec5-7dbc-4c76-82ff-f963625bd46b admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:41:20.395540 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1089/2190] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 09:41:20 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:41:20.399975 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369bfb7d-b27f-45b3-911e-2505b3f7ace8 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:41:20.410453 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369bfb7d-b27f-45b3-911e-2505b3f7ace8 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:41:20.415249 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a445475-5954-4876-80b4-fc1fe645970b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:41:20.416149 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a445475-5954-4876-80b4-fc1fe645970b admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:41:20.416493 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a445475-5954-4876-80b4-fc1fe645970b admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:41:20.416730 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a445475-5954-4876-80b4-fc1fe645970b admin admin] PATH_INFO: `/v3/projects/58df2f717fcd44939fa909c6d0bdbf79/users/1f3d903b658e4039a110cd24e1691386/roles/17dfac38a2e540fea229af7de99911bb` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:41:20.433309 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a445475-5954-4876-80b4-fc1fe645970b admin admin] RBAC: Authorizing `identity:create_grant(project_id=58df2f717fcd44939fa909c6d0bdbf79, user_id=1f3d903b658e4039a110cd24e1691386, role_id=17dfac38a2e540fea229af7de99911bb)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:41:20.436228 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a445475-5954-4876-80b4-fc1fe645970b admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:41:20.449875 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1102/2191] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 14 09:41:20 2022] PUT /identity/v3/projects/58df2f717fcd44939fa909c6d0bdbf79/users/1f3d903b658e4039a110cd24e1691386/roles/17dfac38a2e540fea229af7de99911bb => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 09:41:20.460891 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e734d03b-1d38-4cce-b96a-300f0170d2be None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:41:20.461381 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e734d03b-1d38-4cce-b96a-300f0170d2be None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:41:20.461710 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e734d03b-1d38-4cce-b96a-300f0170d2be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:41:20.489417 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-e734d03b-1d38-4cce-b96a-300f0170d2be None None] MFA Rules not processed for user `1f3d903b658e4039a110cd24e1691386`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:41:20.490649 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-e734d03b-1d38-4cce-b96a-300f0170d2be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:41:20.554791 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1090/2192] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:41:20 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:41:20.565831 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a445475-5954-4876-80b4-fc1fe645970b admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:41:20.568161 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-9a445475-5954-4876-80b4-fc1fe645970b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:41:20.582444 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:41:20.624980 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a445475-5954-4876-80b4-fc1fe645970b admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:41:20.628729 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c2b379-842e-4bc6-9285-ff9fd80bcd9d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25048b29787d482783ebc944f1a7df65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:41:20.629963 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c2b379-842e-4bc6-9285-ff9fd80bcd9d service cinder] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:41:20.630281 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c2b379-842e-4bc6-9285-ff9fd80bcd9d service cinder] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:41:20.630564 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c2b379-842e-4bc6-9285-ff9fd80bcd9d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:41:20.638899 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c2b379-842e-4bc6-9285-ff9fd80bcd9d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:41:20.640327 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c2b379-842e-4bc6-9285-ff9fd80bcd9d service cinder] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:41:20.649036 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1103/2193] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:41:20 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:41:22.967551 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e734d03b-1d38-4cce-b96a-300f0170d2be None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:41:22.968967 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-e734d03b-1d38-4cce-b96a-300f0170d2be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:41:23.026898 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e734d03b-1d38-4cce-b96a-300f0170d2be None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:41:23.030687 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca37625-11c3-4460-b7c0-75b82aef49dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e4a5a8965e4802a9055d332179b7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:41:23.031339 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca37625-11c3-4460-b7c0-75b82aef49dd service neutron] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:41:23.031622 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca37625-11c3-4460-b7c0-75b82aef49dd service neutron] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:41:23.031920 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca37625-11c3-4460-b7c0-75b82aef49dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:41:23.033692 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-dca37625-11c3-4460-b7c0-75b82aef49dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:41:23.043170 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad0ff77-3038-418e-8295-6a2721cd4fea None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:41:23.043641 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad0ff77-3038-418e-8295-6a2721cd4fea None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:41:23.043800 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad0ff77-3038-418e-8295-6a2721cd4fea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:41:23.057196 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:41:23.060981 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-7ad0ff77-3038-418e-8295-6a2721cd4fea None None] MFA Rules not processed for user `1f3d903b658e4039a110cd24e1691386`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:41:23.062171 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-7ad0ff77-3038-418e-8295-6a2721cd4fea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:41:23.069886 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1104/2194] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:41:23 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 09:41:23.102446 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca37625-11c3-4460-b7c0-75b82aef49dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:41:23.103894 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca37625-11c3-4460-b7c0-75b82aef49dd service neutron] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:41:23.113589 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1091/2195] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:41:22 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:41:33.055698 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=23 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:41:33.109279 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=19 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:41:42.547038 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f12c165-a61d-4ae5-ac37-db58d699e3c5 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:41:42.547519 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f12c165-a61d-4ae5-ac37-db58d699e3c5 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:41:42.547617 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f12c165-a61d-4ae5-ac37-db58d699e3c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:41:42.565107 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-3f12c165-a61d-4ae5-ac37-db58d699e3c5 None None] MFA Rules not processed for user `6cf35868f9ff46e2835a6cc023641da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:41:42.566337 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-3f12c165-a61d-4ae5-ac37-db58d699e3c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:41:42.622962 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1105/2196] 10.222.0.40 () {58 vars in 1009 bytes} [Thu Jul 14 09:41:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:41:42.635439 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca37625-11c3-4460-b7c0-75b82aef49dd service neutron] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:41:42.636857 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-dca37625-11c3-4460-b7c0-75b82aef49dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:41:42.706052 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca37625-11c3-4460-b7c0-75b82aef49dd service neutron] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:41:42.711645 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5757243-a16f-42a2-b7bf-3380d5eee440 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '302c0f7dd3bf4829aad0b29bd0c091a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:41:42.712297 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5757243-a16f-42a2-b7bf-3380d5eee440 service swift] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:41:42.712583 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5757243-a16f-42a2-b7bf-3380d5eee440 service swift] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:41:42.712861 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5757243-a16f-42a2-b7bf-3380d5eee440 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:41:42.721001 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5757243-a16f-42a2-b7bf-3380d5eee440 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:41:42.722619 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5757243-a16f-42a2-b7bf-3380d5eee440 service swift] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:41:42.730663 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1092/2197] 10.222.0.40 () {60 vars in 1384 bytes} [Thu Jul 14 09:41:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 09:41:43.236845 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4253a6-2334-4271-b5d4-8fbc78dbc0a8 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:41:43.237137 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4253a6-2334-4271-b5d4-8fbc78dbc0a8 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:41:43.237421 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4253a6-2334-4271-b5d4-8fbc78dbc0a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:41:43.256587 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-cd4253a6-2334-4271-b5d4-8fbc78dbc0a8 None None] MFA Rules not processed for user `6cf35868f9ff46e2835a6cc023641da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:41:43.257825 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-cd4253a6-2334-4271-b5d4-8fbc78dbc0a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:41:43.265222 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1106/2198] 10.222.0.40 () {58 vars in 967 bytes} [Thu Jul 14 09:41:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:41:43.277806 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5757243-a16f-42a2-b7bf-3380d5eee440 service swift] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:41:43.288704 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5757243-a16f-42a2-b7bf-3380d5eee440 service swift] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:41:43.293700 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a8fe01-40c9-40e7-99ba-eddfaf065515 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '302c0f7dd3bf4829aad0b29bd0c091a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:41:43.294379 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a8fe01-40c9-40e7-99ba-eddfaf065515 service swift] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:41:43.294666 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a8fe01-40c9-40e7-99ba-eddfaf065515 service swift] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:41:43.294947 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a8fe01-40c9-40e7-99ba-eddfaf065515 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:41:43.303775 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a8fe01-40c9-40e7-99ba-eddfaf065515 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:41:43.305347 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a8fe01-40c9-40e7-99ba-eddfaf065515 service swift] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:41:43.313610 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1093/2199] 10.222.0.40 () {60 vars in 1384 bytes} [Thu Jul 14 09:41:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 09:41:43.504093 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2978c6-c08f-4ece-b7e1-20e0c8538aaf None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:41:43.504391 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2978c6-c08f-4ece-b7e1-20e0c8538aaf None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:41:43.504717 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2978c6-c08f-4ece-b7e1-20e0c8538aaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:41:43.522588 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-aa2978c6-c08f-4ece-b7e1-20e0c8538aaf None None] MFA Rules not processed for user `6cf35868f9ff46e2835a6cc023641da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:41:43.523801 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-aa2978c6-c08f-4ece-b7e1-20e0c8538aaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:41:43.531223 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1107/2200] 10.222.0.40 () {58 vars in 1009 bytes} [Thu Jul 14 09:41:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:41:43.543833 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a8fe01-40c9-40e7-99ba-eddfaf065515 service swift] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:41:43.554356 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a8fe01-40c9-40e7-99ba-eddfaf065515 service swift] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:41:43.560448 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26b0eda-fc8c-4700-bc67-2be0f7539507 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '302c0f7dd3bf4829aad0b29bd0c091a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:41:43.560640 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26b0eda-fc8c-4700-bc67-2be0f7539507 service swift] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:41:43.561248 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26b0eda-fc8c-4700-bc67-2be0f7539507 service swift] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:41:43.561248 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26b0eda-fc8c-4700-bc67-2be0f7539507 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:41:43.569886 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26b0eda-fc8c-4700-bc67-2be0f7539507 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:41:43.571559 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26b0eda-fc8c-4700-bc67-2be0f7539507 service swift] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:41:43.580104 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1094/2201] 10.222.0.40 () {60 vars in 1384 bytes} [Thu Jul 14 09:41:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 09:41:43.904040 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df12ccf-7680-49b7-8210-7363d471343c None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:41:43.904525 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df12ccf-7680-49b7-8210-7363d471343c None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:41:43.904615 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df12ccf-7680-49b7-8210-7363d471343c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:41:43.922966 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-4df12ccf-7680-49b7-8210-7363d471343c None None] MFA Rules not processed for user `6cf35868f9ff46e2835a6cc023641da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:41:43.924195 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-4df12ccf-7680-49b7-8210-7363d471343c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:41:43.931748 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1108/2202] 10.222.0.40 () {58 vars in 967 bytes} [Thu Jul 14 09:41:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:41:43.944302 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26b0eda-fc8c-4700-bc67-2be0f7539507 service swift] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:41:43.955410 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26b0eda-fc8c-4700-bc67-2be0f7539507 service swift] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:41:43.961667 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa650d5a-cfdd-4fc5-83ab-73991a650c20 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '302c0f7dd3bf4829aad0b29bd0c091a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:41:43.962440 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa650d5a-cfdd-4fc5-83ab-73991a650c20 service swift] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:41:43.962793 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa650d5a-cfdd-4fc5-83ab-73991a650c20 service swift] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:41:43.963135 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa650d5a-cfdd-4fc5-83ab-73991a650c20 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:41:43.971747 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa650d5a-cfdd-4fc5-83ab-73991a650c20 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:41:43.973335 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa650d5a-cfdd-4fc5-83ab-73991a650c20 service swift] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:41:43.981726 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1095/2203] 10.222.0.40 () {60 vars in 1384 bytes} [Thu Jul 14 09:41:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 14 09:41:46.022023 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df12ccf-7680-49b7-8210-7363d471343c None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:41:46.083925 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df12ccf-7680-49b7-8210-7363d471343c None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:41:46.088558 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f37704-92a1-4bcc-a8f6-20081be1f56f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:41:46.089425 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f37704-92a1-4bcc-a8f6-20081be1f56f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:41:46.089708 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f37704-92a1-4bcc-a8f6-20081be1f56f admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:41:46.089982 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f37704-92a1-4bcc-a8f6-20081be1f56f admin admin] PATH_INFO: `/v3/users/1f3d903b658e4039a110cd24e1691386` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:41:46.091222 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f37704-92a1-4bcc-a8f6-20081be1f56f admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f3d903b658e4039a110cd24e1691386)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:41:46.093163 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f37704-92a1-4bcc-a8f6-20081be1f56f admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:41:46.138680 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-a0f37704-92a1-4bcc-a8f6-20081be1f56f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f3d903b658e4039a110cd24e1691386'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:41:46.150486 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-a0f37704-92a1-4bcc-a8f6-20081be1f56f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f3d903b658e4039a110cd24e1691386'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:41:46.151144 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-a0f37704-92a1-4bcc-a8f6-20081be1f56f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f3d903b658e4039a110cd24e1691386'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:41:46.158157 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-a0f37704-92a1-4bcc-a8f6-20081be1f56f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f3d903b658e4039a110cd24e1691386'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:41:46.165610 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-a0f37704-92a1-4bcc-a8f6-20081be1f56f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f3d903b658e4039a110cd24e1691386'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:41:46.171509 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1109/2204] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 14 09:41:46 2022] DELETE /identity/v3/users/1f3d903b658e4039a110cd24e1691386 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:41:46.175973 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5675f64-1275-4995-88a3-71a3a204827f None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:41:46.176993 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5675f64-1275-4995-88a3-71a3a204827f None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:41:46.177157 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5675f64-1275-4995-88a3-71a3a204827f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:41:46.194305 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-e5675f64-1275-4995-88a3-71a3a204827f None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:41:46.195513 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-e5675f64-1275-4995-88a3-71a3a204827f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:41:46.253631 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1096/2205] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:41:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:41:46.263412 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f37704-92a1-4bcc-a8f6-20081be1f56f admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:41:46.264797 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-a0f37704-92a1-4bcc-a8f6-20081be1f56f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:41:46.271564 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:41:46.323134 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f37704-92a1-4bcc-a8f6-20081be1f56f admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:41:46.326859 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9dd787-f29b-4e74-8925-b260f0c4324e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e4a5a8965e4802a9055d332179b7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:41:46.327510 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9dd787-f29b-4e74-8925-b260f0c4324e service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:41:46.327799 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9dd787-f29b-4e74-8925-b260f0c4324e service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:41:46.328077 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9dd787-f29b-4e74-8925-b260f0c4324e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:41:46.337557 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9dd787-f29b-4e74-8925-b260f0c4324e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:41:46.339064 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9dd787-f29b-4e74-8925-b260f0c4324e service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:41:46.349440 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1110/2206] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:41:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:41:46.594024 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5675f64-1275-4995-88a3-71a3a204827f None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:41:46.595532 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-e5675f64-1275-4995-88a3-71a3a204827f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:41:46.615149 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5675f64-1275-4995-88a3-71a3a204827f None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:41:46.620003 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a928154-29aa-40ea-aef7-0c3177fe5dbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:41:46.620971 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a928154-29aa-40ea-aef7-0c3177fe5dbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:41:46.622577 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a928154-29aa-40ea-aef7-0c3177fe5dbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:41:46.622859 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a928154-29aa-40ea-aef7-0c3177fe5dbf admin admin] PATH_INFO: `/v3/projects/58df2f717fcd44939fa909c6d0bdbf79` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:41:46.624126 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a928154-29aa-40ea-aef7-0c3177fe5dbf admin admin] RBAC: Authorizing `identity:delete_project(project_id=58df2f717fcd44939fa909c6d0bdbf79)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:41:46.626067 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a928154-29aa-40ea-aef7-0c3177fe5dbf admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:41:46.673907 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:41:46.677072 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-2a928154-29aa-40ea-aef7-0c3177fe5dbf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58df2f717fcd44939fa909c6d0bdbf79', 'request_id': 'req-2a928154-29aa-40ea-aef7-0c3177fe5dbf'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:41:46.687823 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-2a928154-29aa-40ea-aef7-0c3177fe5dbf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58df2f717fcd44939fa909c6d0bdbf79', 'request_id': 'req-2a928154-29aa-40ea-aef7-0c3177fe5dbf'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:41:46.694144 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-2a928154-29aa-40ea-aef7-0c3177fe5dbf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58df2f717fcd44939fa909c6d0bdbf79', 'request_id': 'req-2a928154-29aa-40ea-aef7-0c3177fe5dbf'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:41:46.705277 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-2a928154-29aa-40ea-aef7-0c3177fe5dbf admin admin] The token cache is being invalidate because project 58df2f717fcd44939fa909c6d0bdbf79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 09:41:46.705832 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-2a928154-29aa-40ea-aef7-0c3177fe5dbf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:41:46.706498 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-2a928154-29aa-40ea-aef7-0c3177fe5dbf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 09:41:46.708579 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1097/2207] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 14 09:41:46 2022] DELETE /identity/v3/projects/58df2f717fcd44939fa909c6d0bdbf79 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:41:46.713381 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee48e92-7813-490e-93af-c7ec4626b13b None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:41:46.713682 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee48e92-7813-490e-93af-c7ec4626b13b None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:41:46.713959 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee48e92-7813-490e-93af-c7ec4626b13b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:41:46.740292 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-2ee48e92-7813-490e-93af-c7ec4626b13b None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:41:46.741500 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-2ee48e92-7813-490e-93af-c7ec4626b13b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:41:46.810088 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1111/2208] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:41:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:41:46.817692 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e98e861-7ea7-479b-9cf5-a0a55b2e9912 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:41:46.817984 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e98e861-7ea7-479b-9cf5-a0a55b2e9912 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:41:46.818302 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e98e861-7ea7-479b-9cf5-a0a55b2e9912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:41:46.836746 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-8e98e861-7ea7-479b-9cf5-a0a55b2e9912 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:41:46.837975 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-8e98e861-7ea7-479b-9cf5-a0a55b2e9912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:41:46.845872 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1098/2209] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:41:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 09:41:46.850551 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee48e92-7813-490e-93af-c7ec4626b13b None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:41:46.860085 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee48e92-7813-490e-93af-c7ec4626b13b None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:41:46.864619 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f129304b-2637-4463-9129-618f9eea3cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:41:46.865269 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f129304b-2637-4463-9129-618f9eea3cb1 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:41:46.865553 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f129304b-2637-4463-9129-618f9eea3cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:41:46.865832 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f129304b-2637-4463-9129-618f9eea3cb1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:41:46.866590 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f129304b-2637-4463-9129-618f9eea3cb1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 09:41:46.866901 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f129304b-2637-4463-9129-618f9eea3cb1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:41:46.868491 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f129304b-2637-4463-9129-618f9eea3cb1 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:41:46.880301 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1112/2210] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jul 14 09:41:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 09:41:46.884655 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e98e861-7ea7-479b-9cf5-a0a55b2e9912 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:41:46.893850 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e98e861-7ea7-479b-9cf5-a0a55b2e9912 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:41:46.899177 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d894399f-af74-4ac4-9a53-242d6a55ce7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:41:46.899824 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d894399f-af74-4ac4-9a53-242d6a55ce7b admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:41:46.900109 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d894399f-af74-4ac4-9a53-242d6a55ce7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:41:46.900389 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d894399f-af74-4ac4-9a53-242d6a55ce7b admin admin] PATH_INFO: `/v3/projects` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:41:46.901082 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d894399f-af74-4ac4-9a53-242d6a55ce7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:41:46.903024 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d894399f-af74-4ac4-9a53-242d6a55ce7b admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:41:46.927501 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1099/2211] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 14 09:41:46 2022] POST /identity/v3/projects => generated 381 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:41:46.931827 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f129304b-2637-4463-9129-618f9eea3cb1 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:41:46.941669 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f129304b-2637-4463-9129-618f9eea3cb1 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:41:47.004091 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ea18c0-6bef-4421-95a4-f8685e664629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:41:47.005328 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ea18c0-6bef-4421-95a4-f8685e664629 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:41:47.005611 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ea18c0-6bef-4421-95a4-f8685e664629 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:41:47.005885 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ea18c0-6bef-4421-95a4-f8685e664629 admin admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:41:47.006617 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ea18c0-6bef-4421-95a4-f8685e664629 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:41:47.008632 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ea18c0-6bef-4421-95a4-f8685e664629 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:41:47.028460 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1113/2212] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 14 09:41:46 2022] POST /identity/v3/users => generated 291 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 09:41:47.033028 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d894399f-af74-4ac4-9a53-242d6a55ce7b admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:41:47.043343 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d894399f-af74-4ac4-9a53-242d6a55ce7b admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:41:47.048072 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85472cb-0a54-4fe8-8f30-f903dc3043f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:41:47.048724 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85472cb-0a54-4fe8-8f30-f903dc3043f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:41:47.049010 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85472cb-0a54-4fe8-8f30-f903dc3043f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:41:47.049286 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85472cb-0a54-4fe8-8f30-f903dc3043f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:41:47.050018 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85472cb-0a54-4fe8-8f30-f903dc3043f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:41:47.051655 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85472cb-0a54-4fe8-8f30-f903dc3043f6 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:41:47.062008 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1100/2213] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 09:41:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:41:47.065952 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ea18c0-6bef-4421-95a4-f8685e664629 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:41:47.076496 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ea18c0-6bef-4421-95a4-f8685e664629 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:41:47.081417 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bc4d8b-a60a-4d96-82e5-d91fdef22dd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:41:47.082071 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bc4d8b-a60a-4d96-82e5-d91fdef22dd9 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:41:47.082393 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bc4d8b-a60a-4d96-82e5-d91fdef22dd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:41:47.083297 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bc4d8b-a60a-4d96-82e5-d91fdef22dd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:41:47.084028 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bc4d8b-a60a-4d96-82e5-d91fdef22dd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:41:47.085606 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bc4d8b-a60a-4d96-82e5-d91fdef22dd9 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:41:47.095390 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1114/2214] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 09:41:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 09:41:47.099434 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85472cb-0a54-4fe8-8f30-f903dc3043f6 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:41:47.109473 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85472cb-0a54-4fe8-8f30-f903dc3043f6 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:41:47.114234 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f520f6-7e4e-42e5-8b98-415f98adc877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:41:47.115107 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f520f6-7e4e-42e5-8b98-415f98adc877 admin admin] REQUEST_METHOD: `PUT` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:41:47.115388 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f520f6-7e4e-42e5-8b98-415f98adc877 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:41:47.115664 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f520f6-7e4e-42e5-8b98-415f98adc877 admin admin] PATH_INFO: `/v3/projects/6bf7eec88bc64cd2be062020a72563de/users/08962a3ebb194189b2ab68e62fee6e60/roles/17dfac38a2e540fea229af7de99911bb` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:41:47.130694 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f520f6-7e4e-42e5-8b98-415f98adc877 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bf7eec88bc64cd2be062020a72563de, user_id=08962a3ebb194189b2ab68e62fee6e60, role_id=17dfac38a2e540fea229af7de99911bb)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:41:47.133349 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f520f6-7e4e-42e5-8b98-415f98adc877 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:41:47.146422 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1101/2215] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 14 09:41:47 2022] PUT /identity/v3/projects/6bf7eec88bc64cd2be062020a72563de/users/08962a3ebb194189b2ab68e62fee6e60/roles/17dfac38a2e540fea229af7de99911bb => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 09:41:47.151395 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbeacd1-8ab2-48e6-a9df-262f703e811d None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:41:47.151692 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbeacd1-8ab2-48e6-a9df-262f703e811d None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:41:47.152035 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbeacd1-8ab2-48e6-a9df-262f703e811d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:41:47.169265 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-4dbeacd1-8ab2-48e6-a9df-262f703e811d None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:41:47.170489 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-4dbeacd1-8ab2-48e6-a9df-262f703e811d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:41:47.178625 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:41:47.229463 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1115/2216] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:41:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:41:47.239475 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f520f6-7e4e-42e5-8b98-415f98adc877 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:41:47.241318 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-e6f520f6-7e4e-42e5-8b98-415f98adc877 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:41:47.296555 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f520f6-7e4e-42e5-8b98-415f98adc877 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:41:47.300126 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ed66e2-55a1-4b59-bdbc-6a76d5cc9f45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e4a5a8965e4802a9055d332179b7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:41:47.300767 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ed66e2-55a1-4b59-bdbc-6a76d5cc9f45 service neutron] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:41:47.301051 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ed66e2-55a1-4b59-bdbc-6a76d5cc9f45 service neutron] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:41:47.301844 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ed66e2-55a1-4b59-bdbc-6a76d5cc9f45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:41:47.310957 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ed66e2-55a1-4b59-bdbc-6a76d5cc9f45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:41:47.312383 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ed66e2-55a1-4b59-bdbc-6a76d5cc9f45 service neutron] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:41:47.322275 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1102/2217] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:41:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:41:47.943922 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1149e03-e952-42bd-85d2-431430c694a7 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:41:47.944216 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1149e03-e952-42bd-85d2-431430c694a7 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:41:47.944493 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1149e03-e952-42bd-85d2-431430c694a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:41:47.980876 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-d1149e03-e952-42bd-85d2-431430c694a7 None None] MFA Rules not processed for user `08962a3ebb194189b2ab68e62fee6e60`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:41:47.982096 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-d1149e03-e952-42bd-85d2-431430c694a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:41:48.051193 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1116/2218] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:41:47 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:41:48.062135 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ed66e2-55a1-4b59-bdbc-6a76d5cc9f45 service neutron] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:41:48.063678 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-44ed66e2-55a1-4b59-bdbc-6a76d5cc9f45 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:41:48.125400 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ed66e2-55a1-4b59-bdbc-6a76d5cc9f45 service neutron] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:41:48.129348 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83ba71a-c106-4339-98e6-edb0b3874a2a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25048b29787d482783ebc944f1a7df65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:41:48.130021 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83ba71a-c106-4339-98e6-edb0b3874a2a service cinder] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:41:48.130337 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83ba71a-c106-4339-98e6-edb0b3874a2a service cinder] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:41:48.130619 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83ba71a-c106-4339-98e6-edb0b3874a2a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:41:48.140025 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83ba71a-c106-4339-98e6-edb0b3874a2a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:41:48.141483 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83ba71a-c106-4339-98e6-edb0b3874a2a service cinder] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:41:48.152322 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1103/2219] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:41:48 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:41:49.556858 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b287fa-2e55-44aa-b31f-ccfe17a4656d None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:41:49.558304 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b287fa-2e55-44aa-b31f-ccfe17a4656d None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:41:49.558815 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b287fa-2e55-44aa-b31f-ccfe17a4656d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:41:49.559347 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fe413a-6562-4a39-a73d-4aff6f4411d1 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:41:49.559744 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fe413a-6562-4a39-a73d-4aff6f4411d1 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:41:49.560114 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fe413a-6562-4a39-a73d-4aff6f4411d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:41:49.576737 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-c8b287fa-2e55-44aa-b31f-ccfe17a4656d None None] MFA Rules not processed for user `08962a3ebb194189b2ab68e62fee6e60`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:41:49.577962 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-c8b287fa-2e55-44aa-b31f-ccfe17a4656d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:41:49.579351 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-e6fe413a-6562-4a39-a73d-4aff6f4411d1 None None] MFA Rules not processed for user `6cf35868f9ff46e2835a6cc023641da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:41:49.580967 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-e6fe413a-6562-4a39-a73d-4aff6f4411d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:41:49.585816 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1117/2220] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:41:49 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:41:49.593301 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:DELETE=4,keystone:SELECT=93,keystone:INSERT=3 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:41:49.654225 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1104/2221] 10.222.0.40 () {58 vars in 1009 bytes} [Thu Jul 14 09:41:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 09:41:49.667971 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b287fa-2e55-44aa-b31f-ccfe17a4656d None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:41:49.669440 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-c8b287fa-2e55-44aa-b31f-ccfe17a4656d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:41:49.753368 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b287fa-2e55-44aa-b31f-ccfe17a4656d None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:41:49.759265 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d95291-d985-45a1-ab6d-9aaa742eaacc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '302c0f7dd3bf4829aad0b29bd0c091a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:41:49.760050 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d95291-d985-45a1-ab6d-9aaa742eaacc service swift] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:41:49.760406 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d95291-d985-45a1-ab6d-9aaa742eaacc service swift] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:41:49.760754 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d95291-d985-45a1-ab6d-9aaa742eaacc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:41:49.770415 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d95291-d985-45a1-ab6d-9aaa742eaacc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:41:49.772095 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d95291-d985-45a1-ab6d-9aaa742eaacc service swift] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:41:49.780511 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1118/2222] 10.222.0.40 () {60 vars in 1384 bytes} [Thu Jul 14 09:41:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 09:41:59.644586 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=18 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:41:59.777155 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=88 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:42:07.437301 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c436ec-bade-4918-b05f-6cfbc9442045 None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:42:07.437883 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c436ec-bade-4918-b05f-6cfbc9442045 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:42:07.437883 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c436ec-bade-4918-b05f-6cfbc9442045 None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:42:07.439238 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1105/2223] 10.222.0.40 () {54 vars in 921 bytes} [Thu Jul 14 09:42:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:42:07.445852 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dd7e1b-ba37-4c8e-bf59-da632a2e49aa None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:42:07.446355 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dd7e1b-ba37-4c8e-bf59-da632a2e49aa None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:42:07.446451 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dd7e1b-ba37-4c8e-bf59-da632a2e49aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:42:07.466153 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-f0dd7e1b-ba37-4c8e-bf59-da632a2e49aa None None] MFA Rules not processed for user `1f6962106dfa4c4c9af551053f8095e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:42:07.467410 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-f0dd7e1b-ba37-4c8e-bf59-da632a2e49aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:42:07.549502 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1119/2224] 10.222.0.40 () {58 vars in 1018 bytes} [Thu Jul 14 09:42:07 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:42:07.564488 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c436ec-bade-4918-b05f-6cfbc9442045 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:42:07.566970 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-46c436ec-bade-4918-b05f-6cfbc9442045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:42:07.629192 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c436ec-bade-4918-b05f-6cfbc9442045 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:42:07.632785 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512bfebd-7e8a-4c3e-a6a7-7dde97c462b4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba461800d6845e6a767c83777ae5213', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:42:07.633467 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512bfebd-7e8a-4c3e-a6a7-7dde97c462b4 service glance] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:42:07.633750 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512bfebd-7e8a-4c3e-a6a7-7dde97c462b4 service glance] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:42:07.634028 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512bfebd-7e8a-4c3e-a6a7-7dde97c462b4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:42:07.645527 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512bfebd-7e8a-4c3e-a6a7-7dde97c462b4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:42:07.647034 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512bfebd-7e8a-4c3e-a6a7-7dde97c462b4 service glance] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:42:07.662613 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1106/2225] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:42:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 09:42:07.743123 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a740b70-a77a-4d6b-9320-d70a63f6ba55 None None] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:42:07.743666 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a740b70-a77a-4d6b-9320-d70a63f6ba55 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:42:07.744143 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a740b70-a77a-4d6b-9320-d70a63f6ba55 None None] PATH_INFO: `/` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:42:07.746466 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1120/2226] 10.222.0.40 () {54 vars in 921 bytes} [Thu Jul 14 09:42:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:42:07.751502 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a624624-e350-4f73-9635-0950db533d91 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:42:07.751909 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a624624-e350-4f73-9635-0950db533d91 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:42:07.752286 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a624624-e350-4f73-9635-0950db533d91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:42:07.775396 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-8a624624-e350-4f73-9635-0950db533d91 None None] MFA Rules not processed for user `65e4a5a8965e4802a9055d332179b7a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:42:07.776784 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-8a624624-e350-4f73-9635-0950db533d91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:42:07.783653 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1107/2227] 10.222.0.40 () {58 vars in 1018 bytes} [Thu Jul 14 09:42:07 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 09:42:07.796036 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a740b70-a77a-4d6b-9320-d70a63f6ba55 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:42:07.798014 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-9a740b70-a77a-4d6b-9320-d70a63f6ba55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:42:07.813421 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a740b70-a77a-4d6b-9320-d70a63f6ba55 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:42:07.817964 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f2c1da-2a4a-4b27-a9df-daff05c4a047 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e4a5a8965e4802a9055d332179b7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:42:07.818677 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f2c1da-2a4a-4b27-a9df-daff05c4a047 service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:42:07.818965 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f2c1da-2a4a-4b27-a9df-daff05c4a047 service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:42:07.819247 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f2c1da-2a4a-4b27-a9df-daff05c4a047 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:42:07.827256 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f2c1da-2a4a-4b27-a9df-daff05c4a047 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:42:07.829083 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f2c1da-2a4a-4b27-a9df-daff05c4a047 service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:42:07.839987 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1121/2228] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:42:07 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:42:07.925967 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4db433-44e1-4351-a648-99fa8233b96c None None] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:42:07.926260 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4db433-44e1-4351-a648-99fa8233b96c None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:42:07.926568 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4db433-44e1-4351-a648-99fa8233b96c None None] PATH_INFO: `/` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:42:07.928017 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1108/2229] 10.222.0.40 () {54 vars in 921 bytes} [Thu Jul 14 09:42:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 09:42:07.933297 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b126ef3d-ebfa-4e6e-a70c-8ba09367d42a None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:42:07.933592 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b126ef3d-ebfa-4e6e-a70c-8ba09367d42a None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:42:07.933897 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b126ef3d-ebfa-4e6e-a70c-8ba09367d42a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:42:07.951993 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-b126ef3d-ebfa-4e6e-a70c-8ba09367d42a None None] MFA Rules not processed for user `1f6962106dfa4c4c9af551053f8095e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:42:07.953193 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-b126ef3d-ebfa-4e6e-a70c-8ba09367d42a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:42:07.963102 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1122/2230] 10.222.0.40 () {58 vars in 1018 bytes} [Thu Jul 14 09:42:07 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:42:07.973989 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4db433-44e1-4351-a648-99fa8233b96c None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:42:07.984967 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4db433-44e1-4351-a648-99fa8233b96c None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:42:07.989405 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1553b4c4-95e3-4985-a315-ec7f10b0e909 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e4a5a8965e4802a9055d332179b7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:42:07.990040 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1553b4c4-95e3-4985-a315-ec7f10b0e909 service neutron] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:42:07.990356 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1553b4c4-95e3-4985-a315-ec7f10b0e909 service neutron] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:42:07.990636 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1553b4c4-95e3-4985-a315-ec7f10b0e909 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:42:08.002014 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1553b4c4-95e3-4985-a315-ec7f10b0e909 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:42:08.003519 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1553b4c4-95e3-4985-a315-ec7f10b0e909 service neutron] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:42:08.015015 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1109/2231] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:42:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:42:10.888091 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbd8a1c-5679-4762-a2c0-6dbacb4a7a30 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:42:10.888578 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbd8a1c-5679-4762-a2c0-6dbacb4a7a30 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:42:10.888724 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbd8a1c-5679-4762-a2c0-6dbacb4a7a30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:42:10.907452 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-ccbd8a1c-5679-4762-a2c0-6dbacb4a7a30 None None] MFA Rules not processed for user `6cf35868f9ff46e2835a6cc023641da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:42:10.908649 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-ccbd8a1c-5679-4762-a2c0-6dbacb4a7a30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:42:10.916426 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1123/2232] 10.222.0.40 () {58 vars in 1009 bytes} [Thu Jul 14 09:42:10 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:42:10.929317 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1553b4c4-95e3-4985-a315-ec7f10b0e909 service neutron] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:42:10.940610 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1553b4c4-95e3-4985-a315-ec7f10b0e909 service neutron] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:42:10.945589 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5485fa-1bdb-4bfb-9366-9b12677d263a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '302c0f7dd3bf4829aad0b29bd0c091a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:42:10.946370 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5485fa-1bdb-4bfb-9366-9b12677d263a service swift] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:42:10.946569 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5485fa-1bdb-4bfb-9366-9b12677d263a service swift] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:42:10.946847 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5485fa-1bdb-4bfb-9366-9b12677d263a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:42:10.955258 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5485fa-1bdb-4bfb-9366-9b12677d263a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:42:10.956831 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5485fa-1bdb-4bfb-9366-9b12677d263a service swift] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:42:10.964870 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1110/2233] 10.222.0.40 () {60 vars in 1384 bytes} [Thu Jul 14 09:42:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 09:42:20.901532 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=43 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:42:20.961592 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=41 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:42:45.779040 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbd8a1c-5679-4762-a2c0-6dbacb4a7a30 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:42:45.788232 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbd8a1c-5679-4762-a2c0-6dbacb4a7a30 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:42:45.791868 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea03adea-0079-4a46-bab6-f9cdfdc1f584 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e4a5a8965e4802a9055d332179b7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:42:45.792510 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea03adea-0079-4a46-bab6-f9cdfdc1f584 service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:42:45.792816 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea03adea-0079-4a46-bab6-f9cdfdc1f584 service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:42:45.793077 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea03adea-0079-4a46-bab6-f9cdfdc1f584 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:42:45.794840 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-ea03adea-0079-4a46-bab6-f9cdfdc1f584 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:42:45.808523 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea03adea-0079-4a46-bab6-f9cdfdc1f584 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:42:45.809962 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea03adea-0079-4a46-bab6-f9cdfdc1f584 service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:42:45.822337 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1124/2234] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:42:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:42:47.930398 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5485fa-1bdb-4bfb-9366-9b12677d263a service swift] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:42:47.939634 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5485fa-1bdb-4bfb-9366-9b12677d263a service swift] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:42:47.943260 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2efdaad-86d9-41a1-be0a-1af61d9144a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e4a5a8965e4802a9055d332179b7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:42:47.943895 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2efdaad-86d9-41a1-be0a-1af61d9144a3 service neutron] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:42:47.944179 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2efdaad-86d9-41a1-be0a-1af61d9144a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:42:47.944457 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2efdaad-86d9-41a1-be0a-1af61d9144a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:42:47.946237 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-a2efdaad-86d9-41a1-be0a-1af61d9144a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:42:47.959500 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2efdaad-86d9-41a1-be0a-1af61d9144a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:42:47.960912 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2efdaad-86d9-41a1-be0a-1af61d9144a3 service neutron] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:42:47.972139 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1111/2235] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:42:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:42:55.816429 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=6 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:42:57.967417 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=6 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:42:57.999242 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e529dfd-0435-403d-ac44-10ca58708c04 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:42:57.999691 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e529dfd-0435-403d-ac44-10ca58708c04 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:42:57.999796 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e529dfd-0435-403d-ac44-10ca58708c04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:42:58.017159 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-7e529dfd-0435-403d-ac44-10ca58708c04 None None] MFA Rules not processed for user `6cf35868f9ff46e2835a6cc023641da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:42:58.018373 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-7e529dfd-0435-403d-ac44-10ca58708c04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:42:58.025550 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1125/2236] 10.222.0.40 () {58 vars in 967 bytes} [Thu Jul 14 09:42:57 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 09:42:58.038855 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2efdaad-86d9-41a1-be0a-1af61d9144a3 service neutron] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:42:58.051568 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2efdaad-86d9-41a1-be0a-1af61d9144a3 service neutron] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:42:58.058295 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919f83ed-0688-45e6-a5ef-e188d4ad47ac service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '302c0f7dd3bf4829aad0b29bd0c091a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:42:58.058994 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919f83ed-0688-45e6-a5ef-e188d4ad47ac service swift] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:42:58.059279 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919f83ed-0688-45e6-a5ef-e188d4ad47ac service swift] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:42:58.059636 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919f83ed-0688-45e6-a5ef-e188d4ad47ac service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:42:58.069054 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919f83ed-0688-45e6-a5ef-e188d4ad47ac service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:42:58.070869 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919f83ed-0688-45e6-a5ef-e188d4ad47ac service swift] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:42:58.081009 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1112/2237] 10.222.0.40 () {60 vars in 1384 bytes} [Thu Jul 14 09:42:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 14 09:43:08.012163 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=3 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:43:08.077106 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=6 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:43:22.240482 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e529dfd-0435-403d-ac44-10ca58708c04 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:43:22.241998 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-7e529dfd-0435-403d-ac44-10ca58708c04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:43:22.257269 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e529dfd-0435-403d-ac44-10ca58708c04 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:43:22.263175 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4aca65-1a8c-4afc-9a22-5b12aac8c687 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f6962106dfa4c4c9af551053f8095e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:43:22.263810 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4aca65-1a8c-4afc-9a22-5b12aac8c687 service nova] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:43:22.264093 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4aca65-1a8c-4afc-9a22-5b12aac8c687 service nova] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:43:22.264370 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4aca65-1a8c-4afc-9a22-5b12aac8c687 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:43:22.266038 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-9d4aca65-1a8c-4afc-9a22-5b12aac8c687 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:43:22.324677 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4aca65-1a8c-4afc-9a22-5b12aac8c687 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:43:22.326295 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4aca65-1a8c-4afc-9a22-5b12aac8c687 service nova] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:43:22.335711 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1126/2238] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:43:22 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:43:32.331612 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=28 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:43:44.941651 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d98136-cec1-47cb-a9aa-2dc2270e13e8 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:43:44.942134 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d98136-cec1-47cb-a9aa-2dc2270e13e8 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:43:44.942134 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d98136-cec1-47cb-a9aa-2dc2270e13e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:43:44.960503 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-a0d98136-cec1-47cb-a9aa-2dc2270e13e8 None None] MFA Rules not processed for user `1d7ae3d2f56a491baf26a83a34d86ccf`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 09:43:44.962271 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-a0d98136-cec1-47cb-a9aa-2dc2270e13e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:43:45.020848 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1113/2239] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 09:43:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 09:43:45.324599 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4aca65-1a8c-4afc-9a22-5b12aac8c687 service nova] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:43:45.334042 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4aca65-1a8c-4afc-9a22-5b12aac8c687 service nova] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:43:45.337757 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52acea78-cbf5-4dcc-b67a-5d1d434eba16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e4a5a8965e4802a9055d332179b7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:43:45.338440 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52acea78-cbf5-4dcc-b67a-5d1d434eba16 service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:43:45.338751 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52acea78-cbf5-4dcc-b67a-5d1d434eba16 service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:43:45.339029 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52acea78-cbf5-4dcc-b67a-5d1d434eba16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:43:45.340766 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-52acea78-cbf5-4dcc-b67a-5d1d434eba16 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:43:45.349952 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52acea78-cbf5-4dcc-b67a-5d1d434eba16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:43:45.351404 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52acea78-cbf5-4dcc-b67a-5d1d434eba16 service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:43:45.359086 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1127/2240] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:43:45 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:43:45.481373 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d98136-cec1-47cb-a9aa-2dc2270e13e8 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:43:45.482839 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-a0d98136-cec1-47cb-a9aa-2dc2270e13e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:43:45.501542 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d98136-cec1-47cb-a9aa-2dc2270e13e8 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:43:45.507039 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce50c222-8891-44d4-816c-7a520adee85a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f6962106dfa4c4c9af551053f8095e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:43:45.507696 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce50c222-8891-44d4-816c-7a520adee85a service nova] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:43:45.508044 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce50c222-8891-44d4-816c-7a520adee85a service nova] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:43:45.508333 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce50c222-8891-44d4-816c-7a520adee85a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:43:45.510126 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-ce50c222-8891-44d4-816c-7a520adee85a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:43:45.573355 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce50c222-8891-44d4-816c-7a520adee85a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:43:45.574987 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce50c222-8891-44d4-816c-7a520adee85a service nova] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:43:45.584564 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1114/2241] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:43:45 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:43:45.682710 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52acea78-cbf5-4dcc-b67a-5d1d434eba16 service neutron] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:43:45.684638 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-52acea78-cbf5-4dcc-b67a-5d1d434eba16 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:43:45.759636 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52acea78-cbf5-4dcc-b67a-5d1d434eba16 service neutron] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:43:45.764559 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d738fef-fa37-40a0-929c-8d807d51e4d6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc5a80144b84c609944a51a84fd5e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:43:45.765201 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d738fef-fa37-40a0-929c-8d807d51e4d6 service placement] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:43:45.765484 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d738fef-fa37-40a0-929c-8d807d51e4d6 service placement] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:43:45.765762 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d738fef-fa37-40a0-929c-8d807d51e4d6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:43:45.767551 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-0d738fef-fa37-40a0-929c-8d807d51e4d6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:43:45.778884 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d738fef-fa37-40a0-929c-8d807d51e4d6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:43:45.780447 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d738fef-fa37-40a0-929c-8d807d51e4d6 service placement] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:43:45.790954 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1128/2242] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:43:45 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:43:47.717976 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce50c222-8891-44d4-816c-7a520adee85a service nova] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:43:47.728587 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce50c222-8891-44d4-816c-7a520adee85a service nova] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:43:47.732456 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8303fb-0781-4c7e-a80d-6fed3fac58f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e4a5a8965e4802a9055d332179b7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:43:47.733116 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8303fb-0781-4c7e-a80d-6fed3fac58f9 service neutron] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:43:47.733424 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8303fb-0781-4c7e-a80d-6fed3fac58f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:43:47.733699 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8303fb-0781-4c7e-a80d-6fed3fac58f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:43:47.735539 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-cd8303fb-0781-4c7e-a80d-6fed3fac58f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:43:47.745971 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8303fb-0781-4c7e-a80d-6fed3fac58f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:43:47.747590 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8303fb-0781-4c7e-a80d-6fed3fac58f9 service neutron] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:43:47.756812 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1115/2243] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:43:47 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:43:48.451282 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d738fef-fa37-40a0-929c-8d807d51e4d6 service placement] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:43:48.466397 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d738fef-fa37-40a0-929c-8d807d51e4d6 service placement] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:43:48.474456 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef3fe30-1006-4883-89b1-c806652f361b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f6962106dfa4c4c9af551053f8095e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:43:48.475472 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef3fe30-1006-4883-89b1-c806652f361b service nova] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:43:48.476205 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef3fe30-1006-4883-89b1-c806652f361b service nova] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:43:48.476605 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef3fe30-1006-4883-89b1-c806652f361b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:43:48.479137 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-9ef3fe30-1006-4883-89b1-c806652f361b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:43:48.495509 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef3fe30-1006-4883-89b1-c806652f361b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:43:48.497195 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef3fe30-1006-4883-89b1-c806652f361b service nova] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:43:48.509209 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1129/2244] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:43:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:43:55.612576 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8303fb-0781-4c7e-a80d-6fed3fac58f9 service neutron] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:43:55.629020 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8303fb-0781-4c7e-a80d-6fed3fac58f9 service neutron] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:43:55.635275 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a030f53-c277-4f8d-bf33-77d357cb7748 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f6962106dfa4c4c9af551053f8095e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:43:55.635937 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a030f53-c277-4f8d-bf33-77d357cb7748 service nova] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:43:55.636230 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a030f53-c277-4f8d-bf33-77d357cb7748 service nova] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:43:55.636515 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a030f53-c277-4f8d-bf33-77d357cb7748 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:43:55.638413 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-7a030f53-c277-4f8d-bf33-77d357cb7748 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:43:55.651065 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a030f53-c277-4f8d-bf33-77d357cb7748 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:43:55.652640 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a030f53-c277-4f8d-bf33-77d357cb7748 service nova] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:43:55.663491 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1116/2245] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:43:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:43:58.504224 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=44 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:44:05.659056 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=65 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:44:29.609021 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef3fe30-1006-4883-89b1-c806652f361b service nova] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:44:29.620652 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef3fe30-1006-4883-89b1-c806652f361b service nova] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:44:29.626144 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f628cbd4-5539-4981-aaf8-460a8cfef805 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f6962106dfa4c4c9af551053f8095e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:44:29.626805 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f628cbd4-5539-4981-aaf8-460a8cfef805 service nova] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:44:29.627091 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f628cbd4-5539-4981-aaf8-460a8cfef805 service nova] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:44:29.627371 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f628cbd4-5539-4981-aaf8-460a8cfef805 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:44:29.629115 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-f628cbd4-5539-4981-aaf8-460a8cfef805 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:44:29.686711 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f628cbd4-5539-4981-aaf8-460a8cfef805 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:44:29.688289 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f628cbd4-5539-4981-aaf8-460a8cfef805 service nova] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:44:29.697241 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1130/2246] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:44:29 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:44:35.718707 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a030f53-c277-4f8d-bf33-77d357cb7748 service nova] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:44:35.729685 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a030f53-c277-4f8d-bf33-77d357cb7748 service nova] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:44:35.735371 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561f4bdf-10c1-4f5a-ac0d-d8f38a3a5a0c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f6962106dfa4c4c9af551053f8095e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:44:35.736016 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561f4bdf-10c1-4f5a-ac0d-d8f38a3a5a0c service nova] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:44:35.736329 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561f4bdf-10c1-4f5a-ac0d-d8f38a3a5a0c service nova] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:44:35.736606 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561f4bdf-10c1-4f5a-ac0d-d8f38a3a5a0c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:44:35.738396 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-561f4bdf-10c1-4f5a-ac0d-d8f38a3a5a0c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:44:35.796487 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561f4bdf-10c1-4f5a-ac0d-d8f38a3a5a0c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:44:35.798090 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561f4bdf-10c1-4f5a-ac0d-d8f38a3a5a0c service nova] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:44:35.807039 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1117/2247] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:44:35 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:44:39.693023 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=28 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:44:45.802941 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=28 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:45:27.358435 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f628cbd4-5539-4981-aaf8-460a8cfef805 service nova] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:45:27.369643 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f628cbd4-5539-4981-aaf8-460a8cfef805 service nova] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:45:27.376024 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069ccca8-f41e-4ee5-949e-f54b875ae63b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f6962106dfa4c4c9af551053f8095e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:45:27.376673 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069ccca8-f41e-4ee5-949e-f54b875ae63b service nova] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:45:27.376961 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069ccca8-f41e-4ee5-949e-f54b875ae63b service nova] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:45:27.377273 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069ccca8-f41e-4ee5-949e-f54b875ae63b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:45:27.379054 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-069ccca8-f41e-4ee5-949e-f54b875ae63b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:45:27.438962 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069ccca8-f41e-4ee5-949e-f54b875ae63b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:45:27.440533 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069ccca8-f41e-4ee5-949e-f54b875ae63b service nova] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:45:27.449824 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1131/2248] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:45:27 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:45:31.798169 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561f4bdf-10c1-4f5a-ac0d-d8f38a3a5a0c service nova] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:45:31.810268 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561f4bdf-10c1-4f5a-ac0d-d8f38a3a5a0c service nova] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:45:31.815738 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868768fc-3d11-4a50-9e32-e5c8cdb6df82 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f6962106dfa4c4c9af551053f8095e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:45:31.816385 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868768fc-3d11-4a50-9e32-e5c8cdb6df82 service nova] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:45:31.816670 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868768fc-3d11-4a50-9e32-e5c8cdb6df82 service nova] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:45:31.816946 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868768fc-3d11-4a50-9e32-e5c8cdb6df82 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:45:31.818818 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-868768fc-3d11-4a50-9e32-e5c8cdb6df82 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:45:31.830082 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868768fc-3d11-4a50-9e32-e5c8cdb6df82 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:45:31.831688 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868768fc-3d11-4a50-9e32-e5c8cdb6df82 service nova] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:45:31.841194 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1118/2249] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:45:31 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:45:37.445359 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=28 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:45:41.836559 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=6 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:45:47.025985 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069ccca8-f41e-4ee5-949e-f54b875ae63b service nova] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:45:47.113045 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069ccca8-f41e-4ee5-949e-f54b875ae63b service nova] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:45:47.120891 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a5d983-e7e5-4115-a7e7-0559bbeac0ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f6962106dfa4c4c9af551053f8095e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:45:47.122645 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a5d983-e7e5-4115-a7e7-0559bbeac0ac service nova] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:45:47.122645 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a5d983-e7e5-4115-a7e7-0559bbeac0ac service nova] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:45:47.122863 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a5d983-e7e5-4115-a7e7-0559bbeac0ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:45:47.124666 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-d8a5d983-e7e5-4115-a7e7-0559bbeac0ac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:45:47.164387 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a5d983-e7e5-4115-a7e7-0559bbeac0ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:45:47.166232 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a5d983-e7e5-4115-a7e7-0559bbeac0ac service nova] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:45:47.177297 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1132/2250] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:45:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:45:57.172988 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=39 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:46:55.093639 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868768fc-3d11-4a50-9e32-e5c8cdb6df82 service nova] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:46:55.145644 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868768fc-3d11-4a50-9e32-e5c8cdb6df82 service nova] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:46:55.150650 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3759292e-892b-4313-b96f-ca97b1b65dcc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc5a80144b84c609944a51a84fd5e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:46:55.151298 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3759292e-892b-4313-b96f-ca97b1b65dcc service placement] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:46:55.151583 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3759292e-892b-4313-b96f-ca97b1b65dcc service placement] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:46:55.151862 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3759292e-892b-4313-b96f-ca97b1b65dcc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:46:55.153642 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-3759292e-892b-4313-b96f-ca97b1b65dcc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:46:55.177203 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3759292e-892b-4313-b96f-ca97b1b65dcc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:46:55.178821 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3759292e-892b-4313-b96f-ca97b1b65dcc service placement] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:46:55.188979 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1119/2251] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:46:55 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:47:05.185382 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=29 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:47:45.496189 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a5d983-e7e5-4115-a7e7-0559bbeac0ac service nova] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:47:45.497617 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-d8a5d983-e7e5-4115-a7e7-0559bbeac0ac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:47:45.530653 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a5d983-e7e5-4115-a7e7-0559bbeac0ac service nova] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:47:45.534333 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400adc82-92f4-4d83-bcf8-a38f0b9c4d36 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25048b29787d482783ebc944f1a7df65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:47:45.534982 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400adc82-92f4-4d83-bcf8-a38f0b9c4d36 service cinder] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:47:45.535268 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400adc82-92f4-4d83-bcf8-a38f0b9c4d36 service cinder] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:47:45.535549 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400adc82-92f4-4d83-bcf8-a38f0b9c4d36 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:47:45.546593 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400adc82-92f4-4d83-bcf8-a38f0b9c4d36 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:47:45.548029 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400adc82-92f4-4d83-bcf8-a38f0b9c4d36 service cinder] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:47:45.559897 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1133/2252] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:47:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 09:47:45.682760 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3759292e-892b-4313-b96f-ca97b1b65dcc service placement] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:47:45.692555 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3759292e-892b-4313-b96f-ca97b1b65dcc service placement] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:47:45.696112 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef75de82-b7ff-4233-b987-b23802e6bcfb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25048b29787d482783ebc944f1a7df65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:47:45.696753 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef75de82-b7ff-4233-b987-b23802e6bcfb service cinder] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:47:45.697040 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef75de82-b7ff-4233-b987-b23802e6bcfb service cinder] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:47:45.697324 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef75de82-b7ff-4233-b987-b23802e6bcfb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:47:45.705948 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef75de82-b7ff-4233-b987-b23802e6bcfb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:47:45.707419 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef75de82-b7ff-4233-b987-b23802e6bcfb service cinder] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:47:45.716147 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1120/2253] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:47:45 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:47:55.554158 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=15 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:47:55.712155 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=6 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:48:40.102254 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400adc82-92f4-4d83-bcf8-a38f0b9c4d36 service cinder] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:48:40.112072 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400adc82-92f4-4d83-bcf8-a38f0b9c4d36 service cinder] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:48:40.115775 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed962d5-85f5-41bc-96d7-896b73f1f62c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25048b29787d482783ebc944f1a7df65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:48:40.116423 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed962d5-85f5-41bc-96d7-896b73f1f62c service cinder] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:48:40.116712 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed962d5-85f5-41bc-96d7-896b73f1f62c service cinder] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:48:40.116983 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed962d5-85f5-41bc-96d7-896b73f1f62c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:48:40.131257 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed962d5-85f5-41bc-96d7-896b73f1f62c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:48:40.132985 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed962d5-85f5-41bc-96d7-896b73f1f62c service cinder] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:48:40.146111 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1134/2254] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:48:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:48:40.263757 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef75de82-b7ff-4233-b987-b23802e6bcfb service cinder] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:48:40.273433 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef75de82-b7ff-4233-b987-b23802e6bcfb service cinder] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:48:40.277561 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f549940b-8782-450c-8a1a-88648ebd25fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25048b29787d482783ebc944f1a7df65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:48:40.278079 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f549940b-8782-450c-8a1a-88648ebd25fb service cinder] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:48:40.278441 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f549940b-8782-450c-8a1a-88648ebd25fb service cinder] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:48:40.278725 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f549940b-8782-450c-8a1a-88648ebd25fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:48:40.288005 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f549940b-8782-450c-8a1a-88648ebd25fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:48:40.289430 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f549940b-8782-450c-8a1a-88648ebd25fb service cinder] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:48:40.326174 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1121/2255] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:48:40 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:48:50.140382 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=6 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:48:50.323230 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=13 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:48:57.506907 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed962d5-85f5-41bc-96d7-896b73f1f62c service cinder] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:48:57.526299 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed962d5-85f5-41bc-96d7-896b73f1f62c service cinder] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:48:57.529979 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596b10a4-ff8b-499a-a61f-8874b884c0b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e4a5a8965e4802a9055d332179b7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:48:57.530668 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596b10a4-ff8b-499a-a61f-8874b884c0b0 service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:48:57.530961 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596b10a4-ff8b-499a-a61f-8874b884c0b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:48:57.531243 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596b10a4-ff8b-499a-a61f-8874b884c0b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:48:57.539528 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596b10a4-ff8b-499a-a61f-8874b884c0b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:48:57.540960 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596b10a4-ff8b-499a-a61f-8874b884c0b0 service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:48:57.548847 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1135/2256] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:48:57 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:49:07.545297 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=10 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:49:29.655508 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f549940b-8782-450c-8a1a-88648ebd25fb service cinder] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:49:29.667766 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f549940b-8782-450c-8a1a-88648ebd25fb service cinder] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:49:29.673349 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead12ce7-f454-44ae-a985-b50c6040ae62 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f6962106dfa4c4c9af551053f8095e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:49:29.673998 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead12ce7-f454-44ae-a985-b50c6040ae62 service nova] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:49:29.674312 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead12ce7-f454-44ae-a985-b50c6040ae62 service nova] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:49:29.674588 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead12ce7-f454-44ae-a985-b50c6040ae62 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:49:29.682615 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead12ce7-f454-44ae-a985-b50c6040ae62 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:49:29.684298 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead12ce7-f454-44ae-a985-b50c6040ae62 service nova] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:49:29.711962 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1122/2257] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:49:29 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:49:35.452735 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596b10a4-ff8b-499a-a61f-8874b884c0b0 service neutron] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:49:35.465678 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596b10a4-ff8b-499a-a61f-8874b884c0b0 service neutron] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:49:35.471400 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2728352b-02d0-4695-8aae-0836e70a8a70 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f6962106dfa4c4c9af551053f8095e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:49:35.472041 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2728352b-02d0-4695-8aae-0836e70a8a70 service nova] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:49:35.472331 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2728352b-02d0-4695-8aae-0836e70a8a70 service nova] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:49:35.472614 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2728352b-02d0-4695-8aae-0836e70a8a70 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:49:35.480422 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2728352b-02d0-4695-8aae-0836e70a8a70 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:49:35.482029 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2728352b-02d0-4695-8aae-0836e70a8a70 service nova] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:49:35.509070 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1136/2258] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:49:35 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:49:39.709341 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=13 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:49:45.506472 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=13 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:49:45.948106 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead12ce7-f454-44ae-a985-b50c6040ae62 service nova] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:49:45.957796 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead12ce7-f454-44ae-a985-b50c6040ae62 service nova] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:49:45.961392 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274717d1-b640-42c5-ba18-41cae9ab5b8c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25048b29787d482783ebc944f1a7df65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:49:45.962037 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274717d1-b640-42c5-ba18-41cae9ab5b8c service cinder] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:49:45.962370 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274717d1-b640-42c5-ba18-41cae9ab5b8c service cinder] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:49:45.962651 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274717d1-b640-42c5-ba18-41cae9ab5b8c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:49:45.971304 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274717d1-b640-42c5-ba18-41cae9ab5b8c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:49:45.972728 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274717d1-b640-42c5-ba18-41cae9ab5b8c service cinder] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:49:45.999357 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1123/2259] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:49:45 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:49:55.996232 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=13 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:50:40.396933 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2728352b-02d0-4695-8aae-0836e70a8a70 service nova] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:50:40.407041 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2728352b-02d0-4695-8aae-0836e70a8a70 service nova] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:50:40.410637 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1045f347-1e59-4c80-a696-30475293668a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25048b29787d482783ebc944f1a7df65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:50:40.411276 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1045f347-1e59-4c80-a696-30475293668a service cinder] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:50:40.411558 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1045f347-1e59-4c80-a696-30475293668a service cinder] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:50:40.411832 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1045f347-1e59-4c80-a696-30475293668a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:50:40.420273 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1045f347-1e59-4c80-a696-30475293668a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:50:40.421714 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1045f347-1e59-4c80-a696-30475293668a service cinder] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:50:40.448257 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1137/2260] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:50:40 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:50:40.548532 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274717d1-b640-42c5-ba18-41cae9ab5b8c service cinder] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:50:40.561550 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274717d1-b640-42c5-ba18-41cae9ab5b8c service cinder] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:50:40.567661 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14035264-cbe8-4e20-9969-84c6e0c94004 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f6962106dfa4c4c9af551053f8095e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:50:40.568372 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14035264-cbe8-4e20-9969-84c6e0c94004 service nova] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:50:40.568590 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14035264-cbe8-4e20-9969-84c6e0c94004 service nova] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:50:40.568893 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14035264-cbe8-4e20-9969-84c6e0c94004 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:50:40.577132 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14035264-cbe8-4e20-9969-84c6e0c94004 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:50:40.579384 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14035264-cbe8-4e20-9969-84c6e0c94004 service nova] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:50:40.611075 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1124/2261] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:50:40 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:50:50.445645 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=13 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:50:50.607213 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=13 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:51:59.111915 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1045f347-1e59-4c80-a696-30475293668a service cinder] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:51:59.123229 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1045f347-1e59-4c80-a696-30475293668a service cinder] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:51:59.128788 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468d113f-96d9-4125-8bfd-118287e8c24f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc5a80144b84c609944a51a84fd5e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:51:59.129433 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468d113f-96d9-4125-8bfd-118287e8c24f service placement] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:51:59.129718 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468d113f-96d9-4125-8bfd-118287e8c24f service placement] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:51:59.129996 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468d113f-96d9-4125-8bfd-118287e8c24f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:51:59.138389 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468d113f-96d9-4125-8bfd-118287e8c24f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:51:59.139976 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468d113f-96d9-4125-8bfd-118287e8c24f service placement] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:51:59.149694 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1138/2262] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:51:59 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:52:09.145598 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=6 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:52:40.875716 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14035264-cbe8-4e20-9969-84c6e0c94004 service nova] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:52:40.963093 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14035264-cbe8-4e20-9969-84c6e0c94004 service nova] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:52:40.969405 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac5e2b1-15c9-41f7-b4fb-6d1b2afe4f9a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f6962106dfa4c4c9af551053f8095e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:52:40.970053 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac5e2b1-15c9-41f7-b4fb-6d1b2afe4f9a service nova] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:52:40.970370 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac5e2b1-15c9-41f7-b4fb-6d1b2afe4f9a service nova] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:52:40.970650 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac5e2b1-15c9-41f7-b4fb-6d1b2afe4f9a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:52:40.979353 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac5e2b1-15c9-41f7-b4fb-6d1b2afe4f9a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:52:40.980944 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac5e2b1-15c9-41f7-b4fb-6d1b2afe4f9a service nova] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:52:40.991130 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1125/2263] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:52:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 09:52:50.986922 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=34 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:53:46.418561 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468d113f-96d9-4125-8bfd-118287e8c24f service placement] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:53:46.473678 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468d113f-96d9-4125-8bfd-118287e8c24f service placement] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:53:46.477464 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386d8ca3-b442-47ce-aafe-d491816890ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25048b29787d482783ebc944f1a7df65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:53:46.478114 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386d8ca3-b442-47ce-aafe-d491816890ca service cinder] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:53:46.478434 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386d8ca3-b442-47ce-aafe-d491816890ca service cinder] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:53:46.478716 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386d8ca3-b442-47ce-aafe-d491816890ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:53:46.481243 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-386d8ca3-b442-47ce-aafe-d491816890ca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:53:46.494347 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386d8ca3-b442-47ce-aafe-d491816890ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:53:46.495773 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386d8ca3-b442-47ce-aafe-d491816890ca service cinder] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:53:46.506507 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1139/2264] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:53:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:53:46.513912 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac5e2b1-15c9-41f7-b4fb-6d1b2afe4f9a service nova] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:53:46.522983 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac5e2b1-15c9-41f7-b4fb-6d1b2afe4f9a service nova] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:53:46.527107 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663a9a24-5655-4610-ad0b-b5ccde284057 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25048b29787d482783ebc944f1a7df65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:53:46.527755 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663a9a24-5655-4610-ad0b-b5ccde284057 service cinder] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:53:46.528046 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663a9a24-5655-4610-ad0b-b5ccde284057 service cinder] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:53:46.528327 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663a9a24-5655-4610-ad0b-b5ccde284057 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:53:46.530392 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-663a9a24-5655-4610-ad0b-b5ccde284057 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:53:46.610405 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663a9a24-5655-4610-ad0b-b5ccde284057 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:53:46.611847 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663a9a24-5655-4610-ad0b-b5ccde284057 service cinder] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:53:46.630298 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1126/2265] 10.222.0.40 () {60 vars in 1396 bytes} [Thu Jul 14 09:53:46 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3248 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 09:53:46.679077 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386d8ca3-b442-47ce-aafe-d491816890ca service cinder] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:53:46.687991 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386d8ca3-b442-47ce-aafe-d491816890ca service cinder] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:53:46.691663 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a369e7d0-4ca0-497a-80c0-ae5d852913d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25048b29787d482783ebc944f1a7df65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:53:46.692308 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a369e7d0-4ca0-497a-80c0-ae5d852913d4 service cinder] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:53:46.692595 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a369e7d0-4ca0-497a-80c0-ae5d852913d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:53:46.692877 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a369e7d0-4ca0-497a-80c0-ae5d852913d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:53:46.694791 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-a369e7d0-4ca0-497a-80c0-ae5d852913d4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:53:46.708243 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a369e7d0-4ca0-497a-80c0-ae5d852913d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:53:46.709659 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a369e7d0-4ca0-497a-80c0-ae5d852913d4 service cinder] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:53:46.720455 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1140/2266] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:53:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:53:56.627516 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=41 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:53:56.716138 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=32 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:54:03.750719 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663a9a24-5655-4610-ad0b-b5ccde284057 service cinder] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:54:03.752420 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-663a9a24-5655-4610-ad0b-b5ccde284057 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:54:03.819269 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663a9a24-5655-4610-ad0b-b5ccde284057 service cinder] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:54:03.822816 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80960dfb-2f3f-4a63-bc0a-d0426dbb6d34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e4a5a8965e4802a9055d332179b7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:54:03.823521 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80960dfb-2f3f-4a63-bc0a-d0426dbb6d34 service neutron] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:54:03.823810 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80960dfb-2f3f-4a63-bc0a-d0426dbb6d34 service neutron] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:54:03.824088 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80960dfb-2f3f-4a63-bc0a-d0426dbb6d34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:54:03.826516 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-80960dfb-2f3f-4a63-bc0a-d0426dbb6d34 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:54:03.835757 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80960dfb-2f3f-4a63-bc0a-d0426dbb6d34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:54:03.837180 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80960dfb-2f3f-4a63-bc0a-d0426dbb6d34 service neutron] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:54:03.848238 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1127/2267] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:54:03 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 09:54:13.843219 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=31 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:54:40.949798 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a369e7d0-4ca0-497a-80c0-ae5d852913d4 service cinder] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:54:40.949798 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-a369e7d0-4ca0-497a-80c0-ae5d852913d4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:54:40.955517 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80960dfb-2f3f-4a63-bc0a-d0426dbb6d34 service neutron] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:54:40.958163 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-80960dfb-2f3f-4a63-bc0a-d0426dbb6d34 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:54:40.959691 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a369e7d0-4ca0-497a-80c0-ae5d852913d4 service cinder] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:54:40.963432 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d50873-4d73-4d66-9df2-d8f9b0852c89 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25048b29787d482783ebc944f1a7df65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:54:40.964092 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d50873-4d73-4d66-9df2-d8f9b0852c89 service cinder] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:54:40.964524 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d50873-4d73-4d66-9df2-d8f9b0852c89 service cinder] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:54:40.964660 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d50873-4d73-4d66-9df2-d8f9b0852c89 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:54:40.967073 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-c4d50873-4d73-4d66-9df2-d8f9b0852c89 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:54:40.975920 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80960dfb-2f3f-4a63-bc0a-d0426dbb6d34 service neutron] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:54:40.982688 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700e718e-0888-46d3-b110-63599c9ece4e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f6962106dfa4c4c9af551053f8095e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:54:40.983420 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700e718e-0888-46d3-b110-63599c9ece4e service nova] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:54:40.983778 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700e718e-0888-46d3-b110-63599c9ece4e service nova] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:54:40.984127 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700e718e-0888-46d3-b110-63599c9ece4e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:54:40.986110 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-700e718e-0888-46d3-b110-63599c9ece4e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:54:41.048904 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d50873-4d73-4d66-9df2-d8f9b0852c89 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:54:41.050394 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d50873-4d73-4d66-9df2-d8f9b0852c89 service cinder] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:54:41.064627 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1141/2268] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:54:40 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:54:41.067256 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700e718e-0888-46d3-b110-63599c9ece4e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:54:41.069094 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700e718e-0888-46d3-b110-63599c9ece4e service nova] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:54:41.079429 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d50873-4d73-4d66-9df2-d8f9b0852c89 service cinder] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:54:41.080716 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1128/2269] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:54:40 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:54:41.082800 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-c4d50873-4d73-4d66-9df2-d8f9b0852c89 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:54:41.100339 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d50873-4d73-4d66-9df2-d8f9b0852c89 service cinder] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:54:41.107711 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524e99e9-890a-463f-bfa9-aa14ddbbd266 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f6962106dfa4c4c9af551053f8095e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:54:41.110293 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524e99e9-890a-463f-bfa9-aa14ddbbd266 service nova] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:54:41.110293 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524e99e9-890a-463f-bfa9-aa14ddbbd266 service nova] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:54:41.110293 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524e99e9-890a-463f-bfa9-aa14ddbbd266 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:54:41.119773 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-524e99e9-890a-463f-bfa9-aa14ddbbd266 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:54:41.204909 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524e99e9-890a-463f-bfa9-aa14ddbbd266 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:54:41.206691 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524e99e9-890a-463f-bfa9-aa14ddbbd266 service nova] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:54:41.216526 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1142/2270] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:54:41 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:54:51.076145 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=33 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:54:51.211810 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=66 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:55:46.941972 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700e718e-0888-46d3-b110-63599c9ece4e service nova] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:55:46.952259 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700e718e-0888-46d3-b110-63599c9ece4e service nova] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:55:46.958944 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb17a4c6-2576-4118-ab3a-a7f3c17b025c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f6962106dfa4c4c9af551053f8095e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:55:46.959761 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb17a4c6-2576-4118-ab3a-a7f3c17b025c service nova] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:55:46.960046 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb17a4c6-2576-4118-ab3a-a7f3c17b025c service nova] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:55:46.960330 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb17a4c6-2576-4118-ab3a-a7f3c17b025c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:55:46.962405 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-cb17a4c6-2576-4118-ab3a-a7f3c17b025c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:55:47.076028 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb17a4c6-2576-4118-ab3a-a7f3c17b025c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:55:47.077656 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb17a4c6-2576-4118-ab3a-a7f3c17b025c service nova] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:55:47.088877 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1129/2271] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:55:46 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:55:47.160121 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524e99e9-890a-463f-bfa9-aa14ddbbd266 service nova] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:55:47.207853 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524e99e9-890a-463f-bfa9-aa14ddbbd266 service nova] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:55:47.216581 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aba34ed-562b-476c-b5d5-89dc045e6c21 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f6962106dfa4c4c9af551053f8095e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:55:47.217247 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aba34ed-562b-476c-b5d5-89dc045e6c21 service nova] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:55:47.217533 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aba34ed-562b-476c-b5d5-89dc045e6c21 service nova] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:55:47.217823 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aba34ed-562b-476c-b5d5-89dc045e6c21 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:55:47.220206 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-5aba34ed-562b-476c-b5d5-89dc045e6c21 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:55:47.317884 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb17a4c6-2576-4118-ab3a-a7f3c17b025c service nova] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:55:47.335013 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aba34ed-562b-476c-b5d5-89dc045e6c21 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:55:47.337060 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aba34ed-562b-476c-b5d5-89dc045e6c21 service nova] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:55:47.348607 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1143/2272] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:55:47 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:55:47.356660 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb17a4c6-2576-4118-ab3a-a7f3c17b025c service nova] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:55:47.363242 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e87a783-e8c0-420d-8baf-87cc9fdeed9b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f6962106dfa4c4c9af551053f8095e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:55:47.364090 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e87a783-e8c0-420d-8baf-87cc9fdeed9b service nova] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:55:47.364567 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e87a783-e8c0-420d-8baf-87cc9fdeed9b service nova] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:55:47.364916 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e87a783-e8c0-420d-8baf-87cc9fdeed9b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:55:47.367143 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-3e87a783-e8c0-420d-8baf-87cc9fdeed9b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:55:47.480165 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e87a783-e8c0-420d-8baf-87cc9fdeed9b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:55:47.481929 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e87a783-e8c0-420d-8baf-87cc9fdeed9b service nova] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:55:47.492748 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1130/2273] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:55:47 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:55:57.344114 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=47 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:55:57.488640 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=73 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:58:01.079992 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aba34ed-562b-476c-b5d5-89dc045e6c21 service nova] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:58:01.081539 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-5aba34ed-562b-476c-b5d5-89dc045e6c21 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:58:01.201992 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aba34ed-562b-476c-b5d5-89dc045e6c21 service nova] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:58:01.207741 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9a70e4-bcd4-4cb2-bd66-93347895f073 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc5a80144b84c609944a51a84fd5e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:58:01.208393 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9a70e4-bcd4-4cb2-bd66-93347895f073 service placement] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:58:01.208677 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9a70e4-bcd4-4cb2-bd66-93347895f073 service placement] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:58:01.208954 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9a70e4-bcd4-4cb2-bd66-93347895f073 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:58:01.210865 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-7e9a70e4-bcd4-4cb2-bd66-93347895f073 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:58:01.222055 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9a70e4-bcd4-4cb2-bd66-93347895f073 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:58:01.223708 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9a70e4-bcd4-4cb2-bd66-93347895f073 service placement] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:58:01.233644 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1144/2274] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:58:01 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:58:11.229581 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=55 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:59:04.817402 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e87a783-e8c0-420d-8baf-87cc9fdeed9b service nova] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:59:04.870957 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e87a783-e8c0-420d-8baf-87cc9fdeed9b service nova] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:59:04.877397 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061fc0d7-f9fa-4e63-8af0-a683749c9086 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e4a5a8965e4802a9055d332179b7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:59:04.878566 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061fc0d7-f9fa-4e63-8af0-a683749c9086 service neutron] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:59:04.879087 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061fc0d7-f9fa-4e63-8af0-a683749c9086 service neutron] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:59:04.879633 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061fc0d7-f9fa-4e63-8af0-a683749c9086 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:59:04.893315 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061fc0d7-f9fa-4e63-8af0-a683749c9086 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:59:04.896137 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061fc0d7-f9fa-4e63-8af0-a683749c9086 service neutron] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:59:04.911924 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1131/2275] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:59:04 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:59:14.905289 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=15 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:59:47.905858 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9a70e4-bcd4-4cb2-bd66-93347895f073 service placement] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:59:47.910384 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-7e9a70e4-bcd4-4cb2-bd66-93347895f073 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 09:59:47.959799 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9a70e4-bcd4-4cb2-bd66-93347895f073 service placement] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:59:47.963700 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c117aa17-ee6f-4052-83b8-fbe906034ff4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25048b29787d482783ebc944f1a7df65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:59:47.964361 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c117aa17-ee6f-4052-83b8-fbe906034ff4 service cinder] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:59:47.964649 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c117aa17-ee6f-4052-83b8-fbe906034ff4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:59:47.964930 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c117aa17-ee6f-4052-83b8-fbe906034ff4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:59:47.976754 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c117aa17-ee6f-4052-83b8-fbe906034ff4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:59:47.978456 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c117aa17-ee6f-4052-83b8-fbe906034ff4 service cinder] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:59:47.994612 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1145/2276] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:59:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 09:59:48.002781 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061fc0d7-f9fa-4e63-8af0-a683749c9086 service neutron] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:59:48.017151 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061fc0d7-f9fa-4e63-8af0-a683749c9086 service neutron] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:59:48.022290 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5351e3e9-1e4a-4b0d-ac5d-82b27c97a5a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25048b29787d482783ebc944f1a7df65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:59:48.023315 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5351e3e9-1e4a-4b0d-ac5d-82b27c97a5a8 service cinder] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:59:48.023801 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5351e3e9-1e4a-4b0d-ac5d-82b27c97a5a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:59:48.024198 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5351e3e9-1e4a-4b0d-ac5d-82b27c97a5a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:59:48.033776 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5351e3e9-1e4a-4b0d-ac5d-82b27c97a5a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:59:48.035795 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5351e3e9-1e4a-4b0d-ac5d-82b27c97a5a8 service cinder] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:59:48.066811 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1132/2277] 10.222.0.40 () {60 vars in 1396 bytes} [Thu Jul 14 09:59:48 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3252 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:59:48.124130 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c117aa17-ee6f-4052-83b8-fbe906034ff4 service cinder] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:59:48.138634 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c117aa17-ee6f-4052-83b8-fbe906034ff4 service cinder] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:59:48.145609 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee7c444-7172-413c-85a0-f98fe31cf264 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25048b29787d482783ebc944f1a7df65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:59:48.146792 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee7c444-7172-413c-85a0-f98fe31cf264 service cinder] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:59:48.147322 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee7c444-7172-413c-85a0-f98fe31cf264 service cinder] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:59:48.147884 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee7c444-7172-413c-85a0-f98fe31cf264 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:59:48.166437 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee7c444-7172-413c-85a0-f98fe31cf264 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:59:48.168461 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee7c444-7172-413c-85a0-f98fe31cf264 service cinder] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:59:48.183160 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1146/2278] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:59:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:59:48.191084 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5351e3e9-1e4a-4b0d-ac5d-82b27c97a5a8 service cinder] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:59:48.205350 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5351e3e9-1e4a-4b0d-ac5d-82b27c97a5a8 service cinder] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:59:48.209564 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f361e072-e873-43ae-9155-d2c4e432206d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25048b29787d482783ebc944f1a7df65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:59:48.210276 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f361e072-e873-43ae-9155-d2c4e432206d service cinder] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:59:48.210728 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f361e072-e873-43ae-9155-d2c4e432206d service cinder] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:59:48.211012 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f361e072-e873-43ae-9155-d2c4e432206d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:59:48.223043 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f361e072-e873-43ae-9155-d2c4e432206d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:59:48.224570 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f361e072-e873-43ae-9155-d2c4e432206d service cinder] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:59:48.236876 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1133/2279] 10.222.0.40 () {60 vars in 1396 bytes} [Thu Jul 14 09:59:48 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3248 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:59:48.307135 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee7c444-7172-413c-85a0-f98fe31cf264 service cinder] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:59:48.320298 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee7c444-7172-413c-85a0-f98fe31cf264 service cinder] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:59:48.326689 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47af102d-0bfd-4606-a328-cb36bc299cb7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25048b29787d482783ebc944f1a7df65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:59:48.328130 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47af102d-0bfd-4606-a328-cb36bc299cb7 service cinder] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:59:48.328761 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47af102d-0bfd-4606-a328-cb36bc299cb7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:59:48.329393 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47af102d-0bfd-4606-a328-cb36bc299cb7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:59:48.343483 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47af102d-0bfd-4606-a328-cb36bc299cb7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:59:48.345146 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47af102d-0bfd-4606-a328-cb36bc299cb7 service cinder] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:59:48.371330 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f361e072-e873-43ae-9155-d2c4e432206d service cinder] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 09:59:48.385207 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f361e072-e873-43ae-9155-d2c4e432206d service cinder] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 09:59:48.391680 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bac7dc3-f762-4ec0-a4f9-f41a710d188c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f6962106dfa4c4c9af551053f8095e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 09:59:48.392643 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bac7dc3-f762-4ec0-a4f9-f41a710d188c service nova] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 09:59:48.393029 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bac7dc3-f762-4ec0-a4f9-f41a710d188c service nova] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 09:59:48.393430 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bac7dc3-f762-4ec0-a4f9-f41a710d188c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 09:59:48.401431 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1147/2280] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:59:48 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 09:59:48.405565 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bac7dc3-f762-4ec0-a4f9-f41a710d188c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 09:59:48.408586 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bac7dc3-f762-4ec0-a4f9-f41a710d188c service nova] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 09:59:48.457940 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1134/2281] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 09:59:48 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 09:59:58.395739 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=34 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:59:58.453119 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=32 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:01:48.450574 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47af102d-0bfd-4606-a328-cb36bc299cb7 service cinder] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:01:48.465538 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47af102d-0bfd-4606-a328-cb36bc299cb7 service cinder] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:01:48.471801 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1460b1-e35d-48bd-a524-773eabddc362 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25048b29787d482783ebc944f1a7df65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:01:48.473406 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1460b1-e35d-48bd-a524-773eabddc362 service cinder] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:01:48.473903 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1460b1-e35d-48bd-a524-773eabddc362 service cinder] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:01:48.474440 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1460b1-e35d-48bd-a524-773eabddc362 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:01:48.487505 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1460b1-e35d-48bd-a524-773eabddc362 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:01:48.489797 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1460b1-e35d-48bd-a524-773eabddc362 service cinder] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:01:48.518903 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1148/2282] 10.222.0.40 () {60 vars in 1396 bytes} [Thu Jul 14 10:01:48 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3250 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 10:01:48.678374 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bac7dc3-f762-4ec0-a4f9-f41a710d188c service nova] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:01:48.688496 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1460b1-e35d-48bd-a524-773eabddc362 service cinder] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:01:48.695709 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bac7dc3-f762-4ec0-a4f9-f41a710d188c service nova] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:01:48.702437 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eb75e4-9265-4db2-894d-57649b3c2566 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25048b29787d482783ebc944f1a7df65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:01:48.703547 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eb75e4-9265-4db2-894d-57649b3c2566 service cinder] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:01:48.704108 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eb75e4-9265-4db2-894d-57649b3c2566 service cinder] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:01:48.704718 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eb75e4-9265-4db2-894d-57649b3c2566 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:01:48.716409 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1460b1-e35d-48bd-a524-773eabddc362 service cinder] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:01:48.716867 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03eb75e4-9265-4db2-894d-57649b3c2566 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:01:48.718914 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03eb75e4-9265-4db2-894d-57649b3c2566 service cinder] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:01:48.723093 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcb1a35-3a72-48cf-aa25-d42e12d2e535 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f6962106dfa4c4c9af551053f8095e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:01:48.723881 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcb1a35-3a72-48cf-aa25-d42e12d2e535 service nova] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:01:48.724059 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcb1a35-3a72-48cf-aa25-d42e12d2e535 service nova] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:01:48.724317 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcb1a35-3a72-48cf-aa25-d42e12d2e535 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:01:48.734527 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcb1a35-3a72-48cf-aa25-d42e12d2e535 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:01:48.736145 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcb1a35-3a72-48cf-aa25-d42e12d2e535 service nova] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:01:48.751367 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1135/2283] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 10:01:48 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 10:01:48.762237 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1149/2284] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 10:01:48 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:01:48.876674 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eb75e4-9265-4db2-894d-57649b3c2566 service cinder] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:01:48.889099 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eb75e4-9265-4db2-894d-57649b3c2566 service cinder] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:01:48.896209 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3b946a-4769-49ca-ac6c-d49af1e64ad0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f6962106dfa4c4c9af551053f8095e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:01:48.896981 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3b946a-4769-49ca-ac6c-d49af1e64ad0 service nova] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:01:48.897395 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3b946a-4769-49ca-ac6c-d49af1e64ad0 service nova] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:01:48.897602 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3b946a-4769-49ca-ac6c-d49af1e64ad0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:01:48.907062 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3b946a-4769-49ca-ac6c-d49af1e64ad0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:01:48.909316 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3b946a-4769-49ca-ac6c-d49af1e64ad0 service nova] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:01:48.949607 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1136/2285] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 10:01:48 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:01:58.757555 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=23 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:01:58.945045 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=26 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:03:06.813260 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcb1a35-3a72-48cf-aa25-d42e12d2e535 service nova] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:03:06.814741 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-4bcb1a35-3a72-48cf-aa25-d42e12d2e535 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:03:06.832684 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcb1a35-3a72-48cf-aa25-d42e12d2e535 service nova] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:03:06.840941 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd31e4c-d808-48c7-89be-28183413a571 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc5a80144b84c609944a51a84fd5e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:03:06.841623 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd31e4c-d808-48c7-89be-28183413a571 service placement] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:03:06.841919 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd31e4c-d808-48c7-89be-28183413a571 service placement] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:03:06.842211 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd31e4c-d808-48c7-89be-28183413a571 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:03:06.851561 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd31e4c-d808-48c7-89be-28183413a571 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:03:06.853363 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd31e4c-d808-48c7-89be-28183413a571 service placement] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:03:06.864557 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1150/2286] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 10:03:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:03:16.860723 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=6 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:07.525387 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3b946a-4769-49ca-ac6c-d49af1e64ad0 service nova] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:07.527403 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-db3b946a-4769-49ca-ac6c-d49af1e64ad0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:04:07.607521 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3b946a-4769-49ca-ac6c-d49af1e64ad0 service nova] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:07.613861 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050ce133-85eb-46d9-aa31-995a24b9b4ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e4a5a8965e4802a9055d332179b7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:07.614997 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050ce133-85eb-46d9-aa31-995a24b9b4ca service neutron] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:07.615485 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050ce133-85eb-46d9-aa31-995a24b9b4ca service neutron] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:07.615967 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050ce133-85eb-46d9-aa31-995a24b9b4ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:07.620332 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-050ce133-85eb-46d9-aa31-995a24b9b4ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:04:07.632823 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050ce133-85eb-46d9-aa31-995a24b9b4ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:07.637474 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050ce133-85eb-46d9-aa31-995a24b9b4ca service neutron] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:07.646706 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1137/2287] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 10:04:07 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:04:17.642843 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=31 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:45.245492 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd31e4c-d808-48c7-89be-28183413a571 service placement] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:45.256081 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd31e4c-d808-48c7-89be-28183413a571 service placement] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:45.259668 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cdf819-6b7f-4e7f-978f-a708d70b9583 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e4a5a8965e4802a9055d332179b7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:45.260429 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cdf819-6b7f-4e7f-978f-a708d70b9583 service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:45.260714 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cdf819-6b7f-4e7f-978f-a708d70b9583 service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:45.260987 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cdf819-6b7f-4e7f-978f-a708d70b9583 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:45.262899 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-13cdf819-6b7f-4e7f-978f-a708d70b9583 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:04:45.373349 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cdf819-6b7f-4e7f-978f-a708d70b9583 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:45.375280 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cdf819-6b7f-4e7f-978f-a708d70b9583 service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:45.414769 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1151/2288] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 10:04:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:04:48.535170 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050ce133-85eb-46d9-aa31-995a24b9b4ca service neutron] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:48.537930 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-050ce133-85eb-46d9-aa31-995a24b9b4ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:04:48.566509 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050ce133-85eb-46d9-aa31-995a24b9b4ca service neutron] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:48.571501 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e045d6f7-de2b-49d7-97d3-0e46d643a05e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e4a5a8965e4802a9055d332179b7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:48.572387 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e045d6f7-de2b-49d7-97d3-0e46d643a05e service neutron] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:48.574302 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e045d6f7-de2b-49d7-97d3-0e46d643a05e service neutron] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:48.574600 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e045d6f7-de2b-49d7-97d3-0e46d643a05e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:48.576683 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-e045d6f7-de2b-49d7-97d3-0e46d643a05e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:04:48.714794 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e045d6f7-de2b-49d7-97d3-0e46d643a05e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:48.716491 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e045d6f7-de2b-49d7-97d3-0e46d643a05e service neutron] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:48.731670 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1138/2289] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 10:04:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:04:48.741228 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cdf819-6b7f-4e7f-978f-a708d70b9583 service neutron] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:48.750609 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cdf819-6b7f-4e7f-978f-a708d70b9583 service neutron] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:48.754528 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba62a442-7606-4400-b22b-dede2d26695f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e4a5a8965e4802a9055d332179b7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:48.755205 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba62a442-7606-4400-b22b-dede2d26695f service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:48.755496 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba62a442-7606-4400-b22b-dede2d26695f service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:48.755781 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba62a442-7606-4400-b22b-dede2d26695f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:48.757836 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-ba62a442-7606-4400-b22b-dede2d26695f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:04:48.864314 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba62a442-7606-4400-b22b-dede2d26695f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:48.865745 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba62a442-7606-4400-b22b-dede2d26695f service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:48.891522 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1152/2290] 10.222.0.40 () {60 vars in 1396 bytes} [Thu Jul 14 10:04:48 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3256 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:04:49.106079 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e045d6f7-de2b-49d7-97d3-0e46d643a05e service neutron] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:49.117936 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e045d6f7-de2b-49d7-97d3-0e46d643a05e service neutron] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:49.123545 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d02d01-5fc6-4d90-b39f-d410aebdc38d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc5a80144b84c609944a51a84fd5e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:49.124288 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d02d01-5fc6-4d90-b39f-d410aebdc38d service placement] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:49.124667 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d02d01-5fc6-4d90-b39f-d410aebdc38d service placement] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:49.125012 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d02d01-5fc6-4d90-b39f-d410aebdc38d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:49.127020 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-46d02d01-5fc6-4d90-b39f-d410aebdc38d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:04:49.140038 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d02d01-5fc6-4d90-b39f-d410aebdc38d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:49.144124 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d02d01-5fc6-4d90-b39f-d410aebdc38d service placement] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:49.154922 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1139/2291] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 10:04:49 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:04:52.866766 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba62a442-7606-4400-b22b-dede2d26695f service neutron] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:52.881858 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba62a442-7606-4400-b22b-dede2d26695f service neutron] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:52.890405 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316cea5b-9184-422d-a20b-8c987751a5de service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc5a80144b84c609944a51a84fd5e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:52.891088 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316cea5b-9184-422d-a20b-8c987751a5de service placement] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:52.891380 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316cea5b-9184-422d-a20b-8c987751a5de service placement] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:52.891658 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316cea5b-9184-422d-a20b-8c987751a5de service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:52.894689 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-316cea5b-9184-422d-a20b-8c987751a5de service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:04:52.914385 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316cea5b-9184-422d-a20b-8c987751a5de service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:52.915933 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316cea5b-9184-422d-a20b-8c987751a5de service placement] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:52.928206 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1153/2292] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 10:04:52 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 10:04:52.990270 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d02d01-5fc6-4d90-b39f-d410aebdc38d service placement] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:52.998728 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-46d02d01-5fc6-4d90-b39f-d410aebdc38d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:04:53.013304 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d02d01-5fc6-4d90-b39f-d410aebdc38d service placement] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:53.018215 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1f05c1-558f-4897-a455-666c155e0ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:53.019157 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1f05c1-558f-4897-a455-666c155e0ca5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:53.019449 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1f05c1-558f-4897-a455-666c155e0ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:53.019732 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1f05c1-558f-4897-a455-666c155e0ca5 admin admin] PATH_INFO: `/v3/users/27cfaef90a5048569453430e75c4c42b` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:53.021007 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1f05c1-558f-4897-a455-666c155e0ca5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=27cfaef90a5048569453430e75c4c42b)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:53.022999 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1f05c1-558f-4897-a455-666c155e0ca5 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:53.083942 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-0a1f05c1-558f-4897-a455-666c155e0ca5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27cfaef90a5048569453430e75c4c42b'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:04:53.093632 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-0a1f05c1-558f-4897-a455-666c155e0ca5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27cfaef90a5048569453430e75c4c42b'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:04:53.094499 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-0a1f05c1-558f-4897-a455-666c155e0ca5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27cfaef90a5048569453430e75c4c42b'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:04:53.104292 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-0a1f05c1-558f-4897-a455-666c155e0ca5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27cfaef90a5048569453430e75c4c42b'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:04:53.105109 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-0a1f05c1-558f-4897-a455-666c155e0ca5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27cfaef90a5048569453430e75c4c42b'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:04:53.124191 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1140/2293] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 14 10:04:52 2022] DELETE /identity/v3/users/27cfaef90a5048569453430e75c4c42b => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:04:53.327702 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316cea5b-9184-422d-a20b-8c987751a5de service placement] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:53.340380 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316cea5b-9184-422d-a20b-8c987751a5de service placement] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:53.391544 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:53.410709 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a3aea6-9bc0-4dfe-9802-8735ac890643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:53.411572 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a3aea6-9bc0-4dfe-9802-8735ac890643 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:53.411861 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a3aea6-9bc0-4dfe-9802-8735ac890643 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:53.412136 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a3aea6-9bc0-4dfe-9802-8735ac890643 admin admin] PATH_INFO: `/v3/projects/a28617ad1f8d40faa7d2e317b32951ab` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:53.413315 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a3aea6-9bc0-4dfe-9802-8735ac890643 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a28617ad1f8d40faa7d2e317b32951ab)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:53.415283 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a3aea6-9bc0-4dfe-9802-8735ac890643 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:53.465765 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-28a3aea6-9bc0-4dfe-9802-8735ac890643 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a28617ad1f8d40faa7d2e317b32951ab', 'request_id': 'req-28a3aea6-9bc0-4dfe-9802-8735ac890643'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:04:53.473058 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-28a3aea6-9bc0-4dfe-9802-8735ac890643 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a28617ad1f8d40faa7d2e317b32951ab', 'request_id': 'req-28a3aea6-9bc0-4dfe-9802-8735ac890643'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:04:53.480838 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-28a3aea6-9bc0-4dfe-9802-8735ac890643 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a28617ad1f8d40faa7d2e317b32951ab', 'request_id': 'req-28a3aea6-9bc0-4dfe-9802-8735ac890643'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:04:53.499114 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-28a3aea6-9bc0-4dfe-9802-8735ac890643 admin admin] The token cache is being invalidate because project a28617ad1f8d40faa7d2e317b32951ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:04:53.499628 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-28a3aea6-9bc0-4dfe-9802-8735ac890643 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:04:53.500502 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-28a3aea6-9bc0-4dfe-9802-8735ac890643 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:04:53.502123 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1154/2294] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 14 10:04:53 2022] DELETE /identity/v3/projects/a28617ad1f8d40faa7d2e317b32951ab => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:04:53.506308 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1f05c1-558f-4897-a455-666c155e0ca5 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:53.507712 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-0a1f05c1-558f-4897-a455-666c155e0ca5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:04:53.521769 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1f05c1-558f-4897-a455-666c155e0ca5 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:53.558631 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:53.590358 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1d2ec4-5255-4b29-bc07-151556a5b6dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:53.591541 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1d2ec4-5255-4b29-bc07-151556a5b6dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:53.591976 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1d2ec4-5255-4b29-bc07-151556a5b6dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:53.592261 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1d2ec4-5255-4b29-bc07-151556a5b6dc admin admin] PATH_INFO: `/v3/users/6d631379146b4fe98570bcda7714b500` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:53.607015 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1d2ec4-5255-4b29-bc07-151556a5b6dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d631379146b4fe98570bcda7714b500)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:53.608947 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1d2ec4-5255-4b29-bc07-151556a5b6dc admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:53.663394 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-ad1d2ec4-5255-4b29-bc07-151556a5b6dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d631379146b4fe98570bcda7714b500'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:04:53.670110 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-ad1d2ec4-5255-4b29-bc07-151556a5b6dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d631379146b4fe98570bcda7714b500'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:04:53.671060 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-ad1d2ec4-5255-4b29-bc07-151556a5b6dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d631379146b4fe98570bcda7714b500'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:04:53.678561 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-ad1d2ec4-5255-4b29-bc07-151556a5b6dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d631379146b4fe98570bcda7714b500'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:04:53.679314 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-ad1d2ec4-5255-4b29-bc07-151556a5b6dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d631379146b4fe98570bcda7714b500'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:04:53.697326 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1141/2295] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 14 10:04:53 2022] DELETE /identity/v3/users/6d631379146b4fe98570bcda7714b500 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:04:53.889017 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a3aea6-9bc0-4dfe-9802-8735ac890643 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:04:53.890732 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-28a3aea6-9bc0-4dfe-9802-8735ac890643 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:04:53.908545 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a3aea6-9bc0-4dfe-9802-8735ac890643 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:04:53.985724 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fd8486-bc85-4dce-9b1e-7cb3d36f6013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:04:53.986935 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fd8486-bc85-4dce-9b1e-7cb3d36f6013 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:04:53.986935 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fd8486-bc85-4dce-9b1e-7cb3d36f6013 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:04:53.987266 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fd8486-bc85-4dce-9b1e-7cb3d36f6013 admin admin] PATH_INFO: `/v3/projects/765528ef03b54a86ac8764641a42efe1` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:04:53.999711 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fd8486-bc85-4dce-9b1e-7cb3d36f6013 admin admin] RBAC: Authorizing `identity:delete_project(project_id=765528ef03b54a86ac8764641a42efe1)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:04:54.002259 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fd8486-bc85-4dce-9b1e-7cb3d36f6013 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:04:54.060749 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-87fd8486-bc85-4dce-9b1e-7cb3d36f6013 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '765528ef03b54a86ac8764641a42efe1', 'request_id': 'req-87fd8486-bc85-4dce-9b1e-7cb3d36f6013'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:04:54.069851 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-87fd8486-bc85-4dce-9b1e-7cb3d36f6013 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '765528ef03b54a86ac8764641a42efe1', 'request_id': 'req-87fd8486-bc85-4dce-9b1e-7cb3d36f6013'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:04:54.079705 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-87fd8486-bc85-4dce-9b1e-7cb3d36f6013 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '765528ef03b54a86ac8764641a42efe1', 'request_id': 'req-87fd8486-bc85-4dce-9b1e-7cb3d36f6013'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:04:54.082571 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:54.103889 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-87fd8486-bc85-4dce-9b1e-7cb3d36f6013 admin admin] The token cache is being invalidate because project 765528ef03b54a86ac8764641a42efe1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:04:54.104026 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-87fd8486-bc85-4dce-9b1e-7cb3d36f6013 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:04:54.104770 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-87fd8486-bc85-4dce-9b1e-7cb3d36f6013 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:04:54.110352 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1155/2296] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 14 10:04:53 2022] DELETE /identity/v3/projects/765528ef03b54a86ac8764641a42efe1 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:05:03.693101 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=43,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:04.102662 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:INSERT=1,keystone:DELETE=1,keystone:SELECT=2 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:49.386476 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1d2ec4-5255-4b29-bc07-151556a5b6dc admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:49.388193 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-ad1d2ec4-5255-4b29-bc07-151556a5b6dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:05:49.484572 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1d2ec4-5255-4b29-bc07-151556a5b6dc admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:49.562575 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea13f17e-bd1c-43b8-b07a-9acd362d739d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25048b29787d482783ebc944f1a7df65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:49.563246 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea13f17e-bd1c-43b8-b07a-9acd362d739d service cinder] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:49.563529 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea13f17e-bd1c-43b8-b07a-9acd362d739d service cinder] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:49.563805 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea13f17e-bd1c-43b8-b07a-9acd362d739d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:49.565663 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-ea13f17e-bd1c-43b8-b07a-9acd362d739d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:05:49.655813 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea13f17e-bd1c-43b8-b07a-9acd362d739d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:49.657181 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea13f17e-bd1c-43b8-b07a-9acd362d739d service cinder] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:49.679329 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1142/2297] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 10:05:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:05:49.686229 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fd8486-bc85-4dce-9b1e-7cb3d36f6013 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:49.687666 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-87fd8486-bc85-4dce-9b1e-7cb3d36f6013 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:05:49.701803 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fd8486-bc85-4dce-9b1e-7cb3d36f6013 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:49.706217 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7112a1-50b2-4d37-94de-c5e4c877f95f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25048b29787d482783ebc944f1a7df65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:49.706886 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7112a1-50b2-4d37-94de-c5e4c877f95f service cinder] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:49.707171 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7112a1-50b2-4d37-94de-c5e4c877f95f service cinder] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:49.707447 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7112a1-50b2-4d37-94de-c5e4c877f95f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:49.709253 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-eb7112a1-50b2-4d37-94de-c5e4c877f95f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:05:49.787178 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7112a1-50b2-4d37-94de-c5e4c877f95f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:49.788630 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7112a1-50b2-4d37-94de-c5e4c877f95f service cinder] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:49.798283 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1156/2298] 10.222.0.40 () {60 vars in 1396 bytes} [Thu Jul 14 10:05:49 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3252 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:05:49.935815 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea13f17e-bd1c-43b8-b07a-9acd362d739d service cinder] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:49.958107 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea13f17e-bd1c-43b8-b07a-9acd362d739d service cinder] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:49.961975 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1872e704-bb8f-4d75-bb51-6feb7a068da6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25048b29787d482783ebc944f1a7df65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:49.962692 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1872e704-bb8f-4d75-bb51-6feb7a068da6 service cinder] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:49.963096 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1872e704-bb8f-4d75-bb51-6feb7a068da6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:49.963263 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1872e704-bb8f-4d75-bb51-6feb7a068da6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:49.965235 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-1872e704-bb8f-4d75-bb51-6feb7a068da6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:05:49.991808 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:50.059242 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1872e704-bb8f-4d75-bb51-6feb7a068da6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:50.060687 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1872e704-bb8f-4d75-bb51-6feb7a068da6 service cinder] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:50.079206 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1143/2299] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 10:05:49 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:05:50.133761 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7112a1-50b2-4d37-94de-c5e4c877f95f service cinder] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:50.143694 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7112a1-50b2-4d37-94de-c5e4c877f95f service cinder] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:50.151479 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089ca9e9-9cb4-44e6-ba93-22cfaed5afbc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25048b29787d482783ebc944f1a7df65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:50.152148 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089ca9e9-9cb4-44e6-ba93-22cfaed5afbc service cinder] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:50.152574 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089ca9e9-9cb4-44e6-ba93-22cfaed5afbc service cinder] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:50.152855 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089ca9e9-9cb4-44e6-ba93-22cfaed5afbc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:50.154919 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-089ca9e9-9cb4-44e6-ba93-22cfaed5afbc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:05:50.241621 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089ca9e9-9cb4-44e6-ba93-22cfaed5afbc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:50.243096 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089ca9e9-9cb4-44e6-ba93-22cfaed5afbc service cinder] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:50.255462 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1157/2300] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 10:05:50 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:05:52.345878 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1872e704-bb8f-4d75-bb51-6feb7a068da6 service cinder] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:05:52.347475 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-1872e704-bb8f-4d75-bb51-6feb7a068da6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:05:52.364606 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1872e704-bb8f-4d75-bb51-6feb7a068da6 service cinder] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:05:52.371154 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee38e317-9feb-4388-b1a6-f3d0d7cad6aa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f6962106dfa4c4c9af551053f8095e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:05:52.371842 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee38e317-9feb-4388-b1a6-f3d0d7cad6aa service nova] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:05:52.372262 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee38e317-9feb-4388-b1a6-f3d0d7cad6aa service nova] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:05:52.372639 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee38e317-9feb-4388-b1a6-f3d0d7cad6aa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:05:52.374805 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-ee38e317-9feb-4388-b1a6-f3d0d7cad6aa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:05:52.391066 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee38e317-9feb-4388-b1a6-f3d0d7cad6aa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:05:52.393225 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee38e317-9feb-4388-b1a6-f3d0d7cad6aa service nova] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:05:52.406395 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1144/2301] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 10:05:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:06:00.248264 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=66 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:06:02.401182 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=36 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:07:50.662570 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089ca9e9-9cb4-44e6-ba93-22cfaed5afbc service cinder] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:07:50.671505 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089ca9e9-9cb4-44e6-ba93-22cfaed5afbc service cinder] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:07:50.675245 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adac635e-bb92-4f94-ae95-4766bcaff566 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25048b29787d482783ebc944f1a7df65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:07:50.675916 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adac635e-bb92-4f94-ae95-4766bcaff566 service cinder] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:07:50.676192 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adac635e-bb92-4f94-ae95-4766bcaff566 service cinder] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:07:50.676468 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adac635e-bb92-4f94-ae95-4766bcaff566 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:07:50.678331 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-adac635e-bb92-4f94-ae95-4766bcaff566 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:07:50.708141 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application [None req-adac635e-bb92-4f94-ae95-4766bcaff566 service cinder] Could not find project: a28617ad1f8d40faa7d2e317b32951ab.: keystone.exception.ProjectNotFound: Could not find project: a28617ad1f8d40faa7d2e317b32951ab. Jul 14 10:07:50.708141 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:07:50.708141 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:07:50.708141 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:07:50.708141 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:07:50.708141 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:07:50.708141 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:07:50.708141 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:07:50.708141 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:07:50.708141 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:07:50.708141 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:07:50.708141 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:07:50.708141 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 285, in get Jul 14 10:07:50.708141 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:validate_token') Jul 14 10:07:50.708141 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 422, in enforce_call Jul 14 10:07:50.709479 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application subj_token_target_data = cls._extract_subject_token_target_data() Jul 14 10:07:50.709479 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 261, in _extract_subject_token_target_data Jul 14 10:07:50.709479 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application token = PROVIDER_APIS.token_provider_api.validate_token( Jul 14 10:07:50.709479 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:07:50.709479 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:07:50.709479 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 145, in validate_token Jul 14 10:07:50.709479 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application token = self._validate_token(token_id) Jul 14 10:07:50.709479 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:07:50.709479 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:07:50.709479 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:07:50.709479 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:07:50.709479 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:07:50.709479 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( Jul 14 10:07:50.709479 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:07:50.709479 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:07:50.709479 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:07:50.709479 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:07:50.710993 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:07:50.710993 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:07:50.710993 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:07:50.710993 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:07:50.710993 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 179, in _validate_token Jul 14 10:07:50.710993 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application token.mint(token_id, issued_at) Jul 14 10:07:50.710993 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/models/token_model.py", line 579, in mint Jul 14 10:07:50.710993 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application self._validate_token_resources() Jul 14 10:07:50.710993 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/models/token_model.py", line 464, in _validate_token_resources Jul 14 10:07:50.710993 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application if self.project and not self.project.get('enabled'): Jul 14 10:07:50.710993 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/models/token_model.py", line 162, in project Jul 14 10:07:50.710993 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application self.__project = PROVIDERS.resource_api.get_project( Jul 14 10:07:50.710993 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:07:50.710993 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:07:50.710993 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:07:50.710993 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:07:50.710993 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:07:50.712302 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:07:50.712302 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:07:50.712302 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application with Lock( Jul 14 10:07:50.712302 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:07:50.712302 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:07:50.712302 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:07:50.712302 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:07:50.712302 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:07:50.712302 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:07:50.712302 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:07:50.712302 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:07:50.712302 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 10:07:50.712302 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 10:07:50.712302 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 10:07:50.712302 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 10:07:50.712302 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 10:07:50.712302 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 10:07:50.713512 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: a28617ad1f8d40faa7d2e317b32951ab. Jul 14 10:07:50.713512 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: ERROR keystone.server.flask.application Jul 14 10:07:50.713512 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1158/2302] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 10:07:50 2022] GET /identity/v3/auth/tokens => generated 113 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 14 10:07:50.818969 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee38e317-9feb-4388-b1a6-f3d0d7cad6aa service nova] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:07:50.828077 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee38e317-9feb-4388-b1a6-f3d0d7cad6aa service nova] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:07:50.831696 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924576eb-337e-4f93-8cd5-88ee93daeab8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25048b29787d482783ebc944f1a7df65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:07:50.832335 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924576eb-337e-4f93-8cd5-88ee93daeab8 service cinder] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:07:50.832619 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924576eb-337e-4f93-8cd5-88ee93daeab8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:07:50.832894 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924576eb-337e-4f93-8cd5-88ee93daeab8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:07:50.834702 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-924576eb-337e-4f93-8cd5-88ee93daeab8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:07:50.906642 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924576eb-337e-4f93-8cd5-88ee93daeab8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:07:50.908195 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924576eb-337e-4f93-8cd5-88ee93daeab8 service cinder] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:07:50.917245 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1145/2303] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 10:07:50 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:07:51.009377 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adac635e-bb92-4f94-ae95-4766bcaff566 service cinder] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:07:51.018405 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adac635e-bb92-4f94-ae95-4766bcaff566 service cinder] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:07:51.022067 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282f8f3e-60f7-4abd-9f78-f4b4b6b87c52 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25048b29787d482783ebc944f1a7df65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:07:51.022685 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282f8f3e-60f7-4abd-9f78-f4b4b6b87c52 service cinder] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:07:51.022971 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282f8f3e-60f7-4abd-9f78-f4b4b6b87c52 service cinder] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:07:51.023249 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282f8f3e-60f7-4abd-9f78-f4b4b6b87c52 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:07:51.025027 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-282f8f3e-60f7-4abd-9f78-f4b4b6b87c52 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:07:51.096135 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282f8f3e-60f7-4abd-9f78-f4b4b6b87c52 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:07:51.097723 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282f8f3e-60f7-4abd-9f78-f4b4b6b87c52 service cinder] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:07:51.107188 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1159/2304] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 10:07:51 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:08:00.913078 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=33 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:08:01.102837 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=37 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:08:11.134054 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924576eb-337e-4f93-8cd5-88ee93daeab8 service cinder] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:08:11.135501 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-924576eb-337e-4f93-8cd5-88ee93daeab8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:08:11.253393 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924576eb-337e-4f93-8cd5-88ee93daeab8 service cinder] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:08:11.258514 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931138f4-1c2d-46e5-8e68-acdec67fdbf1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc5a80144b84c609944a51a84fd5e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:08:11.259167 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931138f4-1c2d-46e5-8e68-acdec67fdbf1 service placement] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:08:11.259453 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931138f4-1c2d-46e5-8e68-acdec67fdbf1 service placement] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:08:11.259735 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931138f4-1c2d-46e5-8e68-acdec67fdbf1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:08:11.261504 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-931138f4-1c2d-46e5-8e68-acdec67fdbf1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:08:11.273032 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931138f4-1c2d-46e5-8e68-acdec67fdbf1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:08:11.274618 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931138f4-1c2d-46e5-8e68-acdec67fdbf1 service placement] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:08:11.284615 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1146/2305] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 10:08:11 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:08:21.280409 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=50 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:09:12.861937 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282f8f3e-60f7-4abd-9f78-f4b4b6b87c52 service cinder] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:09:12.864274 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-282f8f3e-60f7-4abd-9f78-f4b4b6b87c52 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:09:12.943586 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282f8f3e-60f7-4abd-9f78-f4b4b6b87c52 service cinder] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:09:12.947261 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df49db84-022b-41e9-8ad4-411e54ea5a96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e4a5a8965e4802a9055d332179b7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:09:12.947904 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df49db84-022b-41e9-8ad4-411e54ea5a96 service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:09:12.948186 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df49db84-022b-41e9-8ad4-411e54ea5a96 service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:09:12.948463 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df49db84-022b-41e9-8ad4-411e54ea5a96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:09:12.950280 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-df49db84-022b-41e9-8ad4-411e54ea5a96 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:09:12.960306 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df49db84-022b-41e9-8ad4-411e54ea5a96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:09:12.961731 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df49db84-022b-41e9-8ad4-411e54ea5a96 service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:09:12.969824 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1160/2306] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 10:09:12 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:09:22.966237 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=35 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:09:48.925547 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931138f4-1c2d-46e5-8e68-acdec67fdbf1 service placement] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:09:48.947552 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931138f4-1c2d-46e5-8e68-acdec67fdbf1 service placement] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:09:48.952987 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b533f1c2-4056-4057-bcd2-acc1635c7dad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f6962106dfa4c4c9af551053f8095e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:09:48.953623 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b533f1c2-4056-4057-bcd2-acc1635c7dad service nova] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:09:48.953908 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b533f1c2-4056-4057-bcd2-acc1635c7dad service nova] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:09:48.954234 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b533f1c2-4056-4057-bcd2-acc1635c7dad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:09:48.955986 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-b533f1c2-4056-4057-bcd2-acc1635c7dad service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:09:49.026478 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b533f1c2-4056-4057-bcd2-acc1635c7dad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:09:49.028072 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b533f1c2-4056-4057-bcd2-acc1635c7dad service nova] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:09:49.047697 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1147/2307] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 10:09:48 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:09:49.101484 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df49db84-022b-41e9-8ad4-411e54ea5a96 service neutron] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:09:49.103088 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-df49db84-022b-41e9-8ad4-411e54ea5a96 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:09:49.113916 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df49db84-022b-41e9-8ad4-411e54ea5a96 service neutron] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:09:49.118152 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b23b2e3-e8f1-4821-aa10-22e85d2ee504 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e4a5a8965e4802a9055d332179b7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:09:49.118870 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b23b2e3-e8f1-4821-aa10-22e85d2ee504 service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:09:49.119154 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b23b2e3-e8f1-4821-aa10-22e85d2ee504 service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:09:49.119433 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b23b2e3-e8f1-4821-aa10-22e85d2ee504 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:09:49.121194 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-9b23b2e3-e8f1-4821-aa10-22e85d2ee504 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:09:49.135929 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b23b2e3-e8f1-4821-aa10-22e85d2ee504 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:09:49.137426 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b23b2e3-e8f1-4821-aa10-22e85d2ee504 service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:09:49.148984 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1161/2308] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 10:09:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:09:59.045289 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=41 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:09:59.144566 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=6 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:10:47.779037 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ebcd1b-dd1d-48a4-8925-33ddc34e075d None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:10:47.779603 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ebcd1b-dd1d-48a4-8925-33ddc34e075d None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:10:47.779603 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ebcd1b-dd1d-48a4-8925-33ddc34e075d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:10:47.809375 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-45ebcd1b-dd1d-48a4-8925-33ddc34e075d None None] MFA Rules not processed for user `f50c3855aa764c2fb86c48c90eb9e15c`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:10:47.810735 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-45ebcd1b-dd1d-48a4-8925-33ddc34e075d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:10:47.819063 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1148/2309] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 10:10:47 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:10:47.949984 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b23b2e3-e8f1-4821-aa10-22e85d2ee504 service neutron] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:10:47.959039 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b23b2e3-e8f1-4821-aa10-22e85d2ee504 service neutron] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:10:47.963326 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef3193a-175e-4068-b8f0-149c535e221a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e4a5a8965e4802a9055d332179b7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:10:47.964016 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef3193a-175e-4068-b8f0-149c535e221a service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:10:47.964369 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef3193a-175e-4068-b8f0-149c535e221a service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:10:47.964819 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef3193a-175e-4068-b8f0-149c535e221a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:10:47.976854 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef3193a-175e-4068-b8f0-149c535e221a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:10:47.978321 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef3193a-175e-4068-b8f0-149c535e221a service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:10:47.990780 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1162/2310] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 10:10:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:10:48.189430 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ebcd1b-dd1d-48a4-8925-33ddc34e075d None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:10:48.199691 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ebcd1b-dd1d-48a4-8925-33ddc34e075d None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:10:48.203958 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66def1d-2b32-4f16-8a49-24060c5f39ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e4a5a8965e4802a9055d332179b7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:10:48.204612 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66def1d-2b32-4f16-8a49-24060c5f39ba service neutron] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:10:48.204894 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66def1d-2b32-4f16-8a49-24060c5f39ba service neutron] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:10:48.205170 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66def1d-2b32-4f16-8a49-24060c5f39ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:10:48.206971 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-b66def1d-2b32-4f16-8a49-24060c5f39ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:10:48.217661 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66def1d-2b32-4f16-8a49-24060c5f39ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:10:48.219130 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66def1d-2b32-4f16-8a49-24060c5f39ba service neutron] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:10:48.228093 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1149/2311] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 10:10:48 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:10:48.582717 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef3193a-175e-4068-b8f0-149c535e221a service neutron] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:10:48.584844 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-5ef3193a-175e-4068-b8f0-149c535e221a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:10:48.602028 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef3193a-175e-4068-b8f0-149c535e221a service neutron] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:10:48.607020 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518123be-b8ff-4c50-bfc3-6c5985bd1048 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc5a80144b84c609944a51a84fd5e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:10:48.607699 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518123be-b8ff-4c50-bfc3-6c5985bd1048 service placement] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:10:48.607986 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518123be-b8ff-4c50-bfc3-6c5985bd1048 service placement] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:10:48.608285 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518123be-b8ff-4c50-bfc3-6c5985bd1048 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:10:48.610343 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-518123be-b8ff-4c50-bfc3-6c5985bd1048 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:10:48.624268 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518123be-b8ff-4c50-bfc3-6c5985bd1048 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:10:48.626077 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518123be-b8ff-4c50-bfc3-6c5985bd1048 service placement] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:10:48.637757 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1163/2312] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 10:10:48 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:10:49.760795 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66def1d-2b32-4f16-8a49-24060c5f39ba service neutron] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:10:49.775580 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66def1d-2b32-4f16-8a49-24060c5f39ba service neutron] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:10:49.787831 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263282a5-3515-4cf3-929b-4aac7a8988fa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f6962106dfa4c4c9af551053f8095e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:10:49.788594 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263282a5-3515-4cf3-929b-4aac7a8988fa service nova] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:10:49.788976 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263282a5-3515-4cf3-929b-4aac7a8988fa service nova] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:10:49.789357 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263282a5-3515-4cf3-929b-4aac7a8988fa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:10:49.801157 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263282a5-3515-4cf3-929b-4aac7a8988fa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:10:49.803248 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263282a5-3515-4cf3-929b-4aac7a8988fa service nova] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:10:49.847720 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1150/2313] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 10:10:49 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:10:49.957148 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518123be-b8ff-4c50-bfc3-6c5985bd1048 service placement] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:10:49.960213 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-518123be-b8ff-4c50-bfc3-6c5985bd1048 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:10:49.984627 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518123be-b8ff-4c50-bfc3-6c5985bd1048 service placement] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:10:49.994646 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38512349-d06d-40ee-a650-3d173f0b21fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f6962106dfa4c4c9af551053f8095e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:10:49.995839 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38512349-d06d-40ee-a650-3d173f0b21fe service nova] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:10:49.996120 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38512349-d06d-40ee-a650-3d173f0b21fe service nova] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:10:49.996617 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38512349-d06d-40ee-a650-3d173f0b21fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:10:50.006504 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38512349-d06d-40ee-a650-3d173f0b21fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:10:50.008146 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38512349-d06d-40ee-a650-3d173f0b21fe service nova] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:10:50.020460 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1164/2314] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 10:10:49 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:10:51.611883 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263282a5-3515-4cf3-929b-4aac7a8988fa service nova] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:10:51.633937 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263282a5-3515-4cf3-929b-4aac7a8988fa service nova] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:10:51.641424 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e18bc25-f084-4ad1-9c8b-ab1846db752a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f6962106dfa4c4c9af551053f8095e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:10:51.642092 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e18bc25-f084-4ad1-9c8b-ab1846db752a service nova] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:10:51.642777 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e18bc25-f084-4ad1-9c8b-ab1846db752a service nova] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:10:51.642777 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e18bc25-f084-4ad1-9c8b-ab1846db752a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:10:51.653783 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e18bc25-f084-4ad1-9c8b-ab1846db752a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:10:51.655468 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e18bc25-f084-4ad1-9c8b-ab1846db752a service nova] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:10:51.669549 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1151/2315] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 10:10:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 10:10:58.060996 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38512349-d06d-40ee-a650-3d173f0b21fe service nova] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:10:58.072984 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38512349-d06d-40ee-a650-3d173f0b21fe service nova] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:10:58.080012 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b598f0-d117-4c7d-941a-f22dabb59c23 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f6962106dfa4c4c9af551053f8095e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:10:58.080965 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b598f0-d117-4c7d-941a-f22dabb59c23 service nova] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:10:58.081386 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b598f0-d117-4c7d-941a-f22dabb59c23 service nova] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:10:58.081761 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b598f0-d117-4c7d-941a-f22dabb59c23 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:10:58.083765 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-51b598f0-d117-4c7d-941a-f22dabb59c23 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:10:58.099083 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b598f0-d117-4c7d-941a-f22dabb59c23 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:10:58.101004 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b598f0-d117-4c7d-941a-f22dabb59c23 service nova] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:10:58.113760 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1165/2316] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 10:10:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:11:01.662596 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=31 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:11:08.108556 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=24 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:12:44.827306 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e18bc25-f084-4ad1-9c8b-ab1846db752a service nova] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:12:44.828899 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-5e18bc25-f084-4ad1-9c8b-ab1846db752a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:12:44.866180 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e18bc25-f084-4ad1-9c8b-ab1846db752a service nova] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:12:44.869845 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf151bf-3c47-4928-9942-23db361ab641 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25048b29787d482783ebc944f1a7df65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:12:44.870520 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf151bf-3c47-4928-9942-23db361ab641 service cinder] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:12:44.870805 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf151bf-3c47-4928-9942-23db361ab641 service cinder] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:12:44.871078 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf151bf-3c47-4928-9942-23db361ab641 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:12:44.880637 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf151bf-3c47-4928-9942-23db361ab641 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:12:44.882117 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf151bf-3c47-4928-9942-23db361ab641 service cinder] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:12:44.913573 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1152/2317] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 10:12:44 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:12:51.212890 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b598f0-d117-4c7d-941a-f22dabb59c23 service nova] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:12:51.214882 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf151bf-3c47-4928-9942-23db361ab641 service cinder] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:12:51.227518 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b598f0-d117-4c7d-941a-f22dabb59c23 service nova] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:12:51.228588 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf151bf-3c47-4928-9942-23db361ab641 service cinder] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:12:51.234033 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f600f4a5-f4c1-45a6-8d4e-3e67bccc14e4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f6962106dfa4c4c9af551053f8095e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:12:51.234275 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1161dbbd-7157-4c22-96d6-87c0d52510c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f6962106dfa4c4c9af551053f8095e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:12:51.234775 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f600f4a5-f4c1-45a6-8d4e-3e67bccc14e4 service nova] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:12:51.235057 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f600f4a5-f4c1-45a6-8d4e-3e67bccc14e4 service nova] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:12:51.235190 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1161dbbd-7157-4c22-96d6-87c0d52510c5 service nova] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:12:51.235335 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f600f4a5-f4c1-45a6-8d4e-3e67bccc14e4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:12:51.235457 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1161dbbd-7157-4c22-96d6-87c0d52510c5 service nova] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:12:51.235663 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1161dbbd-7157-4c22-96d6-87c0d52510c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:12:51.245416 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1161dbbd-7157-4c22-96d6-87c0d52510c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:12:51.245620 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f600f4a5-f4c1-45a6-8d4e-3e67bccc14e4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:12:51.246966 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1161dbbd-7157-4c22-96d6-87c0d52510c5 service nova] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:12:51.247215 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f600f4a5-f4c1-45a6-8d4e-3e67bccc14e4 service nova] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:12:51.275980 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1166/2318] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 10:12:51 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:12:51.278229 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1153/2319] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 10:12:51 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:13:01.273147 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=13 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:13:01.273740 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=35 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:13:18.184668 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f600f4a5-f4c1-45a6-8d4e-3e67bccc14e4 service nova] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:13:18.196893 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f600f4a5-f4c1-45a6-8d4e-3e67bccc14e4 service nova] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:13:18.201919 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0302f5fa-a8b6-49f5-95e6-1c14dc84d251 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc5a80144b84c609944a51a84fd5e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:13:18.202604 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0302f5fa-a8b6-49f5-95e6-1c14dc84d251 service placement] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:13:18.202914 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0302f5fa-a8b6-49f5-95e6-1c14dc84d251 service placement] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:13:18.203198 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0302f5fa-a8b6-49f5-95e6-1c14dc84d251 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:13:18.212900 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0302f5fa-a8b6-49f5-95e6-1c14dc84d251 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:13:18.214503 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0302f5fa-a8b6-49f5-95e6-1c14dc84d251 service placement] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:13:18.225268 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1167/2320] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 10:13:18 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:13:28.220972 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=6 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:13:47.621721 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1161dbbd-7157-4c22-96d6-87c0d52510c5 service nova] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:13:47.632630 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1161dbbd-7157-4c22-96d6-87c0d52510c5 service nova] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:13:47.636607 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3614c0f-3ef7-4feb-a681-6169e2f9ca5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e4a5a8965e4802a9055d332179b7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:13:47.637279 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3614c0f-3ef7-4feb-a681-6169e2f9ca5b service neutron] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:13:47.637573 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3614c0f-3ef7-4feb-a681-6169e2f9ca5b service neutron] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:13:47.637856 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3614c0f-3ef7-4feb-a681-6169e2f9ca5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:13:47.639941 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-c3614c0f-3ef7-4feb-a681-6169e2f9ca5b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:13:47.722135 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3614c0f-3ef7-4feb-a681-6169e2f9ca5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:13:47.723664 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3614c0f-3ef7-4feb-a681-6169e2f9ca5b service neutron] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:13:47.736902 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1154/2321] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 10:13:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:13:50.591794 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b62914-f134-4da4-8236-7073942bb3a5 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:13:50.592312 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b62914-f134-4da4-8236-7073942bb3a5 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:13:50.592403 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b62914-f134-4da4-8236-7073942bb3a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:13:50.663590 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-c5b62914-f134-4da4-8236-7073942bb3a5 None None] MFA Rules not processed for user `688f473972144fb6b7a398c1f775a5c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:13:50.665323 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-c5b62914-f134-4da4-8236-7073942bb3a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:13:50.686102 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1168/2322] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 10:13:50 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:13:50.975083 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3614c0f-3ef7-4feb-a681-6169e2f9ca5b service neutron] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:13:50.999540 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3614c0f-3ef7-4feb-a681-6169e2f9ca5b service neutron] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:13:51.011770 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb861460-c353-409e-9e0d-a2091449c7dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f6962106dfa4c4c9af551053f8095e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:13:51.012826 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb861460-c353-409e-9e0d-a2091449c7dd service nova] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:13:51.013288 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb861460-c353-409e-9e0d-a2091449c7dd service nova] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:13:51.013743 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb861460-c353-409e-9e0d-a2091449c7dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:13:51.016057 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-eb861460-c353-409e-9e0d-a2091449c7dd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:13:51.040080 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb861460-c353-409e-9e0d-a2091449c7dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:13:51.041708 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb861460-c353-409e-9e0d-a2091449c7dd service nova] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:13:51.072017 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1155/2323] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 10:13:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:13:51.424520 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b62914-f134-4da4-8236-7073942bb3a5 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:13:51.439426 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b62914-f134-4da4-8236-7073942bb3a5 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:13:51.448233 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a9df7d-d0a3-4360-801b-e342abeb0d1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e4a5a8965e4802a9055d332179b7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:13:51.450782 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a9df7d-d0a3-4360-801b-e342abeb0d1d service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:13:51.451343 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a9df7d-d0a3-4360-801b-e342abeb0d1d service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:13:51.452568 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a9df7d-d0a3-4360-801b-e342abeb0d1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:13:51.457409 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-50a9df7d-d0a3-4360-801b-e342abeb0d1d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:13:51.480319 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a9df7d-d0a3-4360-801b-e342abeb0d1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:13:51.482134 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a9df7d-d0a3-4360-801b-e342abeb0d1d service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:13:51.494249 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1169/2324] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 10:13:51 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:13:52.108908 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9f7387-c27c-43b3-baeb-4ab20367647e None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:13:52.110002 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9f7387-c27c-43b3-baeb-4ab20367647e None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:13:52.110351 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9f7387-c27c-43b3-baeb-4ab20367647e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:13:52.285056 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-8f9f7387-c27c-43b3-baeb-4ab20367647e None None] MFA Rules not processed for user `6cf35868f9ff46e2835a6cc023641da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:13:52.286284 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-8f9f7387-c27c-43b3-baeb-4ab20367647e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:13:52.436560 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1156/2325] 10.222.0.40 () {58 vars in 967 bytes} [Thu Jul 14 10:13:52 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 10:13:52.532293 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a9df7d-d0a3-4360-801b-e342abeb0d1d service neutron] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:13:52.534945 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-50a9df7d-d0a3-4360-801b-e342abeb0d1d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:13:52.816531 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a9df7d-d0a3-4360-801b-e342abeb0d1d service neutron] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:13:52.830488 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18dc458-d995-46c0-99d1-96188a482f12 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '302c0f7dd3bf4829aad0b29bd0c091a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:13:52.831373 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18dc458-d995-46c0-99d1-96188a482f12 service swift] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:13:52.831802 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18dc458-d995-46c0-99d1-96188a482f12 service swift] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:13:52.832189 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18dc458-d995-46c0-99d1-96188a482f12 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:13:52.843440 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18dc458-d995-46c0-99d1-96188a482f12 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:13:52.846476 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18dc458-d995-46c0-99d1-96188a482f12 service swift] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:13:52.859137 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1170/2326] 10.222.0.40 () {60 vars in 1384 bytes} [Thu Jul 14 10:13:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 10:13:53.531162 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9f7387-c27c-43b3-baeb-4ab20367647e None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:13:53.548930 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9f7387-c27c-43b3-baeb-4ab20367647e None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:13:53.553307 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c796a23d-daf1-48cc-8870-92f43009e600 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e4a5a8965e4802a9055d332179b7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:13:53.553978 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c796a23d-daf1-48cc-8870-92f43009e600 service neutron] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:13:53.554294 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c796a23d-daf1-48cc-8870-92f43009e600 service neutron] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:13:53.554576 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c796a23d-daf1-48cc-8870-92f43009e600 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:13:53.564413 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-c796a23d-daf1-48cc-8870-92f43009e600 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:13:53.581458 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c796a23d-daf1-48cc-8870-92f43009e600 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:13:53.583219 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c796a23d-daf1-48cc-8870-92f43009e600 service neutron] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:13:53.599251 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1157/2327] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 10:13:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:13:54.622662 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18dc458-d995-46c0-99d1-96188a482f12 service swift] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:13:54.635311 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18dc458-d995-46c0-99d1-96188a482f12 service swift] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:13:54.640593 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58322c1f-146d-4b1f-9b4c-566401bf3c85 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc5a80144b84c609944a51a84fd5e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:13:54.641256 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58322c1f-146d-4b1f-9b4c-566401bf3c85 service placement] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:13:54.641535 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58322c1f-146d-4b1f-9b4c-566401bf3c85 service placement] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:13:54.642592 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58322c1f-146d-4b1f-9b4c-566401bf3c85 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:13:54.644619 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-58322c1f-146d-4b1f-9b4c-566401bf3c85 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:13:54.657921 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58322c1f-146d-4b1f-9b4c-566401bf3c85 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:13:54.659632 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58322c1f-146d-4b1f-9b4c-566401bf3c85 service placement] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:13:54.671296 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1171/2328] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 10:13:54 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:13:54.764107 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c796a23d-daf1-48cc-8870-92f43009e600 service neutron] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:13:54.766458 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-c796a23d-daf1-48cc-8870-92f43009e600 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:13:54.780563 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c796a23d-daf1-48cc-8870-92f43009e600 service neutron] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:13:54.787030 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ac2f3d-c95d-41bd-949e-47bd1f8e52ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:13:54.788031 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ac2f3d-c95d-41bd-949e-47bd1f8e52ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:13:54.788405 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ac2f3d-c95d-41bd-949e-47bd1f8e52ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:13:54.788761 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ac2f3d-c95d-41bd-949e-47bd1f8e52ea admin admin] PATH_INFO: `/v3/users/f50c3855aa764c2fb86c48c90eb9e15c` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:13:54.790119 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ac2f3d-c95d-41bd-949e-47bd1f8e52ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=f50c3855aa764c2fb86c48c90eb9e15c)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:13:54.792370 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ac2f3d-c95d-41bd-949e-47bd1f8e52ea admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:13:54.838358 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:13:54.878755 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-d2ac2f3d-c95d-41bd-949e-47bd1f8e52ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f50c3855aa764c2fb86c48c90eb9e15c'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:13:54.887017 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-d2ac2f3d-c95d-41bd-949e-47bd1f8e52ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f50c3855aa764c2fb86c48c90eb9e15c'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:13:54.887881 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-d2ac2f3d-c95d-41bd-949e-47bd1f8e52ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f50c3855aa764c2fb86c48c90eb9e15c'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:13:54.896300 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-d2ac2f3d-c95d-41bd-949e-47bd1f8e52ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f50c3855aa764c2fb86c48c90eb9e15c'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:13:54.897251 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-d2ac2f3d-c95d-41bd-949e-47bd1f8e52ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f50c3855aa764c2fb86c48c90eb9e15c'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:13:54.916463 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1158/2329] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 14 10:13:54 2022] DELETE /identity/v3/users/f50c3855aa764c2fb86c48c90eb9e15c => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:13:55.169519 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58322c1f-146d-4b1f-9b4c-566401bf3c85 service placement] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:13:55.184976 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58322c1f-146d-4b1f-9b4c-566401bf3c85 service placement] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:13:55.260416 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40551b03-671d-4146-8808-35a06fc722a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:13:55.261286 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40551b03-671d-4146-8808-35a06fc722a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:13:55.261655 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40551b03-671d-4146-8808-35a06fc722a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:13:55.261999 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40551b03-671d-4146-8808-35a06fc722a0 admin admin] PATH_INFO: `/v3/projects/e4d87102c8234c7f9ba0c1a6299ba3d7` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:13:55.263325 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40551b03-671d-4146-8808-35a06fc722a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4d87102c8234c7f9ba0c1a6299ba3d7)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:13:55.265285 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40551b03-671d-4146-8808-35a06fc722a0 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:13:55.305432 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:13:55.319492 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-40551b03-671d-4146-8808-35a06fc722a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'request_id': 'req-40551b03-671d-4146-8808-35a06fc722a0'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:13:55.326624 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-40551b03-671d-4146-8808-35a06fc722a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'request_id': 'req-40551b03-671d-4146-8808-35a06fc722a0'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:13:55.337651 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-40551b03-671d-4146-8808-35a06fc722a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'request_id': 'req-40551b03-671d-4146-8808-35a06fc722a0'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:13:55.354220 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-40551b03-671d-4146-8808-35a06fc722a0 admin admin] The token cache is being invalidate because project e4d87102c8234c7f9ba0c1a6299ba3d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:13:55.354668 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-40551b03-671d-4146-8808-35a06fc722a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:13:55.355416 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-40551b03-671d-4146-8808-35a06fc722a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:13:55.357299 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1172/2330] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 14 10:13:55 2022] DELETE /identity/v3/projects/e4d87102c8234c7f9ba0c1a6299ba3d7 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:13:55.362863 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534cbd64-96ff-4ee5-9012-acaa9fc38bf9 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:13:55.363157 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534cbd64-96ff-4ee5-9012-acaa9fc38bf9 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:13:55.363436 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534cbd64-96ff-4ee5-9012-acaa9fc38bf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:13:55.422109 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-534cbd64-96ff-4ee5-9012-acaa9fc38bf9 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:13:55.424164 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-534cbd64-96ff-4ee5-9012-acaa9fc38bf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:13:55.488537 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1159/2331] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 10:13:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:13:55.496361 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815ee975-2a31-4ffc-8af8-8813f382b06d None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:13:55.496654 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815ee975-2a31-4ffc-8af8-8813f382b06d None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:13:55.496936 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815ee975-2a31-4ffc-8af8-8813f382b06d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:13:55.517596 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-815ee975-2a31-4ffc-8af8-8813f382b06d None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:13:55.518974 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-815ee975-2a31-4ffc-8af8-8813f382b06d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:13:55.541050 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1173/2332] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 10:13:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:13:55.545118 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534cbd64-96ff-4ee5-9012-acaa9fc38bf9 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:13:55.564212 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534cbd64-96ff-4ee5-9012-acaa9fc38bf9 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:13:55.568967 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d08f053-c5b4-417c-9fde-6c2137d4a0f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:13:55.570080 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d08f053-c5b4-417c-9fde-6c2137d4a0f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:13:55.570080 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d08f053-c5b4-417c-9fde-6c2137d4a0f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:13:55.570324 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d08f053-c5b4-417c-9fde-6c2137d4a0f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:13:55.571237 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d08f053-c5b4-417c-9fde-6c2137d4a0f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:13:55.571551 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d08f053-c5b4-417c-9fde-6c2137d4a0f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:13:55.573170 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d08f053-c5b4-417c-9fde-6c2137d4a0f4 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:13:55.590641 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1160/2333] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jul 14 10:13:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:13:55.591589 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815ee975-2a31-4ffc-8af8-8813f382b06d None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:13:55.601808 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815ee975-2a31-4ffc-8af8-8813f382b06d None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:13:55.607039 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ad0f39-5468-4cf0-8e79-3875a1cbefb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:13:55.607722 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ad0f39-5468-4cf0-8e79-3875a1cbefb9 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:13:55.608009 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ad0f39-5468-4cf0-8e79-3875a1cbefb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:13:55.608286 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ad0f39-5468-4cf0-8e79-3875a1cbefb9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:13:55.609400 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ad0f39-5468-4cf0-8e79-3875a1cbefb9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:13:55.611747 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ad0f39-5468-4cf0-8e79-3875a1cbefb9 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:13:55.657062 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1174/2334] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 14 10:13:55 2022] POST /identity/v3/projects => generated 367 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 10:13:55.658442 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d08f053-c5b4-417c-9fde-6c2137d4a0f4 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:13:55.669116 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d08f053-c5b4-417c-9fde-6c2137d4a0f4 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:13:55.733794 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd3b638-8692-4fd6-9ff3-f3083fedea07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:13:55.734515 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd3b638-8692-4fd6-9ff3-f3083fedea07 admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:13:55.734805 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd3b638-8692-4fd6-9ff3-f3083fedea07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:13:55.735089 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd3b638-8692-4fd6-9ff3-f3083fedea07 admin admin] PATH_INFO: `/v3/users` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:13:55.735841 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd3b638-8692-4fd6-9ff3-f3083fedea07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:13:55.737779 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd3b638-8692-4fd6-9ff3-f3083fedea07 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:13:55.744700 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:13:55.764492 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1161/2335] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 14 10:13:55 2022] POST /identity/v3/users => generated 284 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:13:55.765986 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ad0f39-5468-4cf0-8e79-3875a1cbefb9 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:13:55.777385 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ad0f39-5468-4cf0-8e79-3875a1cbefb9 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:13:55.783058 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf99c26a-4cd7-4d87-805c-34e82e876da6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:13:55.783780 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf99c26a-4cd7-4d87-805c-34e82e876da6 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:13:55.784074 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf99c26a-4cd7-4d87-805c-34e82e876da6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:13:55.784355 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf99c26a-4cd7-4d87-805c-34e82e876da6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:13:55.785097 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf99c26a-4cd7-4d87-805c-34e82e876da6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:13:55.786861 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf99c26a-4cd7-4d87-805c-34e82e876da6 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:13:55.802560 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1175/2336] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 10:13:55 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 10:13:55.809553 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd3b638-8692-4fd6-9ff3-f3083fedea07 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:13:55.821538 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd3b638-8692-4fd6-9ff3-f3083fedea07 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:13:55.826944 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5510bdb6-72f7-4b1b-acb9-8247dad944ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:13:55.827741 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5510bdb6-72f7-4b1b-acb9-8247dad944ea admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:13:55.828130 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5510bdb6-72f7-4b1b-acb9-8247dad944ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:13:55.828483 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5510bdb6-72f7-4b1b-acb9-8247dad944ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:13:55.830004 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5510bdb6-72f7-4b1b-acb9-8247dad944ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:13:55.831799 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5510bdb6-72f7-4b1b-acb9-8247dad944ea admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:13:55.850095 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1162/2337] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 10:13:55 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:13:55.851357 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf99c26a-4cd7-4d87-805c-34e82e876da6 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:13:55.863279 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf99c26a-4cd7-4d87-805c-34e82e876da6 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:13:55.868785 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73a2175-25b7-4cfa-b003-cd6158228b79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:13:55.870213 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73a2175-25b7-4cfa-b003-cd6158228b79 admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:13:55.870666 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73a2175-25b7-4cfa-b003-cd6158228b79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:13:55.871337 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73a2175-25b7-4cfa-b003-cd6158228b79 admin admin] PATH_INFO: `/v3/projects/4c466d76505848468c2ae176b6787d94/users/aaa04ec83ec54f9289b5fb73e5119a78/roles/17dfac38a2e540fea229af7de99911bb` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:13:55.889983 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73a2175-25b7-4cfa-b003-cd6158228b79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c466d76505848468c2ae176b6787d94, user_id=aaa04ec83ec54f9289b5fb73e5119a78, role_id=17dfac38a2e540fea229af7de99911bb)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:13:55.893551 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73a2175-25b7-4cfa-b003-cd6158228b79 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:13:55.907462 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1176/2338] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 14 10:13:55 2022] PUT /identity/v3/projects/4c466d76505848468c2ae176b6787d94/users/aaa04ec83ec54f9289b5fb73e5119a78/roles/17dfac38a2e540fea229af7de99911bb => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:13:55.919664 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e084c9-fe1e-4e45-a0ce-099a67f9debc None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:13:55.920369 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e084c9-fe1e-4e45-a0ce-099a67f9debc None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:13:55.920744 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e084c9-fe1e-4e45-a0ce-099a67f9debc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:13:55.961518 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-45e084c9-fe1e-4e45-a0ce-099a67f9debc None None] MFA Rules not processed for user `aaa04ec83ec54f9289b5fb73e5119a78`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:13:55.962770 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-45e084c9-fe1e-4e45-a0ce-099a67f9debc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:13:56.036015 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1163/2339] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 10:13:55 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:13:56.048742 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73a2175-25b7-4cfa-b003-cd6158228b79 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:13:56.050501 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-f73a2175-25b7-4cfa-b003-cd6158228b79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:13:56.111177 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73a2175-25b7-4cfa-b003-cd6158228b79 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:13:56.115008 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a331511-6cd6-4ab9-b555-2c936483d157 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25048b29787d482783ebc944f1a7df65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:13:56.115677 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a331511-6cd6-4ab9-b555-2c936483d157 service cinder] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:13:56.116392 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a331511-6cd6-4ab9-b555-2c936483d157 service cinder] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:13:56.116392 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a331511-6cd6-4ab9-b555-2c936483d157 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:13:56.125164 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a331511-6cd6-4ab9-b555-2c936483d157 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:13:56.126875 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a331511-6cd6-4ab9-b555-2c936483d157 service cinder] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:13:56.136466 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1177/2340] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 10:13:56 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:13:56.711947 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa7f264-d43a-4a48-846f-626e930aed41 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:13:56.712247 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa7f264-d43a-4a48-846f-626e930aed41 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:13:56.712530 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa7f264-d43a-4a48-846f-626e930aed41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:13:56.744561 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-8aa7f264-d43a-4a48-846f-626e930aed41 None None] MFA Rules not processed for user `1d7ae3d2f56a491baf26a83a34d86ccf`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:13:56.745823 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-8aa7f264-d43a-4a48-846f-626e930aed41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:13:56.809024 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1164/2341] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 10:13:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:14:01.098090 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a331511-6cd6-4ab9-b555-2c936483d157 service cinder] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:01.099606 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-6a331511-6cd6-4ab9-b555-2c936483d157 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:14:01.225543 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a331511-6cd6-4ab9-b555-2c936483d157 service cinder] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:01.229460 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650f17e9-4947-4f56-9c42-64f70fa582b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e4a5a8965e4802a9055d332179b7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:01.230135 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650f17e9-4947-4f56-9c42-64f70fa582b0 service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:01.230669 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650f17e9-4947-4f56-9c42-64f70fa582b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:01.231113 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650f17e9-4947-4f56-9c42-64f70fa582b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:01.233468 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-650f17e9-4947-4f56-9c42-64f70fa582b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:14:01.239768 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:14:01.326125 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650f17e9-4947-4f56-9c42-64f70fa582b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:01.328224 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650f17e9-4947-4f56-9c42-64f70fa582b0 service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:01.347615 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1178/2342] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 10:14:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:14:04.382725 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa7f264-d43a-4a48-846f-626e930aed41 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:04.385926 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-8aa7f264-d43a-4a48-846f-626e930aed41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:14:04.427563 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa7f264-d43a-4a48-846f-626e930aed41 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:04.452203 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c55763f-ff7a-4587-9541-4a058f1661da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:04.457016 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c55763f-ff7a-4587-9541-4a058f1661da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:04.457505 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c55763f-ff7a-4587-9541-4a058f1661da admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:04.457977 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c55763f-ff7a-4587-9541-4a058f1661da admin admin] PATH_INFO: `/v3/users/93132e89a8ed42e58754ff9009d95a2b` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:04.459680 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c55763f-ff7a-4587-9541-4a058f1661da admin admin] RBAC: Authorizing `identity:delete_user(user_id=93132e89a8ed42e58754ff9009d95a2b)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:04.462024 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c55763f-ff7a-4587-9541-4a058f1661da admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:04.567074 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-9c55763f-ff7a-4587-9541-4a058f1661da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93132e89a8ed42e58754ff9009d95a2b'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:04.580565 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-9c55763f-ff7a-4587-9541-4a058f1661da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93132e89a8ed42e58754ff9009d95a2b'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:04.581338 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-9c55763f-ff7a-4587-9541-4a058f1661da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93132e89a8ed42e58754ff9009d95a2b'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:04.586403 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:INSERT=4,keystone:SELECT=88,keystone:DELETE=8 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:14:04.601214 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-9c55763f-ff7a-4587-9541-4a058f1661da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93132e89a8ed42e58754ff9009d95a2b'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:04.602574 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-9c55763f-ff7a-4587-9541-4a058f1661da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93132e89a8ed42e58754ff9009d95a2b'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:04.636346 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1165/2343] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 14 10:14:04 2022] DELETE /identity/v3/users/93132e89a8ed42e58754ff9009d95a2b => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:14:04.904388 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650f17e9-4947-4f56-9c42-64f70fa582b0 service neutron] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:04.921054 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650f17e9-4947-4f56-9c42-64f70fa582b0 service neutron] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:05.018611 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8430c61f-7aac-4fc2-a2b9-097f8efd592a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:05.019551 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8430c61f-7aac-4fc2-a2b9-097f8efd592a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:05.019842 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8430c61f-7aac-4fc2-a2b9-097f8efd592a admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:05.020381 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8430c61f-7aac-4fc2-a2b9-097f8efd592a admin admin] PATH_INFO: `/v3/projects/6d48c64f286a4510a83d07bd9eb9449e` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:05.021852 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8430c61f-7aac-4fc2-a2b9-097f8efd592a admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d48c64f286a4510a83d07bd9eb9449e)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:05.031064 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8430c61f-7aac-4fc2-a2b9-097f8efd592a admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:05.093210 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-8430c61f-7aac-4fc2-a2b9-097f8efd592a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d48c64f286a4510a83d07bd9eb9449e', 'request_id': 'req-8430c61f-7aac-4fc2-a2b9-097f8efd592a'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:05.100318 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-8430c61f-7aac-4fc2-a2b9-097f8efd592a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d48c64f286a4510a83d07bd9eb9449e', 'request_id': 'req-8430c61f-7aac-4fc2-a2b9-097f8efd592a'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:05.107089 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-8430c61f-7aac-4fc2-a2b9-097f8efd592a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d48c64f286a4510a83d07bd9eb9449e', 'request_id': 'req-8430c61f-7aac-4fc2-a2b9-097f8efd592a'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:05.127061 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-8430c61f-7aac-4fc2-a2b9-097f8efd592a admin admin] The token cache is being invalidate because project 6d48c64f286a4510a83d07bd9eb9449e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:14:05.127672 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-8430c61f-7aac-4fc2-a2b9-097f8efd592a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:05.128338 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-8430c61f-7aac-4fc2-a2b9-097f8efd592a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:05.129909 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1179/2344] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 14 10:14:04 2022] DELETE /identity/v3/projects/6d48c64f286a4510a83d07bd9eb9449e => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:14:05.133917 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c55763f-ff7a-4587-9541-4a058f1661da admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:05.135347 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-9c55763f-ff7a-4587-9541-4a058f1661da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:14:05.149063 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c55763f-ff7a-4587-9541-4a058f1661da admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:05.216525 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d89add0-3fe4-463e-b202-bf527fb05124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:05.217404 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d89add0-3fe4-463e-b202-bf527fb05124 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:05.217696 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d89add0-3fe4-463e-b202-bf527fb05124 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:05.217960 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d89add0-3fe4-463e-b202-bf527fb05124 admin admin] PATH_INFO: `/v3/users/6f0537acb3d948dc8b756cf45c8347e1` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:05.234325 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d89add0-3fe4-463e-b202-bf527fb05124 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f0537acb3d948dc8b756cf45c8347e1)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:05.237828 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d89add0-3fe4-463e-b202-bf527fb05124 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:05.308218 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-9d89add0-3fe4-463e-b202-bf527fb05124 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f0537acb3d948dc8b756cf45c8347e1'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:05.315944 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8430c61f-7aac-4fc2-a2b9-097f8efd592a admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:05.317378 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-8430c61f-7aac-4fc2-a2b9-097f8efd592a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:14:05.327176 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-9d89add0-3fe4-463e-b202-bf527fb05124 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f0537acb3d948dc8b756cf45c8347e1'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:05.328428 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-9d89add0-3fe4-463e-b202-bf527fb05124 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f0537acb3d948dc8b756cf45c8347e1'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:05.330545 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8430c61f-7aac-4fc2-a2b9-097f8efd592a admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:05.336124 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420b69d4-a889-48c7-b779-fd8ddabe6765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:05.337215 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420b69d4-a889-48c7-b779-fd8ddabe6765 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:05.337498 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420b69d4-a889-48c7-b779-fd8ddabe6765 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:05.337715 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420b69d4-a889-48c7-b779-fd8ddabe6765 admin admin] PATH_INFO: `/v3/users/f1d0b9390f474de79828a675d4e0646a` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:05.339243 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420b69d4-a889-48c7-b779-fd8ddabe6765 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1d0b9390f474de79828a675d4e0646a)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:05.341217 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420b69d4-a889-48c7-b779-fd8ddabe6765 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:05.341821 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-9d89add0-3fe4-463e-b202-bf527fb05124 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f0537acb3d948dc8b756cf45c8347e1'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:05.342766 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-9d89add0-3fe4-463e-b202-bf527fb05124 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f0537acb3d948dc8b756cf45c8347e1'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:05.379949 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1166/2345] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 14 10:14:05 2022] DELETE /identity/v3/users/6f0537acb3d948dc8b756cf45c8347e1 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:14:05.380768 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:14:05.408664 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-420b69d4-a889-48c7-b779-fd8ddabe6765 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1d0b9390f474de79828a675d4e0646a'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:05.441457 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-420b69d4-a889-48c7-b779-fd8ddabe6765 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1d0b9390f474de79828a675d4e0646a'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:05.442848 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-420b69d4-a889-48c7-b779-fd8ddabe6765 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1d0b9390f474de79828a675d4e0646a'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:05.463582 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-420b69d4-a889-48c7-b779-fd8ddabe6765 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1d0b9390f474de79828a675d4e0646a'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:05.477580 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-420b69d4-a889-48c7-b779-fd8ddabe6765 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1d0b9390f474de79828a675d4e0646a'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:05.492415 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1180/2346] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 14 10:14:05 2022] DELETE /identity/v3/users/f1d0b9390f474de79828a675d4e0646a => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:14:05.911926 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d89add0-3fe4-463e-b202-bf527fb05124 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:05.914356 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-9d89add0-3fe4-463e-b202-bf527fb05124 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:14:06.024700 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420b69d4-a889-48c7-b779-fd8ddabe6765 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:06.028168 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-420b69d4-a889-48c7-b779-fd8ddabe6765 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:14:06.043058 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:14:06.103807 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d89add0-3fe4-463e-b202-bf527fb05124 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:06.116149 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420b69d4-a889-48c7-b779-fd8ddabe6765 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:06.119679 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c88988-bbd3-43b9-8c58-385b8dabef3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:06.121524 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c88988-bbd3-43b9-8c58-385b8dabef3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:06.121702 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67642e0-dd45-49c1-b7d0-1699e142aee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:06.122035 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c88988-bbd3-43b9-8c58-385b8dabef3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:06.122394 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c88988-bbd3-43b9-8c58-385b8dabef3d admin admin] PATH_INFO: `/v3/projects/badd2f59d0904d9a80c947eb8f50bce5` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:06.122679 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67642e0-dd45-49c1-b7d0-1699e142aee1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:06.123218 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67642e0-dd45-49c1-b7d0-1699e142aee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:06.123514 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67642e0-dd45-49c1-b7d0-1699e142aee1 admin admin] PATH_INFO: `/v3/projects/f35a70c5090a4570ad8ba3701dad3f80` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:06.125048 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67642e0-dd45-49c1-b7d0-1699e142aee1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f35a70c5090a4570ad8ba3701dad3f80)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:06.128130 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67642e0-dd45-49c1-b7d0-1699e142aee1 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:06.159752 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c88988-bbd3-43b9-8c58-385b8dabef3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=badd2f59d0904d9a80c947eb8f50bce5)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:06.162899 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c88988-bbd3-43b9-8c58-385b8dabef3d admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:06.219715 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-f67642e0-dd45-49c1-b7d0-1699e142aee1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f35a70c5090a4570ad8ba3701dad3f80', 'request_id': 'req-f67642e0-dd45-49c1-b7d0-1699e142aee1'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:06.227690 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-f67642e0-dd45-49c1-b7d0-1699e142aee1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f35a70c5090a4570ad8ba3701dad3f80', 'request_id': 'req-f67642e0-dd45-49c1-b7d0-1699e142aee1'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:06.240472 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-f67642e0-dd45-49c1-b7d0-1699e142aee1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f35a70c5090a4570ad8ba3701dad3f80', 'request_id': 'req-f67642e0-dd45-49c1-b7d0-1699e142aee1'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:06.254150 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-e7c88988-bbd3-43b9-8c58-385b8dabef3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'badd2f59d0904d9a80c947eb8f50bce5', 'request_id': 'req-e7c88988-bbd3-43b9-8c58-385b8dabef3d'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:06.267102 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-f67642e0-dd45-49c1-b7d0-1699e142aee1 admin admin] The token cache is being invalidate because project f35a70c5090a4570ad8ba3701dad3f80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:14:06.268150 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-f67642e0-dd45-49c1-b7d0-1699e142aee1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:06.269273 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-f67642e0-dd45-49c1-b7d0-1699e142aee1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:06.272092 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-e7c88988-bbd3-43b9-8c58-385b8dabef3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'badd2f59d0904d9a80c947eb8f50bce5', 'request_id': 'req-e7c88988-bbd3-43b9-8c58-385b8dabef3d'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:06.273071 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1181/2347] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 14 10:14:06 2022] DELETE /identity/v3/projects/f35a70c5090a4570ad8ba3701dad3f80 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:14:06.282142 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97d4b24-d298-4118-8dfb-5ec4de6a159a None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:06.282867 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97d4b24-d298-4118-8dfb-5ec4de6a159a None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:06.283366 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97d4b24-d298-4118-8dfb-5ec4de6a159a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:06.283650 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-e7c88988-bbd3-43b9-8c58-385b8dabef3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'badd2f59d0904d9a80c947eb8f50bce5', 'request_id': 'req-e7c88988-bbd3-43b9-8c58-385b8dabef3d'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:06.305472 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-e7c88988-bbd3-43b9-8c58-385b8dabef3d admin admin] The token cache is being invalidate because project badd2f59d0904d9a80c947eb8f50bce5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:14:06.305821 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-e7c88988-bbd3-43b9-8c58-385b8dabef3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:06.306511 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-e7c88988-bbd3-43b9-8c58-385b8dabef3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:06.326230 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1167/2348] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 14 10:14:05 2022] DELETE /identity/v3/projects/badd2f59d0904d9a80c947eb8f50bce5 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:14:06.326531 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-c97d4b24-d298-4118-8dfb-5ec4de6a159a None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:14:06.326531 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-c97d4b24-d298-4118-8dfb-5ec4de6a159a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:14:06.408462 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:14:06.539378 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1182/2349] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 10:14:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:14:06.553995 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bb0b56-8189-4432-88e2-c752054b2340 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:06.554821 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bb0b56-8189-4432-88e2-c752054b2340 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:06.555263 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bb0b56-8189-4432-88e2-c752054b2340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:06.588487 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-00bb0b56-8189-4432-88e2-c752054b2340 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:14:06.590015 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-00bb0b56-8189-4432-88e2-c752054b2340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:14:06.600370 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1168/2350] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 10:14:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:14:06.613313 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97d4b24-d298-4118-8dfb-5ec4de6a159a None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:06.643613 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97d4b24-d298-4118-8dfb-5ec4de6a159a None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:06.660720 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aff6075-2261-4bec-8993-d2686e4294ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:06.661907 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aff6075-2261-4bec-8993-d2686e4294ef admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:06.662291 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aff6075-2261-4bec-8993-d2686e4294ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:06.662791 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aff6075-2261-4bec-8993-d2686e4294ef admin admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:06.664221 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aff6075-2261-4bec-8993-d2686e4294ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:14:06.664952 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aff6075-2261-4bec-8993-d2686e4294ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:06.669630 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aff6075-2261-4bec-8993-d2686e4294ef admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:06.701376 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bb0b56-8189-4432-88e2-c752054b2340 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:06.701573 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1183/2351] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jul 14 10:14:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:14:06.705327 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352d1169-f55a-4ff4-a335-5fc6a933f4fa None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:06.705980 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352d1169-f55a-4ff4-a335-5fc6a933f4fa None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:06.706502 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352d1169-f55a-4ff4-a335-5fc6a933f4fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:06.719402 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bb0b56-8189-4432-88e2-c752054b2340 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:06.734708 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2dc9ed-2817-46be-a825-f46b08a3c956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:06.739142 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2dc9ed-2817-46be-a825-f46b08a3c956 admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:06.740839 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2dc9ed-2817-46be-a825-f46b08a3c956 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:06.741212 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2dc9ed-2817-46be-a825-f46b08a3c956 admin admin] PATH_INFO: `/v3/projects` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:06.743578 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2dc9ed-2817-46be-a825-f46b08a3c956 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:06.749929 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2dc9ed-2817-46be-a825-f46b08a3c956 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:06.763062 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-352d1169-f55a-4ff4-a335-5fc6a933f4fa None None] MFA Rules not processed for user `08962a3ebb194189b2ab68e62fee6e60`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:14:06.764469 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-352d1169-f55a-4ff4-a335-5fc6a933f4fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:14:06.813641 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1169/2352] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 14 10:14:06 2022] POST /identity/v3/projects => generated 379 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:14:06.819056 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2dc9ed-2817-46be-a825-f46b08a3c956 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:06.888603 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1184/2353] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 10:14:06 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:14:06.911859 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2dc9ed-2817-46be-a825-f46b08a3c956 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:06.923167 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4085708d-502c-4ea3-b7ae-1b856485f0ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:06.929895 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4085708d-502c-4ea3-b7ae-1b856485f0ce admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:06.930225 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4085708d-502c-4ea3-b7ae-1b856485f0ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:06.930525 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4085708d-502c-4ea3-b7ae-1b856485f0ce admin admin] PATH_INFO: `/v3/users` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:06.931209 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4085708d-502c-4ea3-b7ae-1b856485f0ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:06.933171 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4085708d-502c-4ea3-b7ae-1b856485f0ce admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:06.965179 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352d1169-f55a-4ff4-a335-5fc6a933f4fa None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:06.977290 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1170/2354] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 14 10:14:06 2022] POST /identity/v3/users => generated 290 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:14:06.979638 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352d1169-f55a-4ff4-a335-5fc6a933f4fa None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:06.985481 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64afc048-980f-4743-b804-d4b1e2cf1cb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:06.987278 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64afc048-980f-4743-b804-d4b1e2cf1cb3 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:06.987278 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64afc048-980f-4743-b804-d4b1e2cf1cb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:06.987278 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64afc048-980f-4743-b804-d4b1e2cf1cb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:06.988275 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64afc048-980f-4743-b804-d4b1e2cf1cb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:06.989975 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64afc048-980f-4743-b804-d4b1e2cf1cb3 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:07.005845 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4085708d-502c-4ea3-b7ae-1b856485f0ce admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:07.015917 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1185/2355] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 10:14:06 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:14:07.019093 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4085708d-502c-4ea3-b7ae-1b856485f0ce admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:07.024402 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378b3e5e-b76b-4294-baf8-0ddf36e0e3bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:07.024901 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378b3e5e-b76b-4294-baf8-0ddf36e0e3bf admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:07.025333 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378b3e5e-b76b-4294-baf8-0ddf36e0e3bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:07.025617 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378b3e5e-b76b-4294-baf8-0ddf36e0e3bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:07.026384 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378b3e5e-b76b-4294-baf8-0ddf36e0e3bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:07.028027 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378b3e5e-b76b-4294-baf8-0ddf36e0e3bf admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:07.048492 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64afc048-980f-4743-b804-d4b1e2cf1cb3 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:07.058584 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1171/2356] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 10:14:07 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 10:14:07.060038 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64afc048-980f-4743-b804-d4b1e2cf1cb3 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:07.067289 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0fb6e8-3aaa-40e0-9f62-ffbbb04bd23c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:07.068213 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0fb6e8-3aaa-40e0-9f62-ffbbb04bd23c admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:07.068512 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0fb6e8-3aaa-40e0-9f62-ffbbb04bd23c admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:07.068787 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0fb6e8-3aaa-40e0-9f62-ffbbb04bd23c admin admin] PATH_INFO: `/v3/projects/a808c6541e4f423bb26e275e2e69f282/users/27a5d70a8ab8426abe86b999198ea16d/roles/17dfac38a2e540fea229af7de99911bb` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:07.090762 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0fb6e8-3aaa-40e0-9f62-ffbbb04bd23c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a808c6541e4f423bb26e275e2e69f282, user_id=27a5d70a8ab8426abe86b999198ea16d, role_id=17dfac38a2e540fea229af7de99911bb)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:07.093416 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0fb6e8-3aaa-40e0-9f62-ffbbb04bd23c admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:07.114313 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1186/2357] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 14 10:14:07 2022] PUT /identity/v3/projects/a808c6541e4f423bb26e275e2e69f282/users/27a5d70a8ab8426abe86b999198ea16d/roles/17dfac38a2e540fea229af7de99911bb => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:14:07.123077 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb104db9-a192-4bbe-9386-afced8e3a4f9 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:07.123792 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb104db9-a192-4bbe-9386-afced8e3a4f9 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:07.124337 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb104db9-a192-4bbe-9386-afced8e3a4f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:07.156561 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-eb104db9-a192-4bbe-9386-afced8e3a4f9 None None] MFA Rules not processed for user `27a5d70a8ab8426abe86b999198ea16d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:14:07.158844 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-eb104db9-a192-4bbe-9386-afced8e3a4f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:14:07.165735 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:14:07.244802 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1172/2358] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 10:14:07 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:14:07.249408 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0fb6e8-3aaa-40e0-9f62-ffbbb04bd23c admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:07.321187 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0fb6e8-3aaa-40e0-9f62-ffbbb04bd23c admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:07.325887 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79598a5-625c-4519-acf4-56892d5b15ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:07.326596 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79598a5-625c-4519-acf4-56892d5b15ad admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:07.326918 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79598a5-625c-4519-acf4-56892d5b15ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:07.327196 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79598a5-625c-4519-acf4-56892d5b15ad admin admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:07.327951 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79598a5-625c-4519-acf4-56892d5b15ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:07.329862 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79598a5-625c-4519-acf4-56892d5b15ad admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:07.365310 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1187/2359] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 14 10:14:07 2022] POST /identity/v3/projects => generated 379 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 10:14:07.366430 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb104db9-a192-4bbe-9386-afced8e3a4f9 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:07.379164 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb104db9-a192-4bbe-9386-afced8e3a4f9 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:07.440051 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972ec333-cd7f-4fae-bad7-48bf3d290e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:07.440739 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972ec333-cd7f-4fae-bad7-48bf3d290e9b admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:07.441021 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972ec333-cd7f-4fae-bad7-48bf3d290e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:07.441335 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972ec333-cd7f-4fae-bad7-48bf3d290e9b admin admin] PATH_INFO: `/v3/users` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:07.442006 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972ec333-cd7f-4fae-bad7-48bf3d290e9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:07.443948 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972ec333-cd7f-4fae-bad7-48bf3d290e9b admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:07.465232 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1173/2360] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 14 10:14:07 2022] POST /identity/v3/users => generated 296 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:14:07.469146 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79598a5-625c-4519-acf4-56892d5b15ad admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:07.480239 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79598a5-625c-4519-acf4-56892d5b15ad admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:07.486220 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1bf043-daab-42fa-b481-097524fc9595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:07.487112 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1bf043-daab-42fa-b481-097524fc9595 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:07.487347 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1bf043-daab-42fa-b481-097524fc9595 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:07.487637 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1bf043-daab-42fa-b481-097524fc9595 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:07.488381 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1bf043-daab-42fa-b481-097524fc9595 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:07.490053 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1bf043-daab-42fa-b481-097524fc9595 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:07.495428 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:14:07.510622 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1188/2361] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 10:14:07 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:14:07.513059 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972ec333-cd7f-4fae-bad7-48bf3d290e9b admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:07.523848 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972ec333-cd7f-4fae-bad7-48bf3d290e9b admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:07.528576 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9320c5cb-d484-4476-919d-a6ca8c76ac25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:07.529718 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9320c5cb-d484-4476-919d-a6ca8c76ac25 admin admin] REQUEST_METHOD: `PUT` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:07.529873 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9320c5cb-d484-4476-919d-a6ca8c76ac25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:07.530043 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9320c5cb-d484-4476-919d-a6ca8c76ac25 admin admin] PATH_INFO: `/v3/projects/d5c633f563cd4392aef03bff4a4bebf2/users/3cfc34f2cb4542069e00c2f6dd84fe97/roles/e3965bd0d5f1427a86a313c0c90bfef3` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:07.550432 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9320c5cb-d484-4476-919d-a6ca8c76ac25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5c633f563cd4392aef03bff4a4bebf2, user_id=3cfc34f2cb4542069e00c2f6dd84fe97, role_id=e3965bd0d5f1427a86a313c0c90bfef3)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:07.558147 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9320c5cb-d484-4476-919d-a6ca8c76ac25 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:07.569128 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1174/2362] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 14 10:14:07 2022] PUT /identity/v3/projects/d5c633f563cd4392aef03bff4a4bebf2/users/3cfc34f2cb4542069e00c2f6dd84fe97/roles/e3965bd0d5f1427a86a313c0c90bfef3 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:14:07.573133 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1bf043-daab-42fa-b481-097524fc9595 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:07.583852 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1bf043-daab-42fa-b481-097524fc9595 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:07.705389 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ce208e-75d4-4cc2-99a9-80371516083f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:07.706232 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ce208e-75d4-4cc2-99a9-80371516083f admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:07.706630 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ce208e-75d4-4cc2-99a9-80371516083f admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:07.707078 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ce208e-75d4-4cc2-99a9-80371516083f admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:07.708077 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ce208e-75d4-4cc2-99a9-80371516083f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:07.710083 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ce208e-75d4-4cc2-99a9-80371516083f admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:07.722169 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1189/2363] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 10:14:07 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:14:07.726308 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9320c5cb-d484-4476-919d-a6ca8c76ac25 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:07.738325 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9320c5cb-d484-4476-919d-a6ca8c76ac25 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:07.744409 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464d61e1-a4c6-4d2f-8533-a454d6cb6f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:07.745435 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464d61e1-a4c6-4d2f-8533-a454d6cb6f25 admin admin] REQUEST_METHOD: `PUT` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:07.745925 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464d61e1-a4c6-4d2f-8533-a454d6cb6f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:07.746424 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464d61e1-a4c6-4d2f-8533-a454d6cb6f25 admin admin] PATH_INFO: `/v3/projects/d5c633f563cd4392aef03bff4a4bebf2/users/3cfc34f2cb4542069e00c2f6dd84fe97/roles/e3965bd0d5f1427a86a313c0c90bfef3` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:07.748624 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464d61e1-a4c6-4d2f-8533-a454d6cb6f25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5c633f563cd4392aef03bff4a4bebf2, user_id=3cfc34f2cb4542069e00c2f6dd84fe97, role_id=e3965bd0d5f1427a86a313c0c90bfef3)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:07.752143 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464d61e1-a4c6-4d2f-8533-a454d6cb6f25 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:07.781705 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1175/2364] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 14 10:14:07 2022] PUT /identity/v3/projects/d5c633f563cd4392aef03bff4a4bebf2/users/3cfc34f2cb4542069e00c2f6dd84fe97/roles/e3965bd0d5f1427a86a313c0c90bfef3 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:14:07.793156 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cf9b64-f2b4-401d-98a9-ec2d6416f278 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:07.793470 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cf9b64-f2b4-401d-98a9-ec2d6416f278 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:07.793893 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cf9b64-f2b4-401d-98a9-ec2d6416f278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:07.828836 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-83cf9b64-f2b4-401d-98a9-ec2d6416f278 None None] MFA Rules not processed for user `3cfc34f2cb4542069e00c2f6dd84fe97`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:14:07.830607 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-83cf9b64-f2b4-401d-98a9-ec2d6416f278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:14:07.919870 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1190/2365] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 10:14:07 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:14:07.927465 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464d61e1-a4c6-4d2f-8533-a454d6cb6f25 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:07.929870 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-464d61e1-a4c6-4d2f-8533-a454d6cb6f25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:14:07.993388 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464d61e1-a4c6-4d2f-8533-a454d6cb6f25 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:07.997615 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd9b41a-fae8-4597-95af-00416fcb4239 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25048b29787d482783ebc944f1a7df65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:07.998437 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd9b41a-fae8-4597-95af-00416fcb4239 service cinder] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:07.998685 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd9b41a-fae8-4597-95af-00416fcb4239 service cinder] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:07.998962 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd9b41a-fae8-4597-95af-00416fcb4239 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:08.010112 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd9b41a-fae8-4597-95af-00416fcb4239 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:08.012053 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd9b41a-fae8-4597-95af-00416fcb4239 service cinder] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:08.029512 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1176/2366] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 10:14:07 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:14:08.123728 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cf9b64-f2b4-401d-98a9-ec2d6416f278 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:08.134052 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cf9b64-f2b4-401d-98a9-ec2d6416f278 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:08.137802 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fec5285-f40f-4702-8730-15b507b675af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25048b29787d482783ebc944f1a7df65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:08.138498 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fec5285-f40f-4702-8730-15b507b675af service cinder] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:08.138790 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fec5285-f40f-4702-8730-15b507b675af service cinder] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:08.139074 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fec5285-f40f-4702-8730-15b507b675af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:08.200530 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fec5285-f40f-4702-8730-15b507b675af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:08.202165 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fec5285-f40f-4702-8730-15b507b675af service cinder] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:08.212935 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1191/2367] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 10:14:08 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:14:17.863234 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd9b41a-fae8-4597-95af-00416fcb4239 service cinder] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:17.864706 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-5fd9b41a-fae8-4597-95af-00416fcb4239 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:14:17.869114 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:14:17.938962 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd9b41a-fae8-4597-95af-00416fcb4239 service cinder] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:17.942761 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673c736c-536f-4274-bf06-752f3dcb350d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e4a5a8965e4802a9055d332179b7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:17.943419 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673c736c-536f-4274-bf06-752f3dcb350d service neutron] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:17.943701 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673c736c-536f-4274-bf06-752f3dcb350d service neutron] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:17.943979 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673c736c-536f-4274-bf06-752f3dcb350d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:17.945721 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-673c736c-536f-4274-bf06-752f3dcb350d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:14:17.955314 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673c736c-536f-4274-bf06-752f3dcb350d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:17.956770 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673c736c-536f-4274-bf06-752f3dcb350d service neutron] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:17.965341 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1177/2368] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 10:14:17 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:14:18.208375 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=92 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:14:18.585581 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fec5285-f40f-4702-8730-15b507b675af service cinder] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:18.587661 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-7fec5285-f40f-4702-8730-15b507b675af service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:14:18.721415 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fec5285-f40f-4702-8730-15b507b675af service cinder] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:18.727966 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6221086d-8689-4a43-b922-9a1ec4d4c97d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:18.729378 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6221086d-8689-4a43-b922-9a1ec4d4c97d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:18.729673 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6221086d-8689-4a43-b922-9a1ec4d4c97d admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:18.729955 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6221086d-8689-4a43-b922-9a1ec4d4c97d admin admin] PATH_INFO: `/v3/users/aaa04ec83ec54f9289b5fb73e5119a78` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:18.731303 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6221086d-8689-4a43-b922-9a1ec4d4c97d admin admin] RBAC: Authorizing `identity:delete_user(user_id=aaa04ec83ec54f9289b5fb73e5119a78)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:18.733539 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6221086d-8689-4a43-b922-9a1ec4d4c97d admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:18.832635 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-6221086d-8689-4a43-b922-9a1ec4d4c97d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aaa04ec83ec54f9289b5fb73e5119a78'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:18.868664 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-6221086d-8689-4a43-b922-9a1ec4d4c97d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aaa04ec83ec54f9289b5fb73e5119a78'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:18.870771 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-6221086d-8689-4a43-b922-9a1ec4d4c97d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aaa04ec83ec54f9289b5fb73e5119a78'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:18.885644 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-6221086d-8689-4a43-b922-9a1ec4d4c97d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aaa04ec83ec54f9289b5fb73e5119a78'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:18.901403 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-6221086d-8689-4a43-b922-9a1ec4d4c97d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aaa04ec83ec54f9289b5fb73e5119a78'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:18.926110 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1192/2369] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 14 10:14:18 2022] DELETE /identity/v3/users/aaa04ec83ec54f9289b5fb73e5119a78 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:14:18.928196 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7a4088-af44-4186-ad35-ef9b88093682 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:18.928892 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7a4088-af44-4186-ad35-ef9b88093682 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:18.928892 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7a4088-af44-4186-ad35-ef9b88093682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:18.961459 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-be7a4088-af44-4186-ad35-ef9b88093682 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:14:18.962945 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-be7a4088-af44-4186-ad35-ef9b88093682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:14:19.046270 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1178/2370] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 10:14:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:14:19.054536 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6221086d-8689-4a43-b922-9a1ec4d4c97d admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:19.056149 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-6221086d-8689-4a43-b922-9a1ec4d4c97d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:14:19.127293 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6221086d-8689-4a43-b922-9a1ec4d4c97d admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:19.131461 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da509739-f702-4cfe-a868-a9859d8da1a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e4a5a8965e4802a9055d332179b7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:19.132139 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da509739-f702-4cfe-a868-a9859d8da1a3 service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:19.132428 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da509739-f702-4cfe-a868-a9859d8da1a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:19.132762 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da509739-f702-4cfe-a868-a9859d8da1a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:19.146633 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da509739-f702-4cfe-a868-a9859d8da1a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:19.148190 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da509739-f702-4cfe-a868-a9859d8da1a3 service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:19.167222 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1193/2371] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 10:14:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:14:19.593453 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7a4088-af44-4186-ad35-ef9b88093682 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:19.594986 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-be7a4088-af44-4186-ad35-ef9b88093682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:14:19.613255 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7a4088-af44-4186-ad35-ef9b88093682 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:19.619227 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c6f622-e5fd-484d-8022-ba8aab2fb9d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:19.620213 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c6f622-e5fd-484d-8022-ba8aab2fb9d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:19.620619 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c6f622-e5fd-484d-8022-ba8aab2fb9d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:19.620964 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c6f622-e5fd-484d-8022-ba8aab2fb9d4 admin admin] PATH_INFO: `/v3/projects/4c466d76505848468c2ae176b6787d94` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:19.622412 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c6f622-e5fd-484d-8022-ba8aab2fb9d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c466d76505848468c2ae176b6787d94)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:19.624894 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c6f622-e5fd-484d-8022-ba8aab2fb9d4 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:19.691801 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-43c6f622-e5fd-484d-8022-ba8aab2fb9d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c466d76505848468c2ae176b6787d94', 'request_id': 'req-43c6f622-e5fd-484d-8022-ba8aab2fb9d4'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:19.699698 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-43c6f622-e5fd-484d-8022-ba8aab2fb9d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c466d76505848468c2ae176b6787d94', 'request_id': 'req-43c6f622-e5fd-484d-8022-ba8aab2fb9d4'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:19.706638 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-43c6f622-e5fd-484d-8022-ba8aab2fb9d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c466d76505848468c2ae176b6787d94', 'request_id': 'req-43c6f622-e5fd-484d-8022-ba8aab2fb9d4'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:19.719153 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-43c6f622-e5fd-484d-8022-ba8aab2fb9d4 admin admin] The token cache is being invalidate because project 4c466d76505848468c2ae176b6787d94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:14:19.719452 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-43c6f622-e5fd-484d-8022-ba8aab2fb9d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:19.720142 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-43c6f622-e5fd-484d-8022-ba8aab2fb9d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:19.722029 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1179/2372] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 14 10:14:19 2022] DELETE /identity/v3/projects/4c466d76505848468c2ae176b6787d94 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:14:19.728414 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b557a38-f2bd-4bb5-b22c-bd514f66e883 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:19.728995 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b557a38-f2bd-4bb5-b22c-bd514f66e883 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:19.729364 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b557a38-f2bd-4bb5-b22c-bd514f66e883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:19.749934 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-2b557a38-f2bd-4bb5-b22c-bd514f66e883 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:14:19.750953 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-2b557a38-f2bd-4bb5-b22c-bd514f66e883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:14:19.771333 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:14:19.829294 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1194/2373] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 10:14:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:14:19.836650 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f379671c-adc7-4327-a592-c1a7955c03ff None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:19.836943 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f379671c-adc7-4327-a592-c1a7955c03ff None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:19.837223 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f379671c-adc7-4327-a592-c1a7955c03ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:19.860240 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-f379671c-adc7-4327-a592-c1a7955c03ff None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:14:19.862068 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-f379671c-adc7-4327-a592-c1a7955c03ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:14:19.870495 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1180/2374] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 10:14:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:14:19.874695 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b557a38-f2bd-4bb5-b22c-bd514f66e883 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:19.885540 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b557a38-f2bd-4bb5-b22c-bd514f66e883 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:19.890360 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c196ef-0511-44d6-baec-460c2e004d71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:19.891082 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c196ef-0511-44d6-baec-460c2e004d71 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:19.891400 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c196ef-0511-44d6-baec-460c2e004d71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:19.891684 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c196ef-0511-44d6-baec-460c2e004d71 admin admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:19.892457 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c196ef-0511-44d6-baec-460c2e004d71 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:14:19.892766 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c196ef-0511-44d6-baec-460c2e004d71 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:19.894451 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c196ef-0511-44d6-baec-460c2e004d71 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:19.907298 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1195/2375] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jul 14 10:14:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:14:19.912007 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f379671c-adc7-4327-a592-c1a7955c03ff None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:19.921533 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f379671c-adc7-4327-a592-c1a7955c03ff None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:19.926838 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70b7a18-58d1-4360-807f-fbcf85b6b123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:19.927757 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70b7a18-58d1-4360-807f-fbcf85b6b123 admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:19.928038 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70b7a18-58d1-4360-807f-fbcf85b6b123 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:19.928313 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70b7a18-58d1-4360-807f-fbcf85b6b123 admin admin] PATH_INFO: `/v3/projects` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:19.929021 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70b7a18-58d1-4360-807f-fbcf85b6b123 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:19.930959 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70b7a18-58d1-4360-807f-fbcf85b6b123 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:19.940454 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:14:19.959697 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1181/2376] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 14 10:14:19 2022] POST /identity/v3/projects => generated 363 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 10:14:19.963811 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c196ef-0511-44d6-baec-460c2e004d71 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:19.974140 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c196ef-0511-44d6-baec-460c2e004d71 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:20.030559 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a423c7-f2d0-4ebd-aa91-738f4a8f35d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:20.031246 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a423c7-f2d0-4ebd-aa91-738f4a8f35d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:20.031529 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a423c7-f2d0-4ebd-aa91-738f4a8f35d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:20.031818 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a423c7-f2d0-4ebd-aa91-738f4a8f35d6 admin admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:20.033033 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a423c7-f2d0-4ebd-aa91-738f4a8f35d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:20.034975 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a423c7-f2d0-4ebd-aa91-738f4a8f35d6 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:20.060710 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1196/2377] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 14 10:14:19 2022] POST /identity/v3/users => generated 282 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 10:14:20.061932 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70b7a18-58d1-4360-807f-fbcf85b6b123 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:20.074633 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70b7a18-58d1-4360-807f-fbcf85b6b123 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:20.079550 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f841c09-caa7-45bf-a829-54236b33ddaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:20.080534 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f841c09-caa7-45bf-a829-54236b33ddaa admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:20.080990 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f841c09-caa7-45bf-a829-54236b33ddaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:20.081327 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f841c09-caa7-45bf-a829-54236b33ddaa admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:20.082062 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f841c09-caa7-45bf-a829-54236b33ddaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:20.083881 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f841c09-caa7-45bf-a829-54236b33ddaa admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:20.099314 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1182/2378] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 10:14:20 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:14:20.103397 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a423c7-f2d0-4ebd-aa91-738f4a8f35d6 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:20.115782 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a423c7-f2d0-4ebd-aa91-738f4a8f35d6 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:20.120983 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afee480f-f6fc-4d60-a3a3-52efb85dcc79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:20.121714 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afee480f-f6fc-4d60-a3a3-52efb85dcc79 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:20.122150 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afee480f-f6fc-4d60-a3a3-52efb85dcc79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:20.122674 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afee480f-f6fc-4d60-a3a3-52efb85dcc79 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:20.124288 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afee480f-f6fc-4d60-a3a3-52efb85dcc79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:20.127295 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afee480f-f6fc-4d60-a3a3-52efb85dcc79 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:20.140273 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1197/2379] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 10:14:20 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:14:20.144327 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f841c09-caa7-45bf-a829-54236b33ddaa admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:20.155030 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f841c09-caa7-45bf-a829-54236b33ddaa admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:20.160801 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99b8c1a-6adf-4dc0-9718-cd57091365b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:20.161844 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99b8c1a-6adf-4dc0-9718-cd57091365b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:20.162126 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99b8c1a-6adf-4dc0-9718-cd57091365b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:20.162477 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99b8c1a-6adf-4dc0-9718-cd57091365b1 admin admin] PATH_INFO: `/v3/projects/c9e58ccd317744288f6a759d17b56ab1/users/906f74893ee74150a5f48cb102be1ef3/roles/17dfac38a2e540fea229af7de99911bb` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:20.188058 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99b8c1a-6adf-4dc0-9718-cd57091365b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9e58ccd317744288f6a759d17b56ab1, user_id=906f74893ee74150a5f48cb102be1ef3, role_id=17dfac38a2e540fea229af7de99911bb)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:20.191118 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99b8c1a-6adf-4dc0-9718-cd57091365b1 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:20.205461 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1183/2380] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 14 10:14:20 2022] PUT /identity/v3/projects/c9e58ccd317744288f6a759d17b56ab1/users/906f74893ee74150a5f48cb102be1ef3/roles/17dfac38a2e540fea229af7de99911bb => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:14:20.216931 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeb5c1b-177e-4309-be89-ce7d11e8b7ad None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:20.217224 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeb5c1b-177e-4309-be89-ce7d11e8b7ad None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:20.217505 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeb5c1b-177e-4309-be89-ce7d11e8b7ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:20.245902 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-2aeb5c1b-177e-4309-be89-ce7d11e8b7ad None None] MFA Rules not processed for user `906f74893ee74150a5f48cb102be1ef3`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:14:20.247165 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-2aeb5c1b-177e-4309-be89-ce7d11e8b7ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:14:20.327190 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1198/2381] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 10:14:20 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:14:20.332485 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99b8c1a-6adf-4dc0-9718-cd57091365b1 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:20.418126 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99b8c1a-6adf-4dc0-9718-cd57091365b1 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:20.424222 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8d534c-9c19-49cc-87a0-4df39e536923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:20.424892 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8d534c-9c19-49cc-87a0-4df39e536923 admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:20.425181 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8d534c-9c19-49cc-87a0-4df39e536923 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:20.425458 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8d534c-9c19-49cc-87a0-4df39e536923 admin admin] PATH_INFO: `/v3/projects` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:20.426157 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8d534c-9c19-49cc-87a0-4df39e536923 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:20.428347 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8d534c-9c19-49cc-87a0-4df39e536923 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:20.464739 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aeb5c1b-177e-4309-be89-ce7d11e8b7ad None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:20.467625 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1184/2382] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 14 10:14:20 2022] POST /identity/v3/projects => generated 365 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:14:20.476592 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aeb5c1b-177e-4309-be89-ce7d11e8b7ad None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:20.498141 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:14:20.573484 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850ab6a8-9400-42fd-a6a2-0f4836df2f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:20.574619 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850ab6a8-9400-42fd-a6a2-0f4836df2f91 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:20.574777 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850ab6a8-9400-42fd-a6a2-0f4836df2f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:20.575114 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850ab6a8-9400-42fd-a6a2-0f4836df2f91 admin admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:20.575963 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850ab6a8-9400-42fd-a6a2-0f4836df2f91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:20.578128 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850ab6a8-9400-42fd-a6a2-0f4836df2f91 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:20.602615 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1199/2383] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 14 10:14:20 2022] POST /identity/v3/users => generated 289 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 10:14:20.606954 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8d534c-9c19-49cc-87a0-4df39e536923 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:20.618355 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8d534c-9c19-49cc-87a0-4df39e536923 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:20.623978 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4dbd5d-033d-445d-8151-9a7359df678e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:20.624888 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4dbd5d-033d-445d-8151-9a7359df678e admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:20.625320 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4dbd5d-033d-445d-8151-9a7359df678e admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:20.625674 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4dbd5d-033d-445d-8151-9a7359df678e admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:20.627494 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4dbd5d-033d-445d-8151-9a7359df678e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:20.629517 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4dbd5d-033d-445d-8151-9a7359df678e admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:20.643686 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1185/2384] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 10:14:20 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:14:20.647814 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850ab6a8-9400-42fd-a6a2-0f4836df2f91 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:20.658546 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850ab6a8-9400-42fd-a6a2-0f4836df2f91 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:20.664794 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2eac4b-6ff4-4af0-b8af-8b07a16150f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:20.665756 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2eac4b-6ff4-4af0-b8af-8b07a16150f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:20.666169 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2eac4b-6ff4-4af0-b8af-8b07a16150f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:20.666530 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2eac4b-6ff4-4af0-b8af-8b07a16150f9 admin admin] PATH_INFO: `/v3/projects/49242d3f37b8401cb96478dba63f10ed/users/be1c07cb4e1346dba2650493b2f54899/roles/e3965bd0d5f1427a86a313c0c90bfef3` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:20.684361 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2eac4b-6ff4-4af0-b8af-8b07a16150f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49242d3f37b8401cb96478dba63f10ed, user_id=be1c07cb4e1346dba2650493b2f54899, role_id=e3965bd0d5f1427a86a313c0c90bfef3)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:20.687757 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2eac4b-6ff4-4af0-b8af-8b07a16150f9 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:20.702726 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1200/2385] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 14 10:14:20 2022] PUT /identity/v3/projects/49242d3f37b8401cb96478dba63f10ed/users/be1c07cb4e1346dba2650493b2f54899/roles/e3965bd0d5f1427a86a313c0c90bfef3 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:14:20.707204 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4dbd5d-033d-445d-8151-9a7359df678e admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:20.717630 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4dbd5d-033d-445d-8151-9a7359df678e admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:20.774979 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6579293-4587-4655-a08e-d6ab37c05702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:20.775662 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6579293-4587-4655-a08e-d6ab37c05702 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:20.775953 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6579293-4587-4655-a08e-d6ab37c05702 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:20.776238 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6579293-4587-4655-a08e-d6ab37c05702 admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:20.776971 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6579293-4587-4655-a08e-d6ab37c05702 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:20.778629 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6579293-4587-4655-a08e-d6ab37c05702 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:20.788967 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1186/2386] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 10:14:20 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:14:20.793061 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2eac4b-6ff4-4af0-b8af-8b07a16150f9 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:20.804417 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2eac4b-6ff4-4af0-b8af-8b07a16150f9 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:20.809390 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad775ba7-c172-4cd6-8233-ff08aee6983f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:20.810596 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad775ba7-c172-4cd6-8233-ff08aee6983f admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:20.811058 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad775ba7-c172-4cd6-8233-ff08aee6983f admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:20.811496 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad775ba7-c172-4cd6-8233-ff08aee6983f admin admin] PATH_INFO: `/v3/projects/49242d3f37b8401cb96478dba63f10ed/users/be1c07cb4e1346dba2650493b2f54899/roles/e3965bd0d5f1427a86a313c0c90bfef3` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:20.814207 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad775ba7-c172-4cd6-8233-ff08aee6983f admin admin] RBAC: Authorizing `identity:create_grant(project_id=49242d3f37b8401cb96478dba63f10ed, user_id=be1c07cb4e1346dba2650493b2f54899, role_id=e3965bd0d5f1427a86a313c0c90bfef3)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:20.816446 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad775ba7-c172-4cd6-8233-ff08aee6983f admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:20.827490 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1201/2387] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 14 10:14:20 2022] PUT /identity/v3/projects/49242d3f37b8401cb96478dba63f10ed/users/be1c07cb4e1346dba2650493b2f54899/roles/e3965bd0d5f1427a86a313c0c90bfef3 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:14:20.837627 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1db6a15-d109-425c-b633-e77f052d6265 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:20.837940 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1db6a15-d109-425c-b633-e77f052d6265 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:20.838261 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1db6a15-d109-425c-b633-e77f052d6265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:20.865819 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-e1db6a15-d109-425c-b633-e77f052d6265 None None] MFA Rules not processed for user `be1c07cb4e1346dba2650493b2f54899`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:14:20.867140 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-e1db6a15-d109-425c-b633-e77f052d6265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:14:20.879152 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:14:20.936121 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1187/2388] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 10:14:20 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 10:14:20.947577 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad775ba7-c172-4cd6-8233-ff08aee6983f admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:20.949319 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-ad775ba7-c172-4cd6-8233-ff08aee6983f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:14:21.007311 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad775ba7-c172-4cd6-8233-ff08aee6983f admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:21.010939 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca75d3cc-5f8b-47fa-8c1b-c1c23ae0e386 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25048b29787d482783ebc944f1a7df65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:21.011595 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca75d3cc-5f8b-47fa-8c1b-c1c23ae0e386 service cinder] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:21.011880 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca75d3cc-5f8b-47fa-8c1b-c1c23ae0e386 service cinder] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:21.012158 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca75d3cc-5f8b-47fa-8c1b-c1c23ae0e386 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:21.022178 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca75d3cc-5f8b-47fa-8c1b-c1c23ae0e386 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:21.023666 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca75d3cc-5f8b-47fa-8c1b-c1c23ae0e386 service cinder] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:21.034436 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1202/2389] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 10:14:20 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:14:21.108581 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1db6a15-d109-425c-b633-e77f052d6265 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:21.118725 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1db6a15-d109-425c-b633-e77f052d6265 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:21.122430 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed1dbe6-b027-4ca3-b4cb-b2d3c25a2d2e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25048b29787d482783ebc944f1a7df65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:21.123074 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed1dbe6-b027-4ca3-b4cb-b2d3c25a2d2e service cinder] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:21.123366 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed1dbe6-b027-4ca3-b4cb-b2d3c25a2d2e service cinder] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:21.123644 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed1dbe6-b027-4ca3-b4cb-b2d3c25a2d2e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:21.189219 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed1dbe6-b027-4ca3-b4cb-b2d3c25a2d2e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:21.190709 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed1dbe6-b027-4ca3-b4cb-b2d3c25a2d2e service cinder] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:21.199853 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1188/2390] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 10:14:21 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:14:21.568494 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca75d3cc-5f8b-47fa-8c1b-c1c23ae0e386 service cinder] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:21.570454 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-ca75d3cc-5f8b-47fa-8c1b-c1c23ae0e386 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:14:21.659371 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca75d3cc-5f8b-47fa-8c1b-c1c23ae0e386 service cinder] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:21.666774 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d619bd-f8b4-4936-84cc-6cddd2cf6f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:21.667843 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d619bd-f8b4-4936-84cc-6cddd2cf6f97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:21.668214 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d619bd-f8b4-4936-84cc-6cddd2cf6f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:21.668582 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d619bd-f8b4-4936-84cc-6cddd2cf6f97 admin admin] PATH_INFO: `/v3/users/27a5d70a8ab8426abe86b999198ea16d` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:21.670066 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d619bd-f8b4-4936-84cc-6cddd2cf6f97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=27a5d70a8ab8426abe86b999198ea16d)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:21.673210 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d619bd-f8b4-4936-84cc-6cddd2cf6f97 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:21.691673 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:14:21.731804 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-91d619bd-f8b4-4936-84cc-6cddd2cf6f97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27a5d70a8ab8426abe86b999198ea16d'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:21.746075 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-91d619bd-f8b4-4936-84cc-6cddd2cf6f97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27a5d70a8ab8426abe86b999198ea16d'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:21.747076 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-91d619bd-f8b4-4936-84cc-6cddd2cf6f97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27a5d70a8ab8426abe86b999198ea16d'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:21.757336 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-91d619bd-f8b4-4936-84cc-6cddd2cf6f97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27a5d70a8ab8426abe86b999198ea16d'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:21.766967 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-91d619bd-f8b4-4936-84cc-6cddd2cf6f97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27a5d70a8ab8426abe86b999198ea16d'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:21.780626 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1203/2391] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 14 10:14:21 2022] DELETE /identity/v3/users/27a5d70a8ab8426abe86b999198ea16d => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:14:21.783684 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269506df-876a-4c50-96ce-adc029d9ba12 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:21.784310 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269506df-876a-4c50-96ce-adc029d9ba12 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:21.784950 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269506df-876a-4c50-96ce-adc029d9ba12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:21.812377 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-269506df-876a-4c50-96ce-adc029d9ba12 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:14:21.814345 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-269506df-876a-4c50-96ce-adc029d9ba12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:14:21.874924 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1189/2392] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 10:14:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:14:21.885015 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d619bd-f8b4-4936-84cc-6cddd2cf6f97 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:21.886575 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-91d619bd-f8b4-4936-84cc-6cddd2cf6f97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:14:21.946033 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d619bd-f8b4-4936-84cc-6cddd2cf6f97 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:21.949740 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3ae8f8-e4ec-48ea-b771-b18960a43b8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e4a5a8965e4802a9055d332179b7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:21.950417 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3ae8f8-e4ec-48ea-b771-b18960a43b8e service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:21.950706 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3ae8f8-e4ec-48ea-b771-b18960a43b8e service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:21.950986 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3ae8f8-e4ec-48ea-b771-b18960a43b8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:21.960418 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3ae8f8-e4ec-48ea-b771-b18960a43b8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:21.961837 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3ae8f8-e4ec-48ea-b771-b18960a43b8e service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:21.971255 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1204/2393] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 10:14:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:14:22.271803 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269506df-876a-4c50-96ce-adc029d9ba12 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:22.273375 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-269506df-876a-4c50-96ce-adc029d9ba12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:14:22.286223 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269506df-876a-4c50-96ce-adc029d9ba12 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:22.293248 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1decbb6c-f61b-4770-ae95-c22bb102717d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:22.294145 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1decbb6c-f61b-4770-ae95-c22bb102717d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:22.294502 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1decbb6c-f61b-4770-ae95-c22bb102717d admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:22.294791 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1decbb6c-f61b-4770-ae95-c22bb102717d admin admin] PATH_INFO: `/v3/projects/a808c6541e4f423bb26e275e2e69f282` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:22.296051 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1decbb6c-f61b-4770-ae95-c22bb102717d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a808c6541e4f423bb26e275e2e69f282)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:22.298059 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1decbb6c-f61b-4770-ae95-c22bb102717d admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:22.345830 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:14:22.349516 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-1decbb6c-f61b-4770-ae95-c22bb102717d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a808c6541e4f423bb26e275e2e69f282', 'request_id': 'req-1decbb6c-f61b-4770-ae95-c22bb102717d'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:22.358672 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-1decbb6c-f61b-4770-ae95-c22bb102717d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a808c6541e4f423bb26e275e2e69f282', 'request_id': 'req-1decbb6c-f61b-4770-ae95-c22bb102717d'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:22.365254 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-1decbb6c-f61b-4770-ae95-c22bb102717d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a808c6541e4f423bb26e275e2e69f282', 'request_id': 'req-1decbb6c-f61b-4770-ae95-c22bb102717d'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:22.379996 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-1decbb6c-f61b-4770-ae95-c22bb102717d admin admin] The token cache is being invalidate because project a808c6541e4f423bb26e275e2e69f282 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:14:22.380230 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-1decbb6c-f61b-4770-ae95-c22bb102717d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:22.380963 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-1decbb6c-f61b-4770-ae95-c22bb102717d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:22.382860 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1190/2394] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 14 10:14:22 2022] DELETE /identity/v3/projects/a808c6541e4f423bb26e275e2e69f282 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:14:22.387104 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3ae8f8-e4ec-48ea-b771-b18960a43b8e service neutron] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:22.397729 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3ae8f8-e4ec-48ea-b771-b18960a43b8e service neutron] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:22.596332 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a98592-486e-4769-a17f-888cf90df2c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:22.597901 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a98592-486e-4769-a17f-888cf90df2c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:22.598219 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a98592-486e-4769-a17f-888cf90df2c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:22.598520 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a98592-486e-4769-a17f-888cf90df2c1 admin admin] PATH_INFO: `/v3/users/3cfc34f2cb4542069e00c2f6dd84fe97` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:22.600139 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a98592-486e-4769-a17f-888cf90df2c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3cfc34f2cb4542069e00c2f6dd84fe97)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:22.602428 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a98592-486e-4769-a17f-888cf90df2c1 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:22.670513 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:14:22.682922 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-86a98592-486e-4769-a17f-888cf90df2c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3cfc34f2cb4542069e00c2f6dd84fe97'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:22.696807 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-86a98592-486e-4769-a17f-888cf90df2c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3cfc34f2cb4542069e00c2f6dd84fe97'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:22.697522 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-86a98592-486e-4769-a17f-888cf90df2c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3cfc34f2cb4542069e00c2f6dd84fe97'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:22.705404 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-86a98592-486e-4769-a17f-888cf90df2c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3cfc34f2cb4542069e00c2f6dd84fe97'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:22.712941 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-86a98592-486e-4769-a17f-888cf90df2c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3cfc34f2cb4542069e00c2f6dd84fe97'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:22.719275 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1205/2395] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 14 10:14:22 2022] DELETE /identity/v3/users/3cfc34f2cb4542069e00c2f6dd84fe97 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:14:23.065788 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1decbb6c-f61b-4770-ae95-c22bb102717d admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:23.067270 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-1decbb6c-f61b-4770-ae95-c22bb102717d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:14:23.084590 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1decbb6c-f61b-4770-ae95-c22bb102717d admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:23.166067 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f5a71d-7813-4494-903c-f5ccccf55d0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:23.167250 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f5a71d-7813-4494-903c-f5ccccf55d0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:23.167538 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f5a71d-7813-4494-903c-f5ccccf55d0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:23.167819 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f5a71d-7813-4494-903c-f5ccccf55d0a admin admin] PATH_INFO: `/v3/projects/d5c633f563cd4392aef03bff4a4bebf2` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:23.169030 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f5a71d-7813-4494-903c-f5ccccf55d0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5c633f563cd4392aef03bff4a4bebf2)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:23.171018 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f5a71d-7813-4494-903c-f5ccccf55d0a admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:23.223208 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-00f5a71d-7813-4494-903c-f5ccccf55d0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5c633f563cd4392aef03bff4a4bebf2', 'request_id': 'req-00f5a71d-7813-4494-903c-f5ccccf55d0a'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:23.231569 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-00f5a71d-7813-4494-903c-f5ccccf55d0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5c633f563cd4392aef03bff4a4bebf2', 'request_id': 'req-00f5a71d-7813-4494-903c-f5ccccf55d0a'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:23.238366 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-00f5a71d-7813-4494-903c-f5ccccf55d0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5c633f563cd4392aef03bff4a4bebf2', 'request_id': 'req-00f5a71d-7813-4494-903c-f5ccccf55d0a'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:23.250984 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-00f5a71d-7813-4494-903c-f5ccccf55d0a admin admin] The token cache is being invalidate because project d5c633f563cd4392aef03bff4a4bebf2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:14:23.251270 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-00f5a71d-7813-4494-903c-f5ccccf55d0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:23.252040 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-00f5a71d-7813-4494-903c-f5ccccf55d0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:23.253608 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1191/2396] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 14 10:14:23 2022] DELETE /identity/v3/projects/d5c633f563cd4392aef03bff4a4bebf2 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:14:23.258600 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e82fdb-db36-4d56-898d-24583dd71630 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:23.259162 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e82fdb-db36-4d56-898d-24583dd71630 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:23.259162 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e82fdb-db36-4d56-898d-24583dd71630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:23.277745 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-c9e82fdb-db36-4d56-898d-24583dd71630 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:14:23.278996 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-c9e82fdb-db36-4d56-898d-24583dd71630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:14:23.338095 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1206/2397] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 10:14:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:14:23.348787 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48dcce6-d521-42c4-bab6-10adf4d9efc7 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:23.349357 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48dcce6-d521-42c4-bab6-10adf4d9efc7 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:23.349784 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48dcce6-d521-42c4-bab6-10adf4d9efc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:23.372803 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-a48dcce6-d521-42c4-bab6-10adf4d9efc7 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:14:23.374052 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-a48dcce6-d521-42c4-bab6-10adf4d9efc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:14:23.383234 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1192/2398] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 10:14:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:14:23.387414 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e82fdb-db36-4d56-898d-24583dd71630 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:23.399035 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e82fdb-db36-4d56-898d-24583dd71630 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:23.404370 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95028498-8617-4dc5-a41b-afc086382620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:23.405047 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95028498-8617-4dc5-a41b-afc086382620 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:23.405496 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95028498-8617-4dc5-a41b-afc086382620 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:23.405775 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95028498-8617-4dc5-a41b-afc086382620 admin admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:23.407176 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95028498-8617-4dc5-a41b-afc086382620 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:14:23.407468 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95028498-8617-4dc5-a41b-afc086382620 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:23.411341 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95028498-8617-4dc5-a41b-afc086382620 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:23.430439 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1207/2399] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jul 14 10:14:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:14:23.434796 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48dcce6-d521-42c4-bab6-10adf4d9efc7 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:23.455955 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48dcce6-d521-42c4-bab6-10adf4d9efc7 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:23.465161 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc34b5eb-5d43-4815-b3f7-093b5caf1572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:23.466915 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc34b5eb-5d43-4815-b3f7-093b5caf1572 admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:23.467213 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc34b5eb-5d43-4815-b3f7-093b5caf1572 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:23.467498 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc34b5eb-5d43-4815-b3f7-093b5caf1572 admin admin] PATH_INFO: `/v3/projects` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:23.468232 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc34b5eb-5d43-4815-b3f7-093b5caf1572 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:23.472129 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc34b5eb-5d43-4815-b3f7-093b5caf1572 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:23.518072 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1193/2400] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 14 10:14:23 2022] POST /identity/v3/projects => generated 365 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:14:23.519220 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95028498-8617-4dc5-a41b-afc086382620 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:23.530238 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95028498-8617-4dc5-a41b-afc086382620 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:23.629145 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c42929f-8060-47c1-89c9-f3dac78c3955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:23.629847 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c42929f-8060-47c1-89c9-f3dac78c3955 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:23.630132 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c42929f-8060-47c1-89c9-f3dac78c3955 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:23.630461 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c42929f-8060-47c1-89c9-f3dac78c3955 admin admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:23.631333 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c42929f-8060-47c1-89c9-f3dac78c3955 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:23.633698 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c42929f-8060-47c1-89c9-f3dac78c3955 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:23.659843 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1208/2401] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 14 10:14:23 2022] POST /identity/v3/users => generated 283 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:14:23.661092 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc34b5eb-5d43-4815-b3f7-093b5caf1572 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:23.673776 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc34b5eb-5d43-4815-b3f7-093b5caf1572 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:23.679374 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cda49e-4ae1-4b76-bf8b-3fb63ec61651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:23.680057 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cda49e-4ae1-4b76-bf8b-3fb63ec61651 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:23.680345 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cda49e-4ae1-4b76-bf8b-3fb63ec61651 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:23.680633 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cda49e-4ae1-4b76-bf8b-3fb63ec61651 admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:23.681380 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cda49e-4ae1-4b76-bf8b-3fb63ec61651 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:23.683043 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cda49e-4ae1-4b76-bf8b-3fb63ec61651 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:23.695505 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1194/2402] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 10:14:23 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 10:14:23.699431 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c42929f-8060-47c1-89c9-f3dac78c3955 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:23.710144 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c42929f-8060-47c1-89c9-f3dac78c3955 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:23.714869 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2204923b-b44e-4f4c-ac3f-933a6e617786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:23.715542 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2204923b-b44e-4f4c-ac3f-933a6e617786 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:23.715895 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2204923b-b44e-4f4c-ac3f-933a6e617786 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:23.716115 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2204923b-b44e-4f4c-ac3f-933a6e617786 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:23.716853 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2204923b-b44e-4f4c-ac3f-933a6e617786 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:23.718488 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2204923b-b44e-4f4c-ac3f-933a6e617786 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:23.729071 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1209/2403] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 10:14:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:14:23.733392 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cda49e-4ae1-4b76-bf8b-3fb63ec61651 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:23.743831 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cda49e-4ae1-4b76-bf8b-3fb63ec61651 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:23.748628 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf611a3b-9289-491b-bce6-236239660e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:23.749515 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf611a3b-9289-491b-bce6-236239660e23 admin admin] REQUEST_METHOD: `PUT` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:23.749804 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf611a3b-9289-491b-bce6-236239660e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:23.750085 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf611a3b-9289-491b-bce6-236239660e23 admin admin] PATH_INFO: `/v3/projects/526222bf5e684c29ae439cd84a8c31d9/users/d3d6712029cc41c4b2261e8adf842a70/roles/17dfac38a2e540fea229af7de99911bb` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:23.765677 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf611a3b-9289-491b-bce6-236239660e23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=526222bf5e684c29ae439cd84a8c31d9, user_id=d3d6712029cc41c4b2261e8adf842a70, role_id=17dfac38a2e540fea229af7de99911bb)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:23.768970 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf611a3b-9289-491b-bce6-236239660e23 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:23.777151 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:14:23.784149 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1195/2404] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 14 10:14:23 2022] PUT /identity/v3/projects/526222bf5e684c29ae439cd84a8c31d9/users/d3d6712029cc41c4b2261e8adf842a70/roles/17dfac38a2e540fea229af7de99911bb => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:14:23.794641 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1bde8d-39f9-4d37-be4f-5634a4c7d1f0 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:23.794939 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1bde8d-39f9-4d37-be4f-5634a4c7d1f0 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:23.795226 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1bde8d-39f9-4d37-be4f-5634a4c7d1f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:23.832469 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-9f1bde8d-39f9-4d37-be4f-5634a4c7d1f0 None None] MFA Rules not processed for user `d3d6712029cc41c4b2261e8adf842a70`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:14:23.833981 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-9f1bde8d-39f9-4d37-be4f-5634a4c7d1f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:14:23.842985 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:14:23.901397 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1210/2405] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 10:14:23 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:14:23.905898 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf611a3b-9289-491b-bce6-236239660e23 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:23.968202 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf611a3b-9289-491b-bce6-236239660e23 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:23.973349 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe574efb-5597-49b0-8390-52ec23ea2169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:23.974014 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe574efb-5597-49b0-8390-52ec23ea2169 admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:23.974339 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe574efb-5597-49b0-8390-52ec23ea2169 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:23.974625 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe574efb-5597-49b0-8390-52ec23ea2169 admin admin] PATH_INFO: `/v3/projects` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:23.975321 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe574efb-5597-49b0-8390-52ec23ea2169 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:23.977279 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe574efb-5597-49b0-8390-52ec23ea2169 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:24.004998 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1196/2406] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 14 10:14:23 2022] POST /identity/v3/projects => generated 365 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:14:24.009043 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1bde8d-39f9-4d37-be4f-5634a4c7d1f0 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:24.020433 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1bde8d-39f9-4d37-be4f-5634a4c7d1f0 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:24.077362 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9682a062-0586-4283-80ac-c1a6959aaf69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:24.078047 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9682a062-0586-4283-80ac-c1a6959aaf69 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:24.078370 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9682a062-0586-4283-80ac-c1a6959aaf69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:24.078716 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9682a062-0586-4283-80ac-c1a6959aaf69 admin admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:24.079362 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9682a062-0586-4283-80ac-c1a6959aaf69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:24.081829 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9682a062-0586-4283-80ac-c1a6959aaf69 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:24.112268 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1211/2407] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 14 10:14:24 2022] POST /identity/v3/users => generated 289 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 10:14:24.113538 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe574efb-5597-49b0-8390-52ec23ea2169 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:24.124003 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe574efb-5597-49b0-8390-52ec23ea2169 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:24.129933 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8015934-8500-46e5-96b7-bc0e29956690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:24.130429 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8015934-8500-46e5-96b7-bc0e29956690 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:24.130708 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8015934-8500-46e5-96b7-bc0e29956690 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:24.130992 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8015934-8500-46e5-96b7-bc0e29956690 admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:24.131741 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8015934-8500-46e5-96b7-bc0e29956690 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:24.133573 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8015934-8500-46e5-96b7-bc0e29956690 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:24.147463 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1197/2408] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 10:14:24 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:14:24.151215 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9682a062-0586-4283-80ac-c1a6959aaf69 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:24.162460 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9682a062-0586-4283-80ac-c1a6959aaf69 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:24.174523 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81772b8-a972-4e08-9624-3bb6e1857995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:24.175876 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81772b8-a972-4e08-9624-3bb6e1857995 admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:24.176271 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81772b8-a972-4e08-9624-3bb6e1857995 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:24.176628 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81772b8-a972-4e08-9624-3bb6e1857995 admin admin] PATH_INFO: `/v3/projects/6decfc95cea7482b9dbc6e4b752cddec/users/75af0424ff084e818078c3c28b53143a/roles/e3965bd0d5f1427a86a313c0c90bfef3` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:24.185934 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8015934-8500-46e5-96b7-bc0e29956690 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:24.189804 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-c8015934-8500-46e5-96b7-bc0e29956690 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:14:24.199542 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81772b8-a972-4e08-9624-3bb6e1857995 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6decfc95cea7482b9dbc6e4b752cddec, user_id=75af0424ff084e818078c3c28b53143a, role_id=e3965bd0d5f1427a86a313c0c90bfef3)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:24.203489 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81772b8-a972-4e08-9624-3bb6e1857995 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:24.208438 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8015934-8500-46e5-96b7-bc0e29956690 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:24.215844 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1200ea43-ab06-4155-8a8e-622717ba7404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:24.217379 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1200ea43-ab06-4155-8a8e-622717ba7404 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:24.217670 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1200ea43-ab06-4155-8a8e-622717ba7404 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:24.217951 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1200ea43-ab06-4155-8a8e-622717ba7404 admin admin] PATH_INFO: `/v3/users/906f74893ee74150a5f48cb102be1ef3` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:24.219351 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1200ea43-ab06-4155-8a8e-622717ba7404 admin admin] RBAC: Authorizing `identity:delete_user(user_id=906f74893ee74150a5f48cb102be1ef3)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:24.221342 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1200ea43-ab06-4155-8a8e-622717ba7404 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:24.222236 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1212/2409] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 14 10:14:24 2022] PUT /identity/v3/projects/6decfc95cea7482b9dbc6e4b752cddec/users/75af0424ff084e818078c3c28b53143a/roles/e3965bd0d5f1427a86a313c0c90bfef3 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:14:24.226403 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81772b8-a972-4e08-9624-3bb6e1857995 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:24.283947 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-1200ea43-ab06-4155-8a8e-622717ba7404 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '906f74893ee74150a5f48cb102be1ef3'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:24.293428 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-1200ea43-ab06-4155-8a8e-622717ba7404 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '906f74893ee74150a5f48cb102be1ef3'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:24.294680 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-1200ea43-ab06-4155-8a8e-622717ba7404 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '906f74893ee74150a5f48cb102be1ef3'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:24.306577 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-1200ea43-ab06-4155-8a8e-622717ba7404 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '906f74893ee74150a5f48cb102be1ef3'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:24.307809 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-1200ea43-ab06-4155-8a8e-622717ba7404 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '906f74893ee74150a5f48cb102be1ef3'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:24.330549 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81772b8-a972-4e08-9624-3bb6e1857995 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:24.334762 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1198/2410] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 14 10:14:24 2022] DELETE /identity/v3/users/906f74893ee74150a5f48cb102be1ef3 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:14:24.340917 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ece2afc-9fa5-4ac1-a5cd-0830c1f25dde None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:24.341494 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ece2afc-9fa5-4ac1-a5cd-0830c1f25dde None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:24.341976 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ece2afc-9fa5-4ac1-a5cd-0830c1f25dde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:24.367594 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-7ece2afc-9fa5-4ac1-a5cd-0830c1f25dde None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:14:24.368875 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-7ece2afc-9fa5-4ac1-a5cd-0830c1f25dde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:14:24.370561 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:14:24.436123 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f7c8dc-9f7a-4d99-b20a-d3788862ecf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:24.437132 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f7c8dc-9f7a-4d99-b20a-d3788862ecf0 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:24.437433 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f7c8dc-9f7a-4d99-b20a-d3788862ecf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:24.437847 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f7c8dc-9f7a-4d99-b20a-d3788862ecf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:24.438630 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f7c8dc-9f7a-4d99-b20a-d3788862ecf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:24.440815 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f7c8dc-9f7a-4d99-b20a-d3788862ecf0 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:24.452056 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1213/2411] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 10:14:24 2022] GET /identity/v3/roles => generated 1420 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 10:14:24.456395 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f7c8dc-9f7a-4d99-b20a-d3788862ecf0 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:24.457632 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:14:24.458149 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-67f7c8dc-9f7a-4d99-b20a-d3788862ecf0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:14:24.471453 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f7c8dc-9f7a-4d99-b20a-d3788862ecf0 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:24.477691 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8dd17c-6d7d-49ca-8559-ca1dc51bd386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:24.478948 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8dd17c-6d7d-49ca-8559-ca1dc51bd386 admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:24.479432 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8dd17c-6d7d-49ca-8559-ca1dc51bd386 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:24.479713 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8dd17c-6d7d-49ca-8559-ca1dc51bd386 admin admin] PATH_INFO: `/v3/projects/6decfc95cea7482b9dbc6e4b752cddec/users/75af0424ff084e818078c3c28b53143a/roles/e3965bd0d5f1427a86a313c0c90bfef3` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:24.481725 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8dd17c-6d7d-49ca-8559-ca1dc51bd386 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6decfc95cea7482b9dbc6e4b752cddec, user_id=75af0424ff084e818078c3c28b53143a, role_id=e3965bd0d5f1427a86a313c0c90bfef3)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:24.485583 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8dd17c-6d7d-49ca-8559-ca1dc51bd386 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:24.488868 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1199/2412] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 10:14:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 10:14:24.499672 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ece2afc-9fa5-4ac1-a5cd-0830c1f25dde None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:24.500258 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1214/2413] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 14 10:14:24 2022] PUT /identity/v3/projects/6decfc95cea7482b9dbc6e4b752cddec/users/75af0424ff084e818078c3c28b53143a/roles/e3965bd0d5f1427a86a313c0c90bfef3 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:14:24.507379 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-7ece2afc-9fa5-4ac1-a5cd-0830c1f25dde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:14:24.511849 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6356a3b8-5a53-406c-995c-912a868ba605 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:24.512251 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6356a3b8-5a53-406c-995c-912a868ba605 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:24.512812 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6356a3b8-5a53-406c-995c-912a868ba605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:24.558150 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-6356a3b8-5a53-406c-995c-912a868ba605 None None] MFA Rules not processed for user `75af0424ff084e818078c3c28b53143a`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:14:24.559503 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-6356a3b8-5a53-406c-995c-912a868ba605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:14:24.589399 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ece2afc-9fa5-4ac1-a5cd-0830c1f25dde None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:24.658515 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1215/2414] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 10:14:24 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:14:24.669579 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6356a3b8-5a53-406c-995c-912a868ba605 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:24.679491 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-6356a3b8-5a53-406c-995c-912a868ba605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:14:24.685280 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f27fa2-fd06-4335-91f5-6d401ba17b3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e4a5a8965e4802a9055d332179b7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:24.685949 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f27fa2-fd06-4335-91f5-6d401ba17b3e service neutron] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:24.686341 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f27fa2-fd06-4335-91f5-6d401ba17b3e service neutron] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:24.687524 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f27fa2-fd06-4335-91f5-6d401ba17b3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:24.746258 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6356a3b8-5a53-406c-995c-912a868ba605 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:24.749972 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7a81bf-309c-4190-a6b5-e86c533314b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25048b29787d482783ebc944f1a7df65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:24.750751 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7a81bf-309c-4190-a6b5-e86c533314b6 service cinder] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:24.751107 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7a81bf-309c-4190-a6b5-e86c533314b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:24.751562 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7a81bf-309c-4190-a6b5-e86c533314b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:24.758381 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f27fa2-fd06-4335-91f5-6d401ba17b3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:24.759913 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f27fa2-fd06-4335-91f5-6d401ba17b3e service neutron] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:24.761961 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7a81bf-309c-4190-a6b5-e86c533314b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:24.763860 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7a81bf-309c-4190-a6b5-e86c533314b6 service cinder] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:24.778855 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1216/2415] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 10:14:24 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 10:14:24.779071 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1200/2416] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 10:14:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 10:14:25.126043 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7a81bf-309c-4190-a6b5-e86c533314b6 service cinder] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:25.127557 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-aa7a81bf-309c-4190-a6b5-e86c533314b6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:14:25.143507 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7a81bf-309c-4190-a6b5-e86c533314b6 service cinder] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:25.148462 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23388ba-e6e5-4b64-908b-f20e22c9513d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:25.149469 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23388ba-e6e5-4b64-908b-f20e22c9513d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:25.149918 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23388ba-e6e5-4b64-908b-f20e22c9513d admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:25.150368 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23388ba-e6e5-4b64-908b-f20e22c9513d admin admin] PATH_INFO: `/v3/projects/c9e58ccd317744288f6a759d17b56ab1` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:25.154383 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23388ba-e6e5-4b64-908b-f20e22c9513d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9e58ccd317744288f6a759d17b56ab1)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:25.154383 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23388ba-e6e5-4b64-908b-f20e22c9513d admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:25.194680 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:14:25.213593 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-e23388ba-e6e5-4b64-908b-f20e22c9513d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9e58ccd317744288f6a759d17b56ab1', 'request_id': 'req-e23388ba-e6e5-4b64-908b-f20e22c9513d'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:25.220677 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-e23388ba-e6e5-4b64-908b-f20e22c9513d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9e58ccd317744288f6a759d17b56ab1', 'request_id': 'req-e23388ba-e6e5-4b64-908b-f20e22c9513d'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:25.227476 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f27fa2-fd06-4335-91f5-6d401ba17b3e service neutron] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:25.227673 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-e23388ba-e6e5-4b64-908b-f20e22c9513d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9e58ccd317744288f6a759d17b56ab1', 'request_id': 'req-e23388ba-e6e5-4b64-908b-f20e22c9513d'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:25.237981 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f27fa2-fd06-4335-91f5-6d401ba17b3e service neutron] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:25.240878 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-e23388ba-e6e5-4b64-908b-f20e22c9513d admin admin] The token cache is being invalidate because project c9e58ccd317744288f6a759d17b56ab1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:14:25.241176 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-e23388ba-e6e5-4b64-908b-f20e22c9513d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:25.241816 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-e23388ba-e6e5-4b64-908b-f20e22c9513d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:25.243423 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1217/2417] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 14 10:14:25 2022] DELETE /identity/v3/projects/c9e58ccd317744288f6a759d17b56ab1 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:14:25.247865 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23388ba-e6e5-4b64-908b-f20e22c9513d admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:25.249264 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-e23388ba-e6e5-4b64-908b-f20e22c9513d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:14:25.287723 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:14:25.299097 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122482d7-f6d0-44d6-a154-181aff4560d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:25.300016 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122482d7-f6d0-44d6-a154-181aff4560d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:25.300305 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122482d7-f6d0-44d6-a154-181aff4560d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:25.300591 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122482d7-f6d0-44d6-a154-181aff4560d4 admin admin] PATH_INFO: `/v3/users/d3d6712029cc41c4b2261e8adf842a70` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:25.301801 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122482d7-f6d0-44d6-a154-181aff4560d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3d6712029cc41c4b2261e8adf842a70)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:25.304049 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122482d7-f6d0-44d6-a154-181aff4560d4 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:25.316392 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23388ba-e6e5-4b64-908b-f20e22c9513d admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:25.321158 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5037e091-4638-4bf5-ace6-93e312460afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:25.322040 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5037e091-4638-4bf5-ace6-93e312460afc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:25.322361 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5037e091-4638-4bf5-ace6-93e312460afc admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:25.322647 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5037e091-4638-4bf5-ace6-93e312460afc admin admin] PATH_INFO: `/v3/users/be1c07cb4e1346dba2650493b2f54899` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:25.323880 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5037e091-4638-4bf5-ace6-93e312460afc admin admin] RBAC: Authorizing `identity:delete_user(user_id=be1c07cb4e1346dba2650493b2f54899)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:25.325802 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5037e091-4638-4bf5-ace6-93e312460afc admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:25.354387 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-122482d7-f6d0-44d6-a154-181aff4560d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3d6712029cc41c4b2261e8adf842a70'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:25.362426 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-122482d7-f6d0-44d6-a154-181aff4560d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3d6712029cc41c4b2261e8adf842a70'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:25.363221 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-122482d7-f6d0-44d6-a154-181aff4560d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3d6712029cc41c4b2261e8adf842a70'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:25.370961 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-122482d7-f6d0-44d6-a154-181aff4560d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3d6712029cc41c4b2261e8adf842a70'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:25.371985 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-122482d7-f6d0-44d6-a154-181aff4560d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3d6712029cc41c4b2261e8adf842a70'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:25.382925 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-5037e091-4638-4bf5-ace6-93e312460afc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be1c07cb4e1346dba2650493b2f54899'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:25.390399 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1201/2418] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 14 10:14:25 2022] DELETE /identity/v3/users/d3d6712029cc41c4b2261e8adf842a70 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:14:25.395493 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a0dab9-af1d-4c20-b7ae-97330af0d31f None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:25.395784 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a0dab9-af1d-4c20-b7ae-97330af0d31f None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:25.396064 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a0dab9-af1d-4c20-b7ae-97330af0d31f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:25.396517 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-5037e091-4638-4bf5-ace6-93e312460afc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be1c07cb4e1346dba2650493b2f54899'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:25.397240 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-5037e091-4638-4bf5-ace6-93e312460afc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be1c07cb4e1346dba2650493b2f54899'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:25.406298 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-5037e091-4638-4bf5-ace6-93e312460afc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be1c07cb4e1346dba2650493b2f54899'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:25.416666 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-5037e091-4638-4bf5-ace6-93e312460afc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be1c07cb4e1346dba2650493b2f54899'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:25.428027 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1218/2419] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 14 10:14:25 2022] DELETE /identity/v3/users/be1c07cb4e1346dba2650493b2f54899 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:14:25.438483 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-c8a0dab9-af1d-4c20-b7ae-97330af0d31f None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:14:25.443529 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-c8a0dab9-af1d-4c20-b7ae-97330af0d31f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:14:25.528456 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1202/2420] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 10:14:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 10:14:25.539102 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5037e091-4638-4bf5-ace6-93e312460afc admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:25.540604 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-5037e091-4638-4bf5-ace6-93e312460afc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:14:25.590436 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:14:25.614015 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5037e091-4638-4bf5-ace6-93e312460afc admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:25.619423 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d2aeee-05e5-46fd-b74c-a1337679442a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e4a5a8965e4802a9055d332179b7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:25.620108 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d2aeee-05e5-46fd-b74c-a1337679442a service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:25.620402 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d2aeee-05e5-46fd-b74c-a1337679442a service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:25.620688 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d2aeee-05e5-46fd-b74c-a1337679442a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:25.635060 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d2aeee-05e5-46fd-b74c-a1337679442a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:25.638038 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d2aeee-05e5-46fd-b74c-a1337679442a service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:25.652361 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1219/2421] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 10:14:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:14:26.113344 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a0dab9-af1d-4c20-b7ae-97330af0d31f None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:26.114937 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-c8a0dab9-af1d-4c20-b7ae-97330af0d31f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:14:26.130938 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a0dab9-af1d-4c20-b7ae-97330af0d31f None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:26.137230 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c44a41a-bae3-4ae4-b15d-b201cb8fb1bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:26.138861 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c44a41a-bae3-4ae4-b15d-b201cb8fb1bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:26.139435 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c44a41a-bae3-4ae4-b15d-b201cb8fb1bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:26.139822 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c44a41a-bae3-4ae4-b15d-b201cb8fb1bf admin admin] PATH_INFO: `/v3/projects/526222bf5e684c29ae439cd84a8c31d9` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:26.142658 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c44a41a-bae3-4ae4-b15d-b201cb8fb1bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=526222bf5e684c29ae439cd84a8c31d9)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:26.144963 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c44a41a-bae3-4ae4-b15d-b201cb8fb1bf admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:26.210172 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-8c44a41a-bae3-4ae4-b15d-b201cb8fb1bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '526222bf5e684c29ae439cd84a8c31d9', 'request_id': 'req-8c44a41a-bae3-4ae4-b15d-b201cb8fb1bf'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:26.218258 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-8c44a41a-bae3-4ae4-b15d-b201cb8fb1bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '526222bf5e684c29ae439cd84a8c31d9', 'request_id': 'req-8c44a41a-bae3-4ae4-b15d-b201cb8fb1bf'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:26.225922 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-8c44a41a-bae3-4ae4-b15d-b201cb8fb1bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '526222bf5e684c29ae439cd84a8c31d9', 'request_id': 'req-8c44a41a-bae3-4ae4-b15d-b201cb8fb1bf'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:26.227614 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:14:26.234113 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d2aeee-05e5-46fd-b74c-a1337679442a service neutron] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:26.236726 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-b9d2aeee-05e5-46fd-b74c-a1337679442a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:14:26.241376 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-8c44a41a-bae3-4ae4-b15d-b201cb8fb1bf admin admin] The token cache is being invalidate because project 526222bf5e684c29ae439cd84a8c31d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:14:26.241866 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-8c44a41a-bae3-4ae4-b15d-b201cb8fb1bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:26.243338 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-8c44a41a-bae3-4ae4-b15d-b201cb8fb1bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:26.245292 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1203/2422] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 14 10:14:26 2022] DELETE /identity/v3/projects/526222bf5e684c29ae439cd84a8c31d9 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:14:26.250298 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c44a41a-bae3-4ae4-b15d-b201cb8fb1bf admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:26.252893 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-8c44a41a-bae3-4ae4-b15d-b201cb8fb1bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:14:26.256591 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d2aeee-05e5-46fd-b74c-a1337679442a service neutron] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:26.355829 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c44a41a-bae3-4ae4-b15d-b201cb8fb1bf admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:26.360308 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27eb56da-bfc8-4b4d-8cb9-a3d8d1ee44fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:26.362081 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eb56da-bfc8-4b4d-8cb9-a3d8d1ee44fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:26.362458 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eb56da-bfc8-4b4d-8cb9-a3d8d1ee44fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:26.362818 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eb56da-bfc8-4b4d-8cb9-a3d8d1ee44fb admin admin] PATH_INFO: `/v3/projects/49242d3f37b8401cb96478dba63f10ed` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:26.362945 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156e89f9-a401-454f-b456-346d2f1c8b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:26.364093 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156e89f9-a401-454f-b456-346d2f1c8b91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:26.364444 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156e89f9-a401-454f-b456-346d2f1c8b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:26.364628 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27eb56da-bfc8-4b4d-8cb9-a3d8d1ee44fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=49242d3f37b8401cb96478dba63f10ed)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:26.364904 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156e89f9-a401-454f-b456-346d2f1c8b91 admin admin] PATH_INFO: `/v3/users/75af0424ff084e818078c3c28b53143a` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:26.366768 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156e89f9-a401-454f-b456-346d2f1c8b91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=75af0424ff084e818078c3c28b53143a)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:26.367410 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27eb56da-bfc8-4b4d-8cb9-a3d8d1ee44fb admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:26.369456 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156e89f9-a401-454f-b456-346d2f1c8b91 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:26.434434 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-156e89f9-a401-454f-b456-346d2f1c8b91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75af0424ff084e818078c3c28b53143a'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:26.441378 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-27eb56da-bfc8-4b4d-8cb9-a3d8d1ee44fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49242d3f37b8401cb96478dba63f10ed', 'request_id': 'req-27eb56da-bfc8-4b4d-8cb9-a3d8d1ee44fb'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:26.445482 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-156e89f9-a401-454f-b456-346d2f1c8b91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75af0424ff084e818078c3c28b53143a'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:26.446606 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-156e89f9-a401-454f-b456-346d2f1c8b91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75af0424ff084e818078c3c28b53143a'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:26.449548 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-27eb56da-bfc8-4b4d-8cb9-a3d8d1ee44fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49242d3f37b8401cb96478dba63f10ed', 'request_id': 'req-27eb56da-bfc8-4b4d-8cb9-a3d8d1ee44fb'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:26.455785 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-156e89f9-a401-454f-b456-346d2f1c8b91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75af0424ff084e818078c3c28b53143a'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:26.456818 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-156e89f9-a401-454f-b456-346d2f1c8b91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75af0424ff084e818078c3c28b53143a'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:26.459775 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-27eb56da-bfc8-4b4d-8cb9-a3d8d1ee44fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49242d3f37b8401cb96478dba63f10ed', 'request_id': 'req-27eb56da-bfc8-4b4d-8cb9-a3d8d1ee44fb'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:26.475854 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-27eb56da-bfc8-4b4d-8cb9-a3d8d1ee44fb admin admin] The token cache is being invalidate because project 49242d3f37b8401cb96478dba63f10ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:14:26.475854 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-27eb56da-bfc8-4b4d-8cb9-a3d8d1ee44fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:26.476815 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-27eb56da-bfc8-4b4d-8cb9-a3d8d1ee44fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:26.479112 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1220/2423] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 14 10:14:26 2022] DELETE /identity/v3/projects/49242d3f37b8401cb96478dba63f10ed => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:14:26.481366 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1204/2424] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 14 10:14:26 2022] DELETE /identity/v3/users/75af0424ff084e818078c3c28b53143a => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:14:26.484381 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211e8fe1-bffe-47f6-958e-1395c1ce0a17 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:26.484706 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211e8fe1-bffe-47f6-958e-1395c1ce0a17 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:26.485048 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211e8fe1-bffe-47f6-958e-1395c1ce0a17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:26.505088 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-211e8fe1-bffe-47f6-958e-1395c1ce0a17 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:14:26.506658 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-211e8fe1-bffe-47f6-958e-1395c1ce0a17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:14:26.583177 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1221/2425] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 10:14:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 10:14:26.590869 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9022f57a-fb58-4ae3-87c6-7e67aeb56bf1 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:26.591168 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9022f57a-fb58-4ae3-87c6-7e67aeb56bf1 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:26.591454 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9022f57a-fb58-4ae3-87c6-7e67aeb56bf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:26.612933 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-9022f57a-fb58-4ae3-87c6-7e67aeb56bf1 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:14:26.614215 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-9022f57a-fb58-4ae3-87c6-7e67aeb56bf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:14:26.624425 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1205/2426] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 10:14:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:14:26.629363 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211e8fe1-bffe-47f6-958e-1395c1ce0a17 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:26.640429 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211e8fe1-bffe-47f6-958e-1395c1ce0a17 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:26.647015 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593eaf02-25a6-44ed-97fc-a76ba9f4739c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:26.647695 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593eaf02-25a6-44ed-97fc-a76ba9f4739c admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:26.648495 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593eaf02-25a6-44ed-97fc-a76ba9f4739c admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:26.648495 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593eaf02-25a6-44ed-97fc-a76ba9f4739c admin admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:26.648975 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593eaf02-25a6-44ed-97fc-a76ba9f4739c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:14:26.649684 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593eaf02-25a6-44ed-97fc-a76ba9f4739c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:26.650946 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593eaf02-25a6-44ed-97fc-a76ba9f4739c admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:26.654895 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:14:26.672703 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1222/2427] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jul 14 10:14:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:14:26.675428 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9022f57a-fb58-4ae3-87c6-7e67aeb56bf1 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:26.685273 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9022f57a-fb58-4ae3-87c6-7e67aeb56bf1 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:26.696778 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cce9b1a-adfe-4636-a840-dc5311108390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:26.697453 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cce9b1a-adfe-4636-a840-dc5311108390 admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:26.697741 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cce9b1a-adfe-4636-a840-dc5311108390 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:26.698022 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cce9b1a-adfe-4636-a840-dc5311108390 admin admin] PATH_INFO: `/v3/projects` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:26.698863 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cce9b1a-adfe-4636-a840-dc5311108390 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:26.700853 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cce9b1a-adfe-4636-a840-dc5311108390 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:26.729518 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1206/2428] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 14 10:14:26 2022] POST /identity/v3/projects => generated 369 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:14:26.733375 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593eaf02-25a6-44ed-97fc-a76ba9f4739c admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:26.745484 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593eaf02-25a6-44ed-97fc-a76ba9f4739c admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:26.809344 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14480de6-4ad6-4321-9ce8-6b6a9db0e487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:26.810164 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14480de6-4ad6-4321-9ce8-6b6a9db0e487 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:26.810521 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14480de6-4ad6-4321-9ce8-6b6a9db0e487 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:26.810846 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14480de6-4ad6-4321-9ce8-6b6a9db0e487 admin admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:26.811572 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14480de6-4ad6-4321-9ce8-6b6a9db0e487 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:26.813506 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14480de6-4ad6-4321-9ce8-6b6a9db0e487 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:26.836051 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1223/2429] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 14 10:14:26 2022] POST /identity/v3/users => generated 285 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:14:26.840774 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cce9b1a-adfe-4636-a840-dc5311108390 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:26.852293 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cce9b1a-adfe-4636-a840-dc5311108390 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:26.857195 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ae866d-a25c-49f3-8f99-d0ac352813ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:26.857908 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ae866d-a25c-49f3-8f99-d0ac352813ad admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:26.858203 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ae866d-a25c-49f3-8f99-d0ac352813ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:26.858588 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ae866d-a25c-49f3-8f99-d0ac352813ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:26.859369 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ae866d-a25c-49f3-8f99-d0ac352813ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:26.861094 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ae866d-a25c-49f3-8f99-d0ac352813ad admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:26.871851 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1207/2430] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 10:14:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:14:26.875884 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14480de6-4ad6-4321-9ce8-6b6a9db0e487 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:26.887044 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14480de6-4ad6-4321-9ce8-6b6a9db0e487 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:26.891903 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1b920e-fa6b-441a-8394-fcb2081c88bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:26.893121 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1b920e-fa6b-441a-8394-fcb2081c88bc admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:26.893409 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1b920e-fa6b-441a-8394-fcb2081c88bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:26.893692 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1b920e-fa6b-441a-8394-fcb2081c88bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:26.894467 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1b920e-fa6b-441a-8394-fcb2081c88bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:26.896082 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1b920e-fa6b-441a-8394-fcb2081c88bc admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:26.906509 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1224/2431] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 10:14:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:14:26.910843 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ae866d-a25c-49f3-8f99-d0ac352813ad admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:26.921154 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ae866d-a25c-49f3-8f99-d0ac352813ad admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:26.926057 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cd3bea-4b11-4b17-93ba-33b934c4f142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:26.926988 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cd3bea-4b11-4b17-93ba-33b934c4f142 admin admin] REQUEST_METHOD: `PUT` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:26.927275 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cd3bea-4b11-4b17-93ba-33b934c4f142 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:26.927809 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cd3bea-4b11-4b17-93ba-33b934c4f142 admin admin] PATH_INFO: `/v3/projects/b2b77dd59f264dffa29580bfed7bca98/users/82e9d765e5084eafa59d7e7f10052f5f/roles/17dfac38a2e540fea229af7de99911bb` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:26.943388 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cd3bea-4b11-4b17-93ba-33b934c4f142 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2b77dd59f264dffa29580bfed7bca98, user_id=82e9d765e5084eafa59d7e7f10052f5f, role_id=17dfac38a2e540fea229af7de99911bb)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:26.946083 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cd3bea-4b11-4b17-93ba-33b934c4f142 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:26.960331 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1208/2432] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 14 10:14:26 2022] PUT /identity/v3/projects/b2b77dd59f264dffa29580bfed7bca98/users/82e9d765e5084eafa59d7e7f10052f5f/roles/17dfac38a2e540fea229af7de99911bb => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:14:26.972592 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65446a54-abe6-47a8-969f-fcc50b634666 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:26.973078 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65446a54-abe6-47a8-969f-fcc50b634666 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:26.973883 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65446a54-abe6-47a8-969f-fcc50b634666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:27.004076 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-65446a54-abe6-47a8-969f-fcc50b634666 None None] MFA Rules not processed for user `82e9d765e5084eafa59d7e7f10052f5f`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:14:27.005406 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-65446a54-abe6-47a8-969f-fcc50b634666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:14:27.059581 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cd3bea-4b11-4b17-93ba-33b934c4f142 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:27.062504 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-02cd3bea-4b11-4b17-93ba-33b934c4f142 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:14:27.074959 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:14:27.098163 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1225/2433] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 10:14:26 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:14:27.099379 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65446a54-abe6-47a8-969f-fcc50b634666 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:27.165968 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cd3bea-4b11-4b17-93ba-33b934c4f142 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:27.171166 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4863a519-d139-4395-b8f7-5c094488b0b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:27.172047 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4863a519-d139-4395-b8f7-5c094488b0b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:27.172457 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4863a519-d139-4395-b8f7-5c094488b0b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:27.172660 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4863a519-d139-4395-b8f7-5c094488b0b6 admin admin] PATH_INFO: `/v3/projects/6decfc95cea7482b9dbc6e4b752cddec` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:27.174761 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4863a519-d139-4395-b8f7-5c094488b0b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6decfc95cea7482b9dbc6e4b752cddec)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:27.176705 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4863a519-d139-4395-b8f7-5c094488b0b6 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:27.199247 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65446a54-abe6-47a8-969f-fcc50b634666 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:27.205252 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1770281c-7871-4b25-ba7b-027792d33c45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:27.206853 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1770281c-7871-4b25-ba7b-027792d33c45 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:27.207256 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1770281c-7871-4b25-ba7b-027792d33c45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:27.207643 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1770281c-7871-4b25-ba7b-027792d33c45 admin admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:27.208463 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1770281c-7871-4b25-ba7b-027792d33c45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:27.213858 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1770281c-7871-4b25-ba7b-027792d33c45 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:27.224957 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:14:27.252881 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1226/2434] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 14 10:14:27 2022] POST /identity/v3/projects => generated 369 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:14:27.255017 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1770281c-7871-4b25-ba7b-027792d33c45 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:27.255386 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-4863a519-d139-4395-b8f7-5c094488b0b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6decfc95cea7482b9dbc6e4b752cddec', 'request_id': 'req-4863a519-d139-4395-b8f7-5c094488b0b6'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:27.268586 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-4863a519-d139-4395-b8f7-5c094488b0b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6decfc95cea7482b9dbc6e4b752cddec', 'request_id': 'req-4863a519-d139-4395-b8f7-5c094488b0b6'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:27.276069 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-4863a519-d139-4395-b8f7-5c094488b0b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6decfc95cea7482b9dbc6e4b752cddec', 'request_id': 'req-4863a519-d139-4395-b8f7-5c094488b0b6'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:27.291073 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-4863a519-d139-4395-b8f7-5c094488b0b6 admin admin] The token cache is being invalidate because project 6decfc95cea7482b9dbc6e4b752cddec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:14:27.291713 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-4863a519-d139-4395-b8f7-5c094488b0b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:27.292954 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-4863a519-d139-4395-b8f7-5c094488b0b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:27.301049 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1209/2435] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 14 10:14:27 2022] DELETE /identity/v3/projects/6decfc95cea7482b9dbc6e4b752cddec => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:14:27.304832 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a272f64f-e39d-4f21-97f5-4ab077414b09 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:27.305323 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a272f64f-e39d-4f21-97f5-4ab077414b09 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:27.318905 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a272f64f-e39d-4f21-97f5-4ab077414b09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:27.359609 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-a272f64f-e39d-4f21-97f5-4ab077414b09 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:14:27.361392 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-a272f64f-e39d-4f21-97f5-4ab077414b09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:14:27.361654 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1770281c-7871-4b25-ba7b-027792d33c45 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:27.370514 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1b75c4-05fa-4268-9658-fb0c0aac14d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:27.371570 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1b75c4-05fa-4268-9658-fb0c0aac14d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:27.371903 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1b75c4-05fa-4268-9658-fb0c0aac14d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:27.372148 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1b75c4-05fa-4268-9658-fb0c0aac14d9 admin admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:27.374601 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1b75c4-05fa-4268-9658-fb0c0aac14d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:27.383361 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1b75c4-05fa-4268-9658-fb0c0aac14d9 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:27.385930 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1210/2436] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 10:14:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:14:27.394524 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26d5c53-622c-4b5c-a51e-895a68ef3014 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:27.394861 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26d5c53-622c-4b5c-a51e-895a68ef3014 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:27.395109 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26d5c53-622c-4b5c-a51e-895a68ef3014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:27.439966 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-c26d5c53-622c-4b5c-a51e-895a68ef3014 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:14:27.441022 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1227/2437] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 14 10:14:27 2022] POST /identity/v3/users => generated 291 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 10:14:27.442606 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-c26d5c53-622c-4b5c-a51e-895a68ef3014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:14:27.446329 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1b75c4-05fa-4268-9658-fb0c0aac14d9 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:27.448616 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-ea1b75c4-05fa-4268-9658-fb0c0aac14d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:14:27.455602 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1211/2438] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 10:14:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:14:27.459351 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26d5c53-622c-4b5c-a51e-895a68ef3014 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:27.465731 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1b75c4-05fa-4268-9658-fb0c0aac14d9 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:27.469619 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26d5c53-622c-4b5c-a51e-895a68ef3014 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:27.476582 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d19d70-f986-49cb-8d7a-97c972cacaa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:27.477512 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d19d70-f986-49cb-8d7a-97c972cacaa6 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:27.478067 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d19d70-f986-49cb-8d7a-97c972cacaa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:27.478753 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d19d70-f986-49cb-8d7a-97c972cacaa6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:27.480291 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d19d70-f986-49cb-8d7a-97c972cacaa6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:27.483068 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d19d70-f986-49cb-8d7a-97c972cacaa6 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:27.487214 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e21ba23-9f4d-4bff-9ef4-b0ec58383919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:27.487931 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e21ba23-9f4d-4bff-9ef4-b0ec58383919 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:27.488221 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e21ba23-9f4d-4bff-9ef4-b0ec58383919 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:27.488509 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e21ba23-9f4d-4bff-9ef4-b0ec58383919 admin admin] PATH_INFO: `/v3/domains` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:27.489585 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e21ba23-9f4d-4bff-9ef4-b0ec58383919 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:14:27.489992 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e21ba23-9f4d-4bff-9ef4-b0ec58383919 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:27.498468 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e21ba23-9f4d-4bff-9ef4-b0ec58383919 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:27.505301 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1228/2439] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 10:14:27 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:14:27.506497 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d19d70-f986-49cb-8d7a-97c972cacaa6 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:27.513772 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1212/2440] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jul 14 10:14:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:14:27.517305 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d19d70-f986-49cb-8d7a-97c972cacaa6 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:27.517992 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e21ba23-9f4d-4bff-9ef4-b0ec58383919 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:27.522340 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7d73bb-5a5b-4907-80e1-13e6aa49ce59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:27.523279 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7d73bb-5a5b-4907-80e1-13e6aa49ce59 admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:27.523573 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7d73bb-5a5b-4907-80e1-13e6aa49ce59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:27.523858 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7d73bb-5a5b-4907-80e1-13e6aa49ce59 admin admin] PATH_INFO: `/v3/projects/527a39f7e5d649fbbb2452b19e42bd82/users/64be7f9e6d42445da51c98133f36cbef/roles/e3965bd0d5f1427a86a313c0c90bfef3` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:27.532417 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e21ba23-9f4d-4bff-9ef4-b0ec58383919 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:27.538864 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0adf579-f0e9-419f-8eb8-8cfdd4ad80e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:27.539682 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0adf579-f0e9-419f-8eb8-8cfdd4ad80e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:27.540256 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0adf579-f0e9-419f-8eb8-8cfdd4ad80e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:27.540683 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0adf579-f0e9-419f-8eb8-8cfdd4ad80e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:27.541519 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0adf579-f0e9-419f-8eb8-8cfdd4ad80e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:27.543769 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0adf579-f0e9-419f-8eb8-8cfdd4ad80e0 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:27.563445 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7d73bb-5a5b-4907-80e1-13e6aa49ce59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=527a39f7e5d649fbbb2452b19e42bd82, user_id=64be7f9e6d42445da51c98133f36cbef, role_id=e3965bd0d5f1427a86a313c0c90bfef3)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:27.566490 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7d73bb-5a5b-4907-80e1-13e6aa49ce59 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:27.591486 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1229/2441] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 14 10:14:27 2022] PUT /identity/v3/projects/527a39f7e5d649fbbb2452b19e42bd82/users/64be7f9e6d42445da51c98133f36cbef/roles/e3965bd0d5f1427a86a313c0c90bfef3 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:14:27.591743 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1213/2442] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 14 10:14:27 2022] POST /identity/v3/projects => generated 355 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:14:27.592295 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7d73bb-5a5b-4907-80e1-13e6aa49ce59 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:27.592524 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0adf579-f0e9-419f-8eb8-8cfdd4ad80e0 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:27.660130 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:14:27.680809 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0adf579-f0e9-419f-8eb8-8cfdd4ad80e0 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:27.690147 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a8e179-5e3d-4de0-a629-bd454ff107e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:27.691230 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a8e179-5e3d-4de0-a629-bd454ff107e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:27.691910 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a8e179-5e3d-4de0-a629-bd454ff107e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:27.692592 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a8e179-5e3d-4de0-a629-bd454ff107e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:27.693598 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a8e179-5e3d-4de0-a629-bd454ff107e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:27.695782 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a8e179-5e3d-4de0-a629-bd454ff107e7 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:27.705247 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7d73bb-5a5b-4907-80e1-13e6aa49ce59 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:27.713611 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1214/2443] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 10:14:27 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:14:27.713888 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f5a267-78df-4671-8d05-b55dae16dfb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:27.714805 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f5a267-78df-4671-8d05-b55dae16dfb7 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:27.715219 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f5a267-78df-4671-8d05-b55dae16dfb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:27.715486 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a8e179-5e3d-4de0-a629-bd454ff107e7 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:27.715611 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f5a267-78df-4671-8d05-b55dae16dfb7 admin admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:27.716679 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f5a267-78df-4671-8d05-b55dae16dfb7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:27.718689 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f5a267-78df-4671-8d05-b55dae16dfb7 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:27.731809 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a8e179-5e3d-4de0-a629-bd454ff107e7 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:27.738344 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f98b514-b87b-4f68-b5f6-00d352d70731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:27.739379 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f98b514-b87b-4f68-b5f6-00d352d70731 admin admin] REQUEST_METHOD: `PUT` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:27.739723 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f98b514-b87b-4f68-b5f6-00d352d70731 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:27.740005 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f98b514-b87b-4f68-b5f6-00d352d70731 admin admin] PATH_INFO: `/v3/projects/527a39f7e5d649fbbb2452b19e42bd82/users/64be7f9e6d42445da51c98133f36cbef/roles/e3965bd0d5f1427a86a313c0c90bfef3` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:27.743264 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f98b514-b87b-4f68-b5f6-00d352d70731 admin admin] RBAC: Authorizing `identity:create_grant(project_id=527a39f7e5d649fbbb2452b19e42bd82, user_id=64be7f9e6d42445da51c98133f36cbef, role_id=e3965bd0d5f1427a86a313c0c90bfef3)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:27.746064 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f98b514-b87b-4f68-b5f6-00d352d70731 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:27.752548 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1230/2444] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 14 10:14:27 2022] POST /identity/v3/users => generated 278 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:14:27.753624 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f5a267-78df-4671-8d05-b55dae16dfb7 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:27.759173 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1215/2445] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 14 10:14:27 2022] PUT /identity/v3/projects/527a39f7e5d649fbbb2452b19e42bd82/users/64be7f9e6d42445da51c98133f36cbef/roles/e3965bd0d5f1427a86a313c0c90bfef3 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:14:27.768892 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f5a267-78df-4671-8d05-b55dae16dfb7 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:27.770244 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37174533-3aca-47cc-b528-539db1a06f76 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:27.770611 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37174533-3aca-47cc-b528-539db1a06f76 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:27.770960 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37174533-3aca-47cc-b528-539db1a06f76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:27.814105 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-37174533-3aca-47cc-b528-539db1a06f76 None None] MFA Rules not processed for user `64be7f9e6d42445da51c98133f36cbef`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:14:27.816044 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-37174533-3aca-47cc-b528-539db1a06f76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:14:27.819594 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:14:27.876597 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fc1515-7bbf-41e5-b974-229ccea73b4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:27.876597 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fc1515-7bbf-41e5-b974-229ccea73b4f admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:27.876597 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fc1515-7bbf-41e5-b974-229ccea73b4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:27.877341 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fc1515-7bbf-41e5-b974-229ccea73b4f admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:27.878636 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fc1515-7bbf-41e5-b974-229ccea73b4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:27.884956 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fc1515-7bbf-41e5-b974-229ccea73b4f admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:27.900666 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1231/2446] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 10:14:27 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:14:27.904942 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fc1515-7bbf-41e5-b974-229ccea73b4f admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:27.917659 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fc1515-7bbf-41e5-b974-229ccea73b4f admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:27.924972 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ce7cf5-0fa8-41bd-81e9-15ac92fb9cc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:27.926390 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ce7cf5-0fa8-41bd-81e9-15ac92fb9cc9 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:27.926836 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ce7cf5-0fa8-41bd-81e9-15ac92fb9cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:27.927294 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ce7cf5-0fa8-41bd-81e9-15ac92fb9cc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:27.928597 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ce7cf5-0fa8-41bd-81e9-15ac92fb9cc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:27.930583 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ce7cf5-0fa8-41bd-81e9-15ac92fb9cc9 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:27.943133 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1232/2447] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 10:14:27 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:14:27.946928 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ce7cf5-0fa8-41bd-81e9-15ac92fb9cc9 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:27.951676 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1216/2448] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 10:14:27 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 10:14:27.962158 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ce7cf5-0fa8-41bd-81e9-15ac92fb9cc9 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:27.966679 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37174533-3aca-47cc-b528-539db1a06f76 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:27.967724 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d40d104-a154-4052-a3bc-d3338cd9d937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:27.968592 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-37174533-3aca-47cc-b528-539db1a06f76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:14:27.968743 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d40d104-a154-4052-a3bc-d3338cd9d937 admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:27.969127 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d40d104-a154-4052-a3bc-d3338cd9d937 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:27.969478 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d40d104-a154-4052-a3bc-d3338cd9d937 admin admin] PATH_INFO: `/v3/projects/a9540c0fe2d5403f9f673fc49d400153/users/cba07d14d2c941d6bf6654da33c167c0/roles/17dfac38a2e540fea229af7de99911bb` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:27.988959 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d40d104-a154-4052-a3bc-d3338cd9d937 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9540c0fe2d5403f9f673fc49d400153, user_id=cba07d14d2c941d6bf6654da33c167c0, role_id=17dfac38a2e540fea229af7de99911bb)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:27.992676 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d40d104-a154-4052-a3bc-d3338cd9d937 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:28.014667 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1233/2449] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 14 10:14:27 2022] PUT /identity/v3/projects/a9540c0fe2d5403f9f673fc49d400153/users/cba07d14d2c941d6bf6654da33c167c0/roles/17dfac38a2e540fea229af7de99911bb => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:14:28.025769 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e410b43-0393-4f7c-9b1e-9f9786d48a22 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:28.026838 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e410b43-0393-4f7c-9b1e-9f9786d48a22 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:28.027131 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e410b43-0393-4f7c-9b1e-9f9786d48a22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:28.049919 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37174533-3aca-47cc-b528-539db1a06f76 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:28.059571 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-8e410b43-0393-4f7c-9b1e-9f9786d48a22 None None] MFA Rules not processed for user `cba07d14d2c941d6bf6654da33c167c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:14:28.061156 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-8e410b43-0393-4f7c-9b1e-9f9786d48a22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:14:28.130688 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e1f792-bcc7-46d4-8032-716be3a77eed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25048b29787d482783ebc944f1a7df65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:28.131818 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e1f792-bcc7-46d4-8032-716be3a77eed service cinder] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:28.132109 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e1f792-bcc7-46d4-8032-716be3a77eed service cinder] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:28.132381 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e1f792-bcc7-46d4-8032-716be3a77eed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:28.162421 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1234/2450] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 10:14:28 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:14:28.165243 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e410b43-0393-4f7c-9b1e-9f9786d48a22 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:28.178488 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:14:28.229757 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e1f792-bcc7-46d4-8032-716be3a77eed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:28.232300 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e1f792-bcc7-46d4-8032-716be3a77eed service cinder] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:28.250049 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1217/2451] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 10:14:27 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:14:28.254574 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e410b43-0393-4f7c-9b1e-9f9786d48a22 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:28.260482 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b39822a-bd2b-414f-a369-cf0f1f6396b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:28.261251 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b39822a-bd2b-414f-a369-cf0f1f6396b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:28.261546 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b39822a-bd2b-414f-a369-cf0f1f6396b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:28.261825 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b39822a-bd2b-414f-a369-cf0f1f6396b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:28.262565 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b39822a-bd2b-414f-a369-cf0f1f6396b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:28.265261 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b39822a-bd2b-414f-a369-cf0f1f6396b7 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:28.307542 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1235/2452] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 14 10:14:28 2022] POST /identity/v3/projects => generated 357 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:14:28.310306 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e1f792-bcc7-46d4-8032-716be3a77eed service cinder] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:28.322434 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e1f792-bcc7-46d4-8032-716be3a77eed service cinder] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:28.404850 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17a8dcd-e67d-43a7-a190-425d647c3b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:28.406130 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17a8dcd-e67d-43a7-a190-425d647c3b08 admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:28.406599 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17a8dcd-e67d-43a7-a190-425d647c3b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:28.407076 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17a8dcd-e67d-43a7-a190-425d647c3b08 admin admin] PATH_INFO: `/v3/users` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:28.408399 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17a8dcd-e67d-43a7-a190-425d647c3b08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:28.412316 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17a8dcd-e67d-43a7-a190-425d647c3b08 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:28.476655 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1218/2453] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 14 10:14:28 2022] POST /identity/v3/users => generated 285 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:14:28.477899 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b39822a-bd2b-414f-a369-cf0f1f6396b7 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:28.490717 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b39822a-bd2b-414f-a369-cf0f1f6396b7 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:28.504089 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f260cb7-f51a-4db9-80e4-ea9998a7f94f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:28.504930 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f260cb7-f51a-4db9-80e4-ea9998a7f94f admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:28.508665 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f260cb7-f51a-4db9-80e4-ea9998a7f94f admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:28.508964 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f260cb7-f51a-4db9-80e4-ea9998a7f94f admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:28.509784 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f260cb7-f51a-4db9-80e4-ea9998a7f94f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:28.516916 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f260cb7-f51a-4db9-80e4-ea9998a7f94f admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:28.524072 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:14:28.546905 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1236/2454] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 10:14:28 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:14:28.558365 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17a8dcd-e67d-43a7-a190-425d647c3b08 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:28.573093 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17a8dcd-e67d-43a7-a190-425d647c3b08 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:28.592047 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e8d228-0768-4938-a74a-60c7e2981485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:28.592984 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e8d228-0768-4938-a74a-60c7e2981485 admin admin] REQUEST_METHOD: `PUT` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:28.593477 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e8d228-0768-4938-a74a-60c7e2981485 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:28.593768 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e8d228-0768-4938-a74a-60c7e2981485 admin admin] PATH_INFO: `/v3/projects/df8193337acc4deaa41882ae5516ff08/users/f6cf45c2ff384e588725c90b637052be/roles/e3965bd0d5f1427a86a313c0c90bfef3` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:28.618844 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e8d228-0768-4938-a74a-60c7e2981485 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df8193337acc4deaa41882ae5516ff08, user_id=f6cf45c2ff384e588725c90b637052be, role_id=e3965bd0d5f1427a86a313c0c90bfef3)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:28.621563 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e8d228-0768-4938-a74a-60c7e2981485 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:28.642418 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1219/2455] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 14 10:14:28 2022] PUT /identity/v3/projects/df8193337acc4deaa41882ae5516ff08/users/f6cf45c2ff384e588725c90b637052be/roles/e3965bd0d5f1427a86a313c0c90bfef3 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:14:28.644123 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f260cb7-f51a-4db9-80e4-ea9998a7f94f admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:28.659025 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f260cb7-f51a-4db9-80e4-ea9998a7f94f admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:28.770658 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69b53b4-d6af-4a73-a234-08443b518329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:28.771353 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69b53b4-d6af-4a73-a234-08443b518329 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:28.771697 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69b53b4-d6af-4a73-a234-08443b518329 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:28.771982 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69b53b4-d6af-4a73-a234-08443b518329 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:28.772753 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69b53b4-d6af-4a73-a234-08443b518329 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:28.774595 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69b53b4-d6af-4a73-a234-08443b518329 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:28.788632 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1237/2456] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 10:14:28 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 10:14:28.792992 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e8d228-0768-4938-a74a-60c7e2981485 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:28.805779 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e8d228-0768-4938-a74a-60c7e2981485 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:28.813103 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca181464-3002-416d-a9a9-d5811c5307f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:28.814624 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca181464-3002-416d-a9a9-d5811c5307f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:28.814923 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca181464-3002-416d-a9a9-d5811c5307f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:28.815208 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca181464-3002-416d-a9a9-d5811c5307f3 admin admin] PATH_INFO: `/v3/projects/df8193337acc4deaa41882ae5516ff08/users/f6cf45c2ff384e588725c90b637052be/roles/e3965bd0d5f1427a86a313c0c90bfef3` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:28.817456 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca181464-3002-416d-a9a9-d5811c5307f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df8193337acc4deaa41882ae5516ff08, user_id=f6cf45c2ff384e588725c90b637052be, role_id=e3965bd0d5f1427a86a313c0c90bfef3)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:28.820369 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca181464-3002-416d-a9a9-d5811c5307f3 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:28.835245 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1220/2457] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 14 10:14:28 2022] PUT /identity/v3/projects/df8193337acc4deaa41882ae5516ff08/users/f6cf45c2ff384e588725c90b637052be/roles/e3965bd0d5f1427a86a313c0c90bfef3 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:14:28.847467 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab5c44b-98e0-428a-8208-1d476eddc9ca None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:28.847802 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab5c44b-98e0-428a-8208-1d476eddc9ca None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:28.848073 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab5c44b-98e0-428a-8208-1d476eddc9ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:28.884382 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-dab5c44b-98e0-428a-8208-1d476eddc9ca None None] MFA Rules not processed for user `f6cf45c2ff384e588725c90b637052be`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:14:28.885922 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-dab5c44b-98e0-428a-8208-1d476eddc9ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:14:29.036536 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1238/2458] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 10:14:28 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:14:29.039792 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca181464-3002-416d-a9a9-d5811c5307f3 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:29.123082 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca181464-3002-416d-a9a9-d5811c5307f3 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:29.126983 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1194884a-305c-4aa5-866b-69441512aa07 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25048b29787d482783ebc944f1a7df65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:29.127654 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1194884a-305c-4aa5-866b-69441512aa07 service cinder] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:29.127942 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1194884a-305c-4aa5-866b-69441512aa07 service cinder] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:29.128223 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1194884a-305c-4aa5-866b-69441512aa07 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:29.140018 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1194884a-305c-4aa5-866b-69441512aa07 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:29.141645 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1194884a-305c-4aa5-866b-69441512aa07 service cinder] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:29.170619 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1221/2459] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 10:14:29 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:14:29.257920 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab5c44b-98e0-428a-8208-1d476eddc9ca None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:29.268512 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab5c44b-98e0-428a-8208-1d476eddc9ca None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:29.272759 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3439d95-6039-49f0-890c-cb6c66e34ab9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25048b29787d482783ebc944f1a7df65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:29.273580 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3439d95-6039-49f0-890c-cb6c66e34ab9 service cinder] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:29.273787 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3439d95-6039-49f0-890c-cb6c66e34ab9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:29.274032 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3439d95-6039-49f0-890c-cb6c66e34ab9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:29.368716 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3439d95-6039-49f0-890c-cb6c66e34ab9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:29.371968 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3439d95-6039-49f0-890c-cb6c66e34ab9 service cinder] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:29.386785 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1239/2460] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 10:14:29 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:14:30.222851 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1194884a-305c-4aa5-866b-69441512aa07 service cinder] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:30.254667 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:14:30.312514 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1194884a-305c-4aa5-866b-69441512aa07 service cinder] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:30.318417 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96e1207-8a04-4f84-93ba-d29f656cbcde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:30.319274 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96e1207-8a04-4f84-93ba-d29f656cbcde admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:30.319565 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96e1207-8a04-4f84-93ba-d29f656cbcde admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:30.319839 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96e1207-8a04-4f84-93ba-d29f656cbcde admin admin] PATH_INFO: `/v3/users/82e9d765e5084eafa59d7e7f10052f5f` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:30.321076 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96e1207-8a04-4f84-93ba-d29f656cbcde admin admin] RBAC: Authorizing `identity:delete_user(user_id=82e9d765e5084eafa59d7e7f10052f5f)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:30.323075 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96e1207-8a04-4f84-93ba-d29f656cbcde admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:30.404644 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-b96e1207-8a04-4f84-93ba-d29f656cbcde admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82e9d765e5084eafa59d7e7f10052f5f'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:30.414369 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-b96e1207-8a04-4f84-93ba-d29f656cbcde admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82e9d765e5084eafa59d7e7f10052f5f'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:30.415169 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-b96e1207-8a04-4f84-93ba-d29f656cbcde admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82e9d765e5084eafa59d7e7f10052f5f'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:30.424761 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-b96e1207-8a04-4f84-93ba-d29f656cbcde admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82e9d765e5084eafa59d7e7f10052f5f'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:30.425519 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-b96e1207-8a04-4f84-93ba-d29f656cbcde admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82e9d765e5084eafa59d7e7f10052f5f'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:30.447537 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1222/2461] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 14 10:14:30 2022] DELETE /identity/v3/users/82e9d765e5084eafa59d7e7f10052f5f => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:14:30.452495 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9bec36-d8dc-407c-8c2a-7cd7557ac450 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:30.453130 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9bec36-d8dc-407c-8c2a-7cd7557ac450 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:30.453259 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9bec36-d8dc-407c-8c2a-7cd7557ac450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:30.472203 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-2e9bec36-d8dc-407c-8c2a-7cd7557ac450 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:14:30.473517 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-2e9bec36-d8dc-407c-8c2a-7cd7557ac450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:14:30.488557 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:14:30.551574 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1240/2462] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 10:14:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:14:30.561968 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96e1207-8a04-4f84-93ba-d29f656cbcde admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:30.563514 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-b96e1207-8a04-4f84-93ba-d29f656cbcde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:14:30.621887 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96e1207-8a04-4f84-93ba-d29f656cbcde admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:30.625697 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391e4274-ee8e-43b7-b59d-27f6acd44a7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e4a5a8965e4802a9055d332179b7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:30.626417 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391e4274-ee8e-43b7-b59d-27f6acd44a7a service neutron] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:30.626705 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391e4274-ee8e-43b7-b59d-27f6acd44a7a service neutron] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:30.626981 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391e4274-ee8e-43b7-b59d-27f6acd44a7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:30.636586 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391e4274-ee8e-43b7-b59d-27f6acd44a7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:30.638170 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391e4274-ee8e-43b7-b59d-27f6acd44a7a service neutron] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:30.648087 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1223/2463] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 10:14:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:14:30.941933 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9bec36-d8dc-407c-8c2a-7cd7557ac450 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:30.943753 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-2e9bec36-d8dc-407c-8c2a-7cd7557ac450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:14:30.957257 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9bec36-d8dc-407c-8c2a-7cd7557ac450 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:30.962733 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaba6a9-57b8-48dd-bb3e-f8599964fcdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:30.963713 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaba6a9-57b8-48dd-bb3e-f8599964fcdd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:30.964073 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaba6a9-57b8-48dd-bb3e-f8599964fcdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:30.964423 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaba6a9-57b8-48dd-bb3e-f8599964fcdd admin admin] PATH_INFO: `/v3/projects/b2b77dd59f264dffa29580bfed7bca98` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:30.966168 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcaba6a9-57b8-48dd-bb3e-f8599964fcdd admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2b77dd59f264dffa29580bfed7bca98)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:30.968142 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcaba6a9-57b8-48dd-bb3e-f8599964fcdd admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:31.023363 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-dcaba6a9-57b8-48dd-bb3e-f8599964fcdd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2b77dd59f264dffa29580bfed7bca98', 'request_id': 'req-dcaba6a9-57b8-48dd-bb3e-f8599964fcdd'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:31.031147 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-dcaba6a9-57b8-48dd-bb3e-f8599964fcdd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2b77dd59f264dffa29580bfed7bca98', 'request_id': 'req-dcaba6a9-57b8-48dd-bb3e-f8599964fcdd'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:31.037809 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-dcaba6a9-57b8-48dd-bb3e-f8599964fcdd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2b77dd59f264dffa29580bfed7bca98', 'request_id': 'req-dcaba6a9-57b8-48dd-bb3e-f8599964fcdd'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:31.053256 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-dcaba6a9-57b8-48dd-bb3e-f8599964fcdd admin admin] The token cache is being invalidate because project b2b77dd59f264dffa29580bfed7bca98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:14:31.053567 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-dcaba6a9-57b8-48dd-bb3e-f8599964fcdd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:31.054521 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-dcaba6a9-57b8-48dd-bb3e-f8599964fcdd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:31.056468 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1241/2464] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 14 10:14:30 2022] DELETE /identity/v3/projects/b2b77dd59f264dffa29580bfed7bca98 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:14:31.061053 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391e4274-ee8e-43b7-b59d-27f6acd44a7a service neutron] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:31.070656 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391e4274-ee8e-43b7-b59d-27f6acd44a7a service neutron] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:31.112762 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:14:31.130702 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8a203f-312d-4074-b024-488bf4410a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:31.131680 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8a203f-312d-4074-b024-488bf4410a33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:31.131968 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8a203f-312d-4074-b024-488bf4410a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:31.132243 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8a203f-312d-4074-b024-488bf4410a33 admin admin] PATH_INFO: `/v3/users/64be7f9e6d42445da51c98133f36cbef` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:31.133481 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8a203f-312d-4074-b024-488bf4410a33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=64be7f9e6d42445da51c98133f36cbef)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:31.135432 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8a203f-312d-4074-b024-488bf4410a33 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:31.181372 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-df8a203f-312d-4074-b024-488bf4410a33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64be7f9e6d42445da51c98133f36cbef'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:31.188289 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-df8a203f-312d-4074-b024-488bf4410a33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64be7f9e6d42445da51c98133f36cbef'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:31.188906 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-df8a203f-312d-4074-b024-488bf4410a33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64be7f9e6d42445da51c98133f36cbef'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:31.196221 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-df8a203f-312d-4074-b024-488bf4410a33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64be7f9e6d42445da51c98133f36cbef'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:31.196841 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-df8a203f-312d-4074-b024-488bf4410a33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64be7f9e6d42445da51c98133f36cbef'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:31.215263 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1224/2465] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 14 10:14:31 2022] DELETE /identity/v3/users/64be7f9e6d42445da51c98133f36cbef => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:14:31.505751 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaba6a9-57b8-48dd-bb3e-f8599964fcdd admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:31.507359 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-dcaba6a9-57b8-48dd-bb3e-f8599964fcdd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:14:31.522448 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaba6a9-57b8-48dd-bb3e-f8599964fcdd admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:31.588401 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c1fd2a-b2ea-400b-ab19-2da2df784ade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:31.589290 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c1fd2a-b2ea-400b-ab19-2da2df784ade admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:31.589573 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c1fd2a-b2ea-400b-ab19-2da2df784ade admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:31.589849 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c1fd2a-b2ea-400b-ab19-2da2df784ade admin admin] PATH_INFO: `/v3/projects/527a39f7e5d649fbbb2452b19e42bd82` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:31.591070 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c1fd2a-b2ea-400b-ab19-2da2df784ade admin admin] RBAC: Authorizing `identity:delete_project(project_id=527a39f7e5d649fbbb2452b19e42bd82)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:31.592957 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c1fd2a-b2ea-400b-ab19-2da2df784ade admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:31.636123 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:14:31.640343 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-67c1fd2a-b2ea-400b-ab19-2da2df784ade admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '527a39f7e5d649fbbb2452b19e42bd82', 'request_id': 'req-67c1fd2a-b2ea-400b-ab19-2da2df784ade'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:31.648429 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-67c1fd2a-b2ea-400b-ab19-2da2df784ade admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '527a39f7e5d649fbbb2452b19e42bd82', 'request_id': 'req-67c1fd2a-b2ea-400b-ab19-2da2df784ade'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:31.654144 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-67c1fd2a-b2ea-400b-ab19-2da2df784ade admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '527a39f7e5d649fbbb2452b19e42bd82', 'request_id': 'req-67c1fd2a-b2ea-400b-ab19-2da2df784ade'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:31.666474 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-67c1fd2a-b2ea-400b-ab19-2da2df784ade admin admin] The token cache is being invalidate because project 527a39f7e5d649fbbb2452b19e42bd82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:14:31.666764 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-67c1fd2a-b2ea-400b-ab19-2da2df784ade admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:31.667393 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-67c1fd2a-b2ea-400b-ab19-2da2df784ade admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:31.668930 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1242/2466] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 14 10:14:31 2022] DELETE /identity/v3/projects/527a39f7e5d649fbbb2452b19e42bd82 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:14:31.674432 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eda5ce-30c1-4e48-aed1-8ec2fe1bc372 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:31.674902 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eda5ce-30c1-4e48-aed1-8ec2fe1bc372 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:31.675003 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eda5ce-30c1-4e48-aed1-8ec2fe1bc372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:31.694413 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-d8eda5ce-30c1-4e48-aed1-8ec2fe1bc372 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:14:31.695665 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-d8eda5ce-30c1-4e48-aed1-8ec2fe1bc372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:14:31.757590 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1225/2467] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 10:14:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:14:31.766614 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3174b1fa-b70a-4b8f-a6e9-91bcbefdb370 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:31.766955 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3174b1fa-b70a-4b8f-a6e9-91bcbefdb370 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:31.767298 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3174b1fa-b70a-4b8f-a6e9-91bcbefdb370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:31.793380 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-3174b1fa-b70a-4b8f-a6e9-91bcbefdb370 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:14:31.795311 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-3174b1fa-b70a-4b8f-a6e9-91bcbefdb370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:14:31.808484 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1243/2468] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 10:14:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:14:31.812540 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8eda5ce-30c1-4e48-aed1-8ec2fe1bc372 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:31.825829 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8eda5ce-30c1-4e48-aed1-8ec2fe1bc372 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:31.831133 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5f75d4-6492-4155-a936-1112404dd146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:31.831812 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5f75d4-6492-4155-a936-1112404dd146 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:31.832098 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5f75d4-6492-4155-a936-1112404dd146 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:31.832377 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5f75d4-6492-4155-a936-1112404dd146 admin admin] PATH_INFO: `/v3/domains` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:31.833121 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5f75d4-6492-4155-a936-1112404dd146 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:14:31.833432 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5f75d4-6492-4155-a936-1112404dd146 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:31.835081 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5f75d4-6492-4155-a936-1112404dd146 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:31.850811 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1226/2469] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jul 14 10:14:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:14:31.851912 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3174b1fa-b70a-4b8f-a6e9-91bcbefdb370 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:31.861625 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3174b1fa-b70a-4b8f-a6e9-91bcbefdb370 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:31.866230 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9be0ed1-b85d-450f-8b0e-2dec752ed31b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:31.866886 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9be0ed1-b85d-450f-8b0e-2dec752ed31b admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:31.867170 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9be0ed1-b85d-450f-8b0e-2dec752ed31b admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:31.867448 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9be0ed1-b85d-450f-8b0e-2dec752ed31b admin admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:31.868134 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9be0ed1-b85d-450f-8b0e-2dec752ed31b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:31.870003 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9be0ed1-b85d-450f-8b0e-2dec752ed31b admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:31.899136 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1244/2470] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 14 10:14:31 2022] POST /identity/v3/projects => generated 387 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:14:31.900313 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5f75d4-6492-4155-a936-1112404dd146 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:31.911012 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5f75d4-6492-4155-a936-1112404dd146 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:31.958778 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:14:31.974481 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cd9115-5529-4572-890e-92ef73c8f492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:31.975340 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cd9115-5529-4572-890e-92ef73c8f492 admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:31.975655 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cd9115-5529-4572-890e-92ef73c8f492 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:31.975920 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cd9115-5529-4572-890e-92ef73c8f492 admin admin] PATH_INFO: `/v3/users` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:31.976802 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cd9115-5529-4572-890e-92ef73c8f492 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:31.978915 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cd9115-5529-4572-890e-92ef73c8f492 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:32.005313 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1227/2471] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 14 10:14:31 2022] POST /identity/v3/users => generated 294 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 10:14:32.006589 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9be0ed1-b85d-450f-8b0e-2dec752ed31b admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:32.017939 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9be0ed1-b85d-450f-8b0e-2dec752ed31b admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:32.023537 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aeadea-1f81-4edd-b342-b9bd74f3b289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:32.024444 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aeadea-1f81-4edd-b342-b9bd74f3b289 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:32.024833 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aeadea-1f81-4edd-b342-b9bd74f3b289 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:32.025227 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aeadea-1f81-4edd-b342-b9bd74f3b289 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:32.026285 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34aeadea-1f81-4edd-b342-b9bd74f3b289 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:32.027992 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34aeadea-1f81-4edd-b342-b9bd74f3b289 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:32.039475 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1245/2472] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 10:14:32 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:14:32.043997 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cd9115-5529-4572-890e-92ef73c8f492 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:32.056056 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cd9115-5529-4572-890e-92ef73c8f492 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:32.060968 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36240991-d4c8-4dee-9c64-94d3dd2df52f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:32.061640 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36240991-d4c8-4dee-9c64-94d3dd2df52f admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:32.062041 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36240991-d4c8-4dee-9c64-94d3dd2df52f admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:32.062365 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36240991-d4c8-4dee-9c64-94d3dd2df52f admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:32.063140 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36240991-d4c8-4dee-9c64-94d3dd2df52f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:32.064784 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36240991-d4c8-4dee-9c64-94d3dd2df52f admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:32.075653 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1228/2473] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 10:14:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:14:32.080130 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aeadea-1f81-4edd-b342-b9bd74f3b289 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:32.090584 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aeadea-1f81-4edd-b342-b9bd74f3b289 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:32.096790 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87737b2f-5f63-469b-bed5-bc0e1d96f5f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:32.097541 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87737b2f-5f63-469b-bed5-bc0e1d96f5f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:32.097822 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87737b2f-5f63-469b-bed5-bc0e1d96f5f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:32.098097 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87737b2f-5f63-469b-bed5-bc0e1d96f5f6 admin admin] PATH_INFO: `/v3/projects/4ef33e0913614a16a7d3d6d325a131ac/users/1b7792ecbda94bfba6676ddc11a8c05d/roles/17dfac38a2e540fea229af7de99911bb` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:32.117168 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87737b2f-5f63-469b-bed5-bc0e1d96f5f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ef33e0913614a16a7d3d6d325a131ac, user_id=1b7792ecbda94bfba6676ddc11a8c05d, role_id=17dfac38a2e540fea229af7de99911bb)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:32.122545 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87737b2f-5f63-469b-bed5-bc0e1d96f5f6 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:32.139901 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1246/2474] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 14 10:14:32 2022] PUT /identity/v3/projects/4ef33e0913614a16a7d3d6d325a131ac/users/1b7792ecbda94bfba6676ddc11a8c05d/roles/17dfac38a2e540fea229af7de99911bb => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:14:32.204526 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630d5ead-6be7-4bdb-945e-cb129e37022b None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:32.204909 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630d5ead-6be7-4bdb-945e-cb129e37022b None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:32.205232 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630d5ead-6be7-4bdb-945e-cb129e37022b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:32.232671 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-630d5ead-6be7-4bdb-945e-cb129e37022b None None] MFA Rules not processed for user `1b7792ecbda94bfba6676ddc11a8c05d`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:14:32.234595 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-630d5ead-6be7-4bdb-945e-cb129e37022b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:14:32.300274 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1229/2475] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 10:14:32 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:14:32.305464 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87737b2f-5f63-469b-bed5-bc0e1d96f5f6 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:32.366139 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87737b2f-5f63-469b-bed5-bc0e1d96f5f6 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:32.370721 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22614aa-5df8-415a-947b-36ecd80acabe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:32.371378 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22614aa-5df8-415a-947b-36ecd80acabe admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:32.371661 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22614aa-5df8-415a-947b-36ecd80acabe admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:32.371933 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22614aa-5df8-415a-947b-36ecd80acabe admin admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:32.372632 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22614aa-5df8-415a-947b-36ecd80acabe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:32.374556 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22614aa-5df8-415a-947b-36ecd80acabe admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:32.400749 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1247/2476] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 14 10:14:32 2022] POST /identity/v3/projects => generated 387 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 10:14:32.404905 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630d5ead-6be7-4bdb-945e-cb129e37022b None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:32.416730 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630d5ead-6be7-4bdb-945e-cb129e37022b None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:32.477915 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c00443-08d4-44cd-a189-3a99d0ab81d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:32.478626 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c00443-08d4-44cd-a189-3a99d0ab81d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:32.479002 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c00443-08d4-44cd-a189-3a99d0ab81d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:32.479278 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c00443-08d4-44cd-a189-3a99d0ab81d5 admin admin] PATH_INFO: `/v3/users` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:32.479974 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c00443-08d4-44cd-a189-3a99d0ab81d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:32.481875 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c00443-08d4-44cd-a189-3a99d0ab81d5 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:32.503339 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1230/2477] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 14 10:14:32 2022] POST /identity/v3/users => generated 300 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:14:32.507274 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22614aa-5df8-415a-947b-36ecd80acabe admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:32.518063 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22614aa-5df8-415a-947b-36ecd80acabe admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:32.522871 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06af1f4-1e34-4047-b458-e71f8296b4c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:32.523584 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06af1f4-1e34-4047-b458-e71f8296b4c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:32.523873 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06af1f4-1e34-4047-b458-e71f8296b4c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:32.524158 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06af1f4-1e34-4047-b458-e71f8296b4c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:32.524897 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06af1f4-1e34-4047-b458-e71f8296b4c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:32.526538 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06af1f4-1e34-4047-b458-e71f8296b4c9 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:32.538720 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1248/2478] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 10:14:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 10:14:32.542901 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c00443-08d4-44cd-a189-3a99d0ab81d5 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:32.553791 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c00443-08d4-44cd-a189-3a99d0ab81d5 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:32.558551 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b04f27-a22e-46a1-81bc-c23f9fff58a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:32.559449 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b04f27-a22e-46a1-81bc-c23f9fff58a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:32.559739 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b04f27-a22e-46a1-81bc-c23f9fff58a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:32.560021 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b04f27-a22e-46a1-81bc-c23f9fff58a4 admin admin] PATH_INFO: `/v3/projects/1db35469ee614f4894c334d41b66fe63/users/9b2ecfd3c404493995776bcec1646908/roles/e3965bd0d5f1427a86a313c0c90bfef3` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:32.576253 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b04f27-a22e-46a1-81bc-c23f9fff58a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1db35469ee614f4894c334d41b66fe63, user_id=9b2ecfd3c404493995776bcec1646908, role_id=e3965bd0d5f1427a86a313c0c90bfef3)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:32.578962 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b04f27-a22e-46a1-81bc-c23f9fff58a4 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:32.591449 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1231/2479] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 14 10:14:32 2022] PUT /identity/v3/projects/1db35469ee614f4894c334d41b66fe63/users/9b2ecfd3c404493995776bcec1646908/roles/e3965bd0d5f1427a86a313c0c90bfef3 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:14:32.595503 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06af1f4-1e34-4047-b458-e71f8296b4c9 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:32.605893 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06af1f4-1e34-4047-b458-e71f8296b4c9 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:32.645487 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:14:32.663966 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ac870f-9368-4fb9-a3ec-764e181d7a53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:32.664642 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ac870f-9368-4fb9-a3ec-764e181d7a53 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:32.664928 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ac870f-9368-4fb9-a3ec-764e181d7a53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:32.665209 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ac870f-9368-4fb9-a3ec-764e181d7a53 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:32.665943 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ac870f-9368-4fb9-a3ec-764e181d7a53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:32.667619 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ac870f-9368-4fb9-a3ec-764e181d7a53 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:32.678091 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1249/2480] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 10:14:32 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:14:32.682330 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b04f27-a22e-46a1-81bc-c23f9fff58a4 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:32.693403 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b04f27-a22e-46a1-81bc-c23f9fff58a4 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:32.697934 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9871f250-8fb4-4cf4-ab4a-4bd6183f4a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:32.698873 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9871f250-8fb4-4cf4-ab4a-4bd6183f4a13 admin admin] REQUEST_METHOD: `PUT` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:32.699158 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9871f250-8fb4-4cf4-ab4a-4bd6183f4a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:32.699432 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9871f250-8fb4-4cf4-ab4a-4bd6183f4a13 admin admin] PATH_INFO: `/v3/projects/1db35469ee614f4894c334d41b66fe63/users/9b2ecfd3c404493995776bcec1646908/roles/e3965bd0d5f1427a86a313c0c90bfef3` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:32.701407 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9871f250-8fb4-4cf4-ab4a-4bd6183f4a13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1db35469ee614f4894c334d41b66fe63, user_id=9b2ecfd3c404493995776bcec1646908, role_id=e3965bd0d5f1427a86a313c0c90bfef3)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:32.704046 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9871f250-8fb4-4cf4-ab4a-4bd6183f4a13 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:32.715987 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1232/2481] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 14 10:14:32 2022] PUT /identity/v3/projects/1db35469ee614f4894c334d41b66fe63/users/9b2ecfd3c404493995776bcec1646908/roles/e3965bd0d5f1427a86a313c0c90bfef3 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:14:32.726144 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2b15cc-2fcc-4a19-8928-96c932aad1eb None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:32.726495 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2b15cc-2fcc-4a19-8928-96c932aad1eb None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:32.726774 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2b15cc-2fcc-4a19-8928-96c932aad1eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:32.753772 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-5b2b15cc-2fcc-4a19-8928-96c932aad1eb None None] MFA Rules not processed for user `9b2ecfd3c404493995776bcec1646908`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:14:32.755030 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-5b2b15cc-2fcc-4a19-8928-96c932aad1eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:14:32.822526 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1250/2482] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 10:14:32 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:14:32.833850 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9871f250-8fb4-4cf4-ab4a-4bd6183f4a13 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:32.835578 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-9871f250-8fb4-4cf4-ab4a-4bd6183f4a13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:14:32.846851 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:14:32.893534 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9871f250-8fb4-4cf4-ab4a-4bd6183f4a13 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:32.897341 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf8a021-1b30-4659-979b-6584dde49c6f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25048b29787d482783ebc944f1a7df65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:32.897935 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf8a021-1b30-4659-979b-6584dde49c6f service cinder] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:32.898257 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf8a021-1b30-4659-979b-6584dde49c6f service cinder] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:32.898543 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf8a021-1b30-4659-979b-6584dde49c6f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:32.908257 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf8a021-1b30-4659-979b-6584dde49c6f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:32.909695 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf8a021-1b30-4659-979b-6584dde49c6f service cinder] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:32.919682 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1233/2483] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 10:14:32 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:14:32.985672 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2b15cc-2fcc-4a19-8928-96c932aad1eb None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:33.051033 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2b15cc-2fcc-4a19-8928-96c932aad1eb None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:33.055877 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287f8911-82c6-4fa3-a178-4e78204f69a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:33.056752 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287f8911-82c6-4fa3-a178-4e78204f69a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:33.057156 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287f8911-82c6-4fa3-a178-4e78204f69a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:33.057442 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287f8911-82c6-4fa3-a178-4e78204f69a1 admin admin] PATH_INFO: `/v3/users/1b7792ecbda94bfba6676ddc11a8c05d` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:33.058688 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287f8911-82c6-4fa3-a178-4e78204f69a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b7792ecbda94bfba6676ddc11a8c05d)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:33.060604 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287f8911-82c6-4fa3-a178-4e78204f69a1 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:33.106027 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-287f8911-82c6-4fa3-a178-4e78204f69a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b7792ecbda94bfba6676ddc11a8c05d'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:33.119075 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-287f8911-82c6-4fa3-a178-4e78204f69a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b7792ecbda94bfba6676ddc11a8c05d'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:33.119780 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-287f8911-82c6-4fa3-a178-4e78204f69a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b7792ecbda94bfba6676ddc11a8c05d'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:33.121463 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:14:33.128178 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-287f8911-82c6-4fa3-a178-4e78204f69a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b7792ecbda94bfba6676ddc11a8c05d'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:33.135167 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-287f8911-82c6-4fa3-a178-4e78204f69a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b7792ecbda94bfba6676ddc11a8c05d'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:33.141093 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1251/2484] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 14 10:14:32 2022] DELETE /identity/v3/users/1b7792ecbda94bfba6676ddc11a8c05d => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:14:33.146149 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa7b323-1401-47ee-b55e-829de888cf48 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:33.146473 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa7b323-1401-47ee-b55e-829de888cf48 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:33.146760 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa7b323-1401-47ee-b55e-829de888cf48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:33.164985 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-4fa7b323-1401-47ee-b55e-829de888cf48 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:14:33.166121 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-4fa7b323-1401-47ee-b55e-829de888cf48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:14:33.226692 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1234/2485] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 10:14:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:14:33.237087 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287f8911-82c6-4fa3-a178-4e78204f69a1 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:33.238636 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-287f8911-82c6-4fa3-a178-4e78204f69a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:14:33.306895 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287f8911-82c6-4fa3-a178-4e78204f69a1 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:33.310609 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcba7e9-6483-4d0b-8a3b-b322779ac32b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e4a5a8965e4802a9055d332179b7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:33.311300 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcba7e9-6483-4d0b-8a3b-b322779ac32b service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:33.311585 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcba7e9-6483-4d0b-8a3b-b322779ac32b service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:33.311865 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcba7e9-6483-4d0b-8a3b-b322779ac32b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:33.321647 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcba7e9-6483-4d0b-8a3b-b322779ac32b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:33.323114 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcba7e9-6483-4d0b-8a3b-b322779ac32b service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:33.333293 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1252/2486] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 10:14:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:14:33.637263 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa7b323-1401-47ee-b55e-829de888cf48 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:33.638786 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-4fa7b323-1401-47ee-b55e-829de888cf48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:14:33.654727 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa7b323-1401-47ee-b55e-829de888cf48 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:33.660392 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25135f1-4fed-4e8d-a92a-c76d8e7981fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:33.661331 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25135f1-4fed-4e8d-a92a-c76d8e7981fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:33.661671 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25135f1-4fed-4e8d-a92a-c76d8e7981fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:33.661889 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25135f1-4fed-4e8d-a92a-c76d8e7981fc admin admin] PATH_INFO: `/v3/projects/4ef33e0913614a16a7d3d6d325a131ac` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:33.663187 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25135f1-4fed-4e8d-a92a-c76d8e7981fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ef33e0913614a16a7d3d6d325a131ac)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:33.665713 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25135f1-4fed-4e8d-a92a-c76d8e7981fc admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:33.726644 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-b25135f1-4fed-4e8d-a92a-c76d8e7981fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ef33e0913614a16a7d3d6d325a131ac', 'request_id': 'req-b25135f1-4fed-4e8d-a92a-c76d8e7981fc'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:33.737349 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-b25135f1-4fed-4e8d-a92a-c76d8e7981fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ef33e0913614a16a7d3d6d325a131ac', 'request_id': 'req-b25135f1-4fed-4e8d-a92a-c76d8e7981fc'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:33.744308 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-b25135f1-4fed-4e8d-a92a-c76d8e7981fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ef33e0913614a16a7d3d6d325a131ac', 'request_id': 'req-b25135f1-4fed-4e8d-a92a-c76d8e7981fc'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:33.757024 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-b25135f1-4fed-4e8d-a92a-c76d8e7981fc admin admin] The token cache is being invalidate because project 4ef33e0913614a16a7d3d6d325a131ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:14:33.757318 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-b25135f1-4fed-4e8d-a92a-c76d8e7981fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:33.757982 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-b25135f1-4fed-4e8d-a92a-c76d8e7981fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:33.759559 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1235/2487] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 14 10:14:33 2022] DELETE /identity/v3/projects/4ef33e0913614a16a7d3d6d325a131ac => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:14:33.763607 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcba7e9-6483-4d0b-8a3b-b322779ac32b service neutron] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:33.773839 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcba7e9-6483-4d0b-8a3b-b322779ac32b service neutron] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:33.829584 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d836bf-eff5-4275-88e8-903532054c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:33.831010 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d836bf-eff5-4275-88e8-903532054c97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:33.831300 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d836bf-eff5-4275-88e8-903532054c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:33.831586 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d836bf-eff5-4275-88e8-903532054c97 admin admin] PATH_INFO: `/v3/users/9b2ecfd3c404493995776bcec1646908` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:33.833636 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d836bf-eff5-4275-88e8-903532054c97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b2ecfd3c404493995776bcec1646908)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:33.834780 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d836bf-eff5-4275-88e8-903532054c97 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:33.886897 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-28d836bf-eff5-4275-88e8-903532054c97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b2ecfd3c404493995776bcec1646908'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:33.898680 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-28d836bf-eff5-4275-88e8-903532054c97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b2ecfd3c404493995776bcec1646908'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:33.899369 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-28d836bf-eff5-4275-88e8-903532054c97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b2ecfd3c404493995776bcec1646908'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:33.907018 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-28d836bf-eff5-4275-88e8-903532054c97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b2ecfd3c404493995776bcec1646908'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:33.914572 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-28d836bf-eff5-4275-88e8-903532054c97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b2ecfd3c404493995776bcec1646908'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:33.920765 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1253/2488] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 14 10:14:33 2022] DELETE /identity/v3/users/9b2ecfd3c404493995776bcec1646908 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:14:34.203996 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25135f1-4fed-4e8d-a92a-c76d8e7981fc admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:34.205523 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-b25135f1-4fed-4e8d-a92a-c76d8e7981fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:14:34.219148 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25135f1-4fed-4e8d-a92a-c76d8e7981fc admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:34.257276 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:14:34.283669 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7e511e-a7c2-456f-9fd1-cf416296feb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:34.284544 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7e511e-a7c2-456f-9fd1-cf416296feb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:34.284830 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7e511e-a7c2-456f-9fd1-cf416296feb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:34.285109 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7e511e-a7c2-456f-9fd1-cf416296feb2 admin admin] PATH_INFO: `/v3/projects/1db35469ee614f4894c334d41b66fe63` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:34.286351 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7e511e-a7c2-456f-9fd1-cf416296feb2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1db35469ee614f4894c334d41b66fe63)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:34.288265 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7e511e-a7c2-456f-9fd1-cf416296feb2 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:34.334206 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-ec7e511e-a7c2-456f-9fd1-cf416296feb2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1db35469ee614f4894c334d41b66fe63', 'request_id': 'req-ec7e511e-a7c2-456f-9fd1-cf416296feb2'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:34.341519 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-ec7e511e-a7c2-456f-9fd1-cf416296feb2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1db35469ee614f4894c334d41b66fe63', 'request_id': 'req-ec7e511e-a7c2-456f-9fd1-cf416296feb2'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:34.348289 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-ec7e511e-a7c2-456f-9fd1-cf416296feb2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1db35469ee614f4894c334d41b66fe63', 'request_id': 'req-ec7e511e-a7c2-456f-9fd1-cf416296feb2'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:34.359441 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-ec7e511e-a7c2-456f-9fd1-cf416296feb2 admin admin] The token cache is being invalidate because project 1db35469ee614f4894c334d41b66fe63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:14:34.359731 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-ec7e511e-a7c2-456f-9fd1-cf416296feb2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:34.360375 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-ec7e511e-a7c2-456f-9fd1-cf416296feb2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:34.362536 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1236/2489] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 14 10:14:34 2022] DELETE /identity/v3/projects/1db35469ee614f4894c334d41b66fe63 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:14:34.367438 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa079db9-b13b-4543-891e-8a5f2ff86904 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:34.367730 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa079db9-b13b-4543-891e-8a5f2ff86904 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:34.368014 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa079db9-b13b-4543-891e-8a5f2ff86904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:34.375191 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:14:34.388691 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-aa079db9-b13b-4543-891e-8a5f2ff86904 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:14:34.389897 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-aa079db9-b13b-4543-891e-8a5f2ff86904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:14:34.451390 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1254/2490] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 10:14:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:14:34.460399 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ec4877-dbe6-4b78-b53a-2ab0a38eca7f None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:34.460693 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ec4877-dbe6-4b78-b53a-2ab0a38eca7f None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:34.460978 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ec4877-dbe6-4b78-b53a-2ab0a38eca7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:34.479858 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-32ec4877-dbe6-4b78-b53a-2ab0a38eca7f None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:14:34.481095 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-32ec4877-dbe6-4b78-b53a-2ab0a38eca7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:14:34.489716 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1237/2491] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 10:14:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:14:34.494018 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa079db9-b13b-4543-891e-8a5f2ff86904 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:34.503614 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa079db9-b13b-4543-891e-8a5f2ff86904 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:34.508131 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddc4cd3-66f4-457d-acad-54664378681c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:34.508728 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddc4cd3-66f4-457d-acad-54664378681c admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:34.509009 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddc4cd3-66f4-457d-acad-54664378681c admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:34.509283 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddc4cd3-66f4-457d-acad-54664378681c admin admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:34.510006 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddc4cd3-66f4-457d-acad-54664378681c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:14:34.510352 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddc4cd3-66f4-457d-acad-54664378681c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:34.511938 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddc4cd3-66f4-457d-acad-54664378681c admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:34.523321 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1255/2492] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jul 14 10:14:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:14:34.527714 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ec4877-dbe6-4b78-b53a-2ab0a38eca7f None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:34.537757 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ec4877-dbe6-4b78-b53a-2ab0a38eca7f None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:34.542472 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cfed45-e901-4cab-84d4-6ccaf6fb629c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:34.543129 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cfed45-e901-4cab-84d4-6ccaf6fb629c admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:34.543414 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cfed45-e901-4cab-84d4-6ccaf6fb629c admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:34.543688 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cfed45-e901-4cab-84d4-6ccaf6fb629c admin admin] PATH_INFO: `/v3/projects` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:34.544384 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cfed45-e901-4cab-84d4-6ccaf6fb629c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:34.546541 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cfed45-e901-4cab-84d4-6ccaf6fb629c admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:34.572996 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1238/2493] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 14 10:14:34 2022] POST /identity/v3/projects => generated 401 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:14:34.577105 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddc4cd3-66f4-457d-acad-54664378681c admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:34.588036 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddc4cd3-66f4-457d-acad-54664378681c admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:34.645671 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e30eb0-8d8f-4785-9b73-f92442d56917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:34.646399 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e30eb0-8d8f-4785-9b73-f92442d56917 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:34.646685 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e30eb0-8d8f-4785-9b73-f92442d56917 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:34.646967 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e30eb0-8d8f-4785-9b73-f92442d56917 admin admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:34.647669 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e30eb0-8d8f-4785-9b73-f92442d56917 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:34.649571 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e30eb0-8d8f-4785-9b73-f92442d56917 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:34.669378 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1256/2494] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 14 10:14:34 2022] POST /identity/v3/users => generated 301 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 10:14:34.673516 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cfed45-e901-4cab-84d4-6ccaf6fb629c admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:34.684068 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cfed45-e901-4cab-84d4-6ccaf6fb629c admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:34.688681 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64fdca3-700f-460c-9f6a-e554e98e00b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:34.689344 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64fdca3-700f-460c-9f6a-e554e98e00b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:34.689622 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64fdca3-700f-460c-9f6a-e554e98e00b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:34.689931 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64fdca3-700f-460c-9f6a-e554e98e00b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:34.690807 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64fdca3-700f-460c-9f6a-e554e98e00b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:34.692395 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64fdca3-700f-460c-9f6a-e554e98e00b8 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:34.703128 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1239/2495] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 10:14:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:14:34.707702 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e30eb0-8d8f-4785-9b73-f92442d56917 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:34.717914 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e30eb0-8d8f-4785-9b73-f92442d56917 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:34.723572 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e84b424-cee1-4ffe-802b-5982c15d82ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:34.724235 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e84b424-cee1-4ffe-802b-5982c15d82ee admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:34.724518 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e84b424-cee1-4ffe-802b-5982c15d82ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:34.724794 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e84b424-cee1-4ffe-802b-5982c15d82ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:34.725521 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e84b424-cee1-4ffe-802b-5982c15d82ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:34.727167 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e84b424-cee1-4ffe-802b-5982c15d82ee admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:34.739384 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1257/2496] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 10:14:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:14:34.743660 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64fdca3-700f-460c-9f6a-e554e98e00b8 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:34.753695 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64fdca3-700f-460c-9f6a-e554e98e00b8 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:34.758518 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b73e1f9-5e30-4846-8383-7fc26c607d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:34.759308 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b73e1f9-5e30-4846-8383-7fc26c607d21 admin admin] REQUEST_METHOD: `PUT` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:34.759587 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b73e1f9-5e30-4846-8383-7fc26c607d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:34.759858 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b73e1f9-5e30-4846-8383-7fc26c607d21 admin admin] PATH_INFO: `/v3/projects/ed6f3b0f4cc8437dbdd8cdb020ae6054/users/4d85aa67f2e14f99850b689f914039f0/roles/17dfac38a2e540fea229af7de99911bb` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:34.775029 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b73e1f9-5e30-4846-8383-7fc26c607d21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed6f3b0f4cc8437dbdd8cdb020ae6054, user_id=4d85aa67f2e14f99850b689f914039f0, role_id=17dfac38a2e540fea229af7de99911bb)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:34.777831 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b73e1f9-5e30-4846-8383-7fc26c607d21 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:34.792060 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1240/2497] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 14 10:14:34 2022] PUT /identity/v3/projects/ed6f3b0f4cc8437dbdd8cdb020ae6054/users/4d85aa67f2e14f99850b689f914039f0/roles/17dfac38a2e540fea229af7de99911bb => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:14:34.802320 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb837f5-41ba-481a-a578-e92c8a692dfb None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:34.803113 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb837f5-41ba-481a-a578-e92c8a692dfb None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:34.803113 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb837f5-41ba-481a-a578-e92c8a692dfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:34.837707 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-0bb837f5-41ba-481a-a578-e92c8a692dfb None None] MFA Rules not processed for user `4d85aa67f2e14f99850b689f914039f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:14:34.839035 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-0bb837f5-41ba-481a-a578-e92c8a692dfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:14:34.909215 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:14:34.914526 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1258/2498] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 10:14:34 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:14:34.917641 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b73e1f9-5e30-4846-8383-7fc26c607d21 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:34.982056 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b73e1f9-5e30-4846-8383-7fc26c607d21 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:34.987429 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5abd2c-78f4-42a4-9dc3-d911e97dcf4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:34.988103 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5abd2c-78f4-42a4-9dc3-d911e97dcf4e admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:34.988392 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5abd2c-78f4-42a4-9dc3-d911e97dcf4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:34.988675 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5abd2c-78f4-42a4-9dc3-d911e97dcf4e admin admin] PATH_INFO: `/v3/projects` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:34.989392 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5abd2c-78f4-42a4-9dc3-d911e97dcf4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:34.991419 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5abd2c-78f4-42a4-9dc3-d911e97dcf4e admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:34.995813 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:14:35.022586 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1241/2499] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 14 10:14:34 2022] POST /identity/v3/projects => generated 399 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:14:35.027018 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb837f5-41ba-481a-a578-e92c8a692dfb None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:35.038380 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb837f5-41ba-481a-a578-e92c8a692dfb None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:35.097154 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c74afe-cebf-4f81-99bb-319ea70df836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:35.097833 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c74afe-cebf-4f81-99bb-319ea70df836 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:35.098122 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c74afe-cebf-4f81-99bb-319ea70df836 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:35.098436 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c74afe-cebf-4f81-99bb-319ea70df836 admin admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:35.099136 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c74afe-cebf-4f81-99bb-319ea70df836 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:35.101085 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c74afe-cebf-4f81-99bb-319ea70df836 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:35.121144 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1259/2500] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 14 10:14:35 2022] POST /identity/v3/users => generated 306 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:14:35.125165 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5abd2c-78f4-42a4-9dc3-d911e97dcf4e admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:35.136549 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5abd2c-78f4-42a4-9dc3-d911e97dcf4e admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:35.141385 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f06c71d-88b6-4351-ab91-b8268bf92798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:35.142741 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f06c71d-88b6-4351-ab91-b8268bf92798 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:35.143045 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f06c71d-88b6-4351-ab91-b8268bf92798 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:35.143263 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f06c71d-88b6-4351-ab91-b8268bf92798 admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:35.144004 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f06c71d-88b6-4351-ab91-b8268bf92798 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:35.145601 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f06c71d-88b6-4351-ab91-b8268bf92798 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:35.156821 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1242/2501] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 10:14:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:14:35.160958 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c74afe-cebf-4f81-99bb-319ea70df836 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:35.170940 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c74afe-cebf-4f81-99bb-319ea70df836 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:35.175587 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388d0c17-a103-4665-9dfe-c441c09d71a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:35.176466 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388d0c17-a103-4665-9dfe-c441c09d71a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:35.176755 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388d0c17-a103-4665-9dfe-c441c09d71a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:35.177036 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388d0c17-a103-4665-9dfe-c441c09d71a5 admin admin] PATH_INFO: `/v3/projects/d2aa01882c2b4336ab316a6361cedaca/users/5bbab24f948649129ebc2ff70a201074/roles/e3965bd0d5f1427a86a313c0c90bfef3` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:35.192571 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388d0c17-a103-4665-9dfe-c441c09d71a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2aa01882c2b4336ab316a6361cedaca, user_id=5bbab24f948649129ebc2ff70a201074, role_id=e3965bd0d5f1427a86a313c0c90bfef3)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:35.195260 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388d0c17-a103-4665-9dfe-c441c09d71a5 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:35.208917 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1260/2502] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 14 10:14:35 2022] PUT /identity/v3/projects/d2aa01882c2b4336ab316a6361cedaca/users/5bbab24f948649129ebc2ff70a201074/roles/e3965bd0d5f1427a86a313c0c90bfef3 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:14:35.213042 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f06c71d-88b6-4351-ab91-b8268bf92798 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:35.223094 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f06c71d-88b6-4351-ab91-b8268bf92798 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:35.285438 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f011bd-c106-4253-bf92-9542cbf06e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:35.286036 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f011bd-c106-4253-bf92-9542cbf06e25 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:35.286362 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f011bd-c106-4253-bf92-9542cbf06e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:35.286647 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f011bd-c106-4253-bf92-9542cbf06e25 admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:35.287414 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f011bd-c106-4253-bf92-9542cbf06e25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:35.289023 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f011bd-c106-4253-bf92-9542cbf06e25 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:35.299105 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1243/2503] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 10:14:35 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:14:35.303747 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388d0c17-a103-4665-9dfe-c441c09d71a5 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:35.314718 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388d0c17-a103-4665-9dfe-c441c09d71a5 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:35.319445 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0a1885-e9c5-4647-9aff-ac2e9b3d2d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:35.320323 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0a1885-e9c5-4647-9aff-ac2e9b3d2d9c admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:35.320611 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0a1885-e9c5-4647-9aff-ac2e9b3d2d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:35.320889 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0a1885-e9c5-4647-9aff-ac2e9b3d2d9c admin admin] PATH_INFO: `/v3/projects/d2aa01882c2b4336ab316a6361cedaca/users/5bbab24f948649129ebc2ff70a201074/roles/e3965bd0d5f1427a86a313c0c90bfef3` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:35.322891 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0a1885-e9c5-4647-9aff-ac2e9b3d2d9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2aa01882c2b4336ab316a6361cedaca, user_id=5bbab24f948649129ebc2ff70a201074, role_id=e3965bd0d5f1427a86a313c0c90bfef3)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:35.325527 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0a1885-e9c5-4647-9aff-ac2e9b3d2d9c admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:35.336499 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1261/2504] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 14 10:14:35 2022] PUT /identity/v3/projects/d2aa01882c2b4336ab316a6361cedaca/users/5bbab24f948649129ebc2ff70a201074/roles/e3965bd0d5f1427a86a313c0c90bfef3 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:14:35.346624 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a170f986-0085-4480-be43-9aa88b145a04 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:35.346935 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a170f986-0085-4480-be43-9aa88b145a04 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:35.347237 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a170f986-0085-4480-be43-9aa88b145a04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:35.373866 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-a170f986-0085-4480-be43-9aa88b145a04 None None] MFA Rules not processed for user `5bbab24f948649129ebc2ff70a201074`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:14:35.375121 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-a170f986-0085-4480-be43-9aa88b145a04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:14:35.444353 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1244/2505] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 10:14:35 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:14:35.456257 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0a1885-e9c5-4647-9aff-ac2e9b3d2d9c admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:35.458876 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-fd0a1885-e9c5-4647-9aff-ac2e9b3d2d9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:14:35.517382 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0a1885-e9c5-4647-9aff-ac2e9b3d2d9c admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:35.521094 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dc06fb-5c01-463d-bd57-f2164451e2e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25048b29787d482783ebc944f1a7df65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:35.521727 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dc06fb-5c01-463d-bd57-f2164451e2e3 service cinder] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:35.522018 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dc06fb-5c01-463d-bd57-f2164451e2e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:35.522334 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dc06fb-5c01-463d-bd57-f2164451e2e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:35.531813 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dc06fb-5c01-463d-bd57-f2164451e2e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:35.533297 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dc06fb-5c01-463d-bd57-f2164451e2e3 service cinder] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:35.543153 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1262/2506] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 10:14:35 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:14:35.625333 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a170f986-0085-4480-be43-9aa88b145a04 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:35.636397 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a170f986-0085-4480-be43-9aa88b145a04 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:35.640191 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f693d7e2-cfa0-4c06-89bf-1de453235f75 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25048b29787d482783ebc944f1a7df65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:35.640848 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f693d7e2-cfa0-4c06-89bf-1de453235f75 service cinder] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:35.641138 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f693d7e2-cfa0-4c06-89bf-1de453235f75 service cinder] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:35.641421 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f693d7e2-cfa0-4c06-89bf-1de453235f75 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:35.698806 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:14:35.701594 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f693d7e2-cfa0-4c06-89bf-1de453235f75 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:35.703355 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f693d7e2-cfa0-4c06-89bf-1de453235f75 service cinder] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:35.713423 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1245/2507] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 10:14:35 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:14:39.757531 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dc06fb-5c01-463d-bd57-f2164451e2e3 service cinder] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:39.818176 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:14:39.825110 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dc06fb-5c01-463d-bd57-f2164451e2e3 service cinder] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:39.830493 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae217c5-ecf0-40eb-8d93-04ff3af5bbed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:39.831373 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae217c5-ecf0-40eb-8d93-04ff3af5bbed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:39.831659 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae217c5-ecf0-40eb-8d93-04ff3af5bbed admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:39.831938 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae217c5-ecf0-40eb-8d93-04ff3af5bbed admin admin] PATH_INFO: `/v3/users/4d85aa67f2e14f99850b689f914039f0` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:39.833154 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae217c5-ecf0-40eb-8d93-04ff3af5bbed admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d85aa67f2e14f99850b689f914039f0)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:39.835119 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae217c5-ecf0-40eb-8d93-04ff3af5bbed admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:39.881039 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-4ae217c5-ecf0-40eb-8d93-04ff3af5bbed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d85aa67f2e14f99850b689f914039f0'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:39.893263 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-4ae217c5-ecf0-40eb-8d93-04ff3af5bbed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d85aa67f2e14f99850b689f914039f0'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:39.894336 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-4ae217c5-ecf0-40eb-8d93-04ff3af5bbed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d85aa67f2e14f99850b689f914039f0'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:39.903861 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-4ae217c5-ecf0-40eb-8d93-04ff3af5bbed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d85aa67f2e14f99850b689f914039f0'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:39.911100 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-4ae217c5-ecf0-40eb-8d93-04ff3af5bbed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d85aa67f2e14f99850b689f914039f0'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:39.917198 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1263/2508] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 14 10:14:39 2022] DELETE /identity/v3/users/4d85aa67f2e14f99850b689f914039f0 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:14:39.921831 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24165dbd-880d-430b-911b-f6acf0a2446b None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:39.922353 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24165dbd-880d-430b-911b-f6acf0a2446b None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:39.922460 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24165dbd-880d-430b-911b-f6acf0a2446b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:39.940675 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-24165dbd-880d-430b-911b-f6acf0a2446b None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:14:39.941890 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-24165dbd-880d-430b-911b-f6acf0a2446b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:14:40.001006 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1246/2509] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 10:14:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:14:40.011199 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae217c5-ecf0-40eb-8d93-04ff3af5bbed admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:40.012627 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-4ae217c5-ecf0-40eb-8d93-04ff3af5bbed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:14:40.071381 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae217c5-ecf0-40eb-8d93-04ff3af5bbed admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:40.075312 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b663517-ae6f-4059-b0c0-d628e9af71eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e4a5a8965e4802a9055d332179b7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:40.075971 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b663517-ae6f-4059-b0c0-d628e9af71eb service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:40.076258 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b663517-ae6f-4059-b0c0-d628e9af71eb service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:40.076539 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b663517-ae6f-4059-b0c0-d628e9af71eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:40.087163 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b663517-ae6f-4059-b0c0-d628e9af71eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:40.088626 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b663517-ae6f-4059-b0c0-d628e9af71eb service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:40.101056 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1264/2510] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 10:14:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:14:40.384899 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24165dbd-880d-430b-911b-f6acf0a2446b None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:40.386421 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-24165dbd-880d-430b-911b-f6acf0a2446b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:14:40.398827 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24165dbd-880d-430b-911b-f6acf0a2446b None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:40.403440 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b29f63c-cb4d-4a0e-8ca0-70ba78acf92f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:40.404314 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b29f63c-cb4d-4a0e-8ca0-70ba78acf92f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:40.404711 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b29f63c-cb4d-4a0e-8ca0-70ba78acf92f admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:40.404996 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b29f63c-cb4d-4a0e-8ca0-70ba78acf92f admin admin] PATH_INFO: `/v3/projects/ed6f3b0f4cc8437dbdd8cdb020ae6054` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:40.406222 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b29f63c-cb4d-4a0e-8ca0-70ba78acf92f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed6f3b0f4cc8437dbdd8cdb020ae6054)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:40.408659 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b29f63c-cb4d-4a0e-8ca0-70ba78acf92f admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:40.463146 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-6b29f63c-cb4d-4a0e-8ca0-70ba78acf92f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed6f3b0f4cc8437dbdd8cdb020ae6054', 'request_id': 'req-6b29f63c-cb4d-4a0e-8ca0-70ba78acf92f'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:40.471595 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-6b29f63c-cb4d-4a0e-8ca0-70ba78acf92f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed6f3b0f4cc8437dbdd8cdb020ae6054', 'request_id': 'req-6b29f63c-cb4d-4a0e-8ca0-70ba78acf92f'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:40.477764 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-6b29f63c-cb4d-4a0e-8ca0-70ba78acf92f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed6f3b0f4cc8437dbdd8cdb020ae6054', 'request_id': 'req-6b29f63c-cb4d-4a0e-8ca0-70ba78acf92f'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:40.489367 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-6b29f63c-cb4d-4a0e-8ca0-70ba78acf92f admin admin] The token cache is being invalidate because project ed6f3b0f4cc8437dbdd8cdb020ae6054 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:14:40.489657 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-6b29f63c-cb4d-4a0e-8ca0-70ba78acf92f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:40.490318 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-6b29f63c-cb4d-4a0e-8ca0-70ba78acf92f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:40.491848 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1247/2511] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 14 10:14:40 2022] DELETE /identity/v3/projects/ed6f3b0f4cc8437dbdd8cdb020ae6054 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:14:40.495881 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b663517-ae6f-4059-b0c0-d628e9af71eb service neutron] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:40.505505 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b663517-ae6f-4059-b0c0-d628e9af71eb service neutron] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:40.561921 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e600d1-bb32-4514-b59e-2b09c17e6f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:40.563140 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e600d1-bb32-4514-b59e-2b09c17e6f4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:40.563566 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e600d1-bb32-4514-b59e-2b09c17e6f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:40.563846 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e600d1-bb32-4514-b59e-2b09c17e6f4e admin admin] PATH_INFO: `/v3/users/5bbab24f948649129ebc2ff70a201074` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:40.565072 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e600d1-bb32-4514-b59e-2b09c17e6f4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5bbab24f948649129ebc2ff70a201074)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:40.567018 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e600d1-bb32-4514-b59e-2b09c17e6f4e admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:40.588123 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:14:40.615352 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-42e600d1-bb32-4514-b59e-2b09c17e6f4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5bbab24f948649129ebc2ff70a201074'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:40.627109 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-42e600d1-bb32-4514-b59e-2b09c17e6f4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5bbab24f948649129ebc2ff70a201074'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:40.627786 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-42e600d1-bb32-4514-b59e-2b09c17e6f4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5bbab24f948649129ebc2ff70a201074'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:40.635392 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-42e600d1-bb32-4514-b59e-2b09c17e6f4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5bbab24f948649129ebc2ff70a201074'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:40.643005 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-42e600d1-bb32-4514-b59e-2b09c17e6f4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5bbab24f948649129ebc2ff70a201074'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:40.649017 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1265/2512] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 14 10:14:40 2022] DELETE /identity/v3/users/5bbab24f948649129ebc2ff70a201074 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:14:40.920670 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b29f63c-cb4d-4a0e-8ca0-70ba78acf92f admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:40.922147 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-6b29f63c-cb4d-4a0e-8ca0-70ba78acf92f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:14:40.936784 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b29f63c-cb4d-4a0e-8ca0-70ba78acf92f admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:41.002104 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12dc630-e9b7-4034-939b-e33e26938841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:41.003078 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12dc630-e9b7-4034-939b-e33e26938841 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:41.003364 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12dc630-e9b7-4034-939b-e33e26938841 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:41.003643 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12dc630-e9b7-4034-939b-e33e26938841 admin admin] PATH_INFO: `/v3/projects/d2aa01882c2b4336ab316a6361cedaca` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:41.004855 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12dc630-e9b7-4034-939b-e33e26938841 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2aa01882c2b4336ab316a6361cedaca)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:41.006815 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12dc630-e9b7-4034-939b-e33e26938841 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:41.031820 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:14:41.057150 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-e12dc630-e9b7-4034-939b-e33e26938841 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2aa01882c2b4336ab316a6361cedaca', 'request_id': 'req-e12dc630-e9b7-4034-939b-e33e26938841'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:41.065525 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-e12dc630-e9b7-4034-939b-e33e26938841 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2aa01882c2b4336ab316a6361cedaca', 'request_id': 'req-e12dc630-e9b7-4034-939b-e33e26938841'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:41.072910 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-e12dc630-e9b7-4034-939b-e33e26938841 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2aa01882c2b4336ab316a6361cedaca', 'request_id': 'req-e12dc630-e9b7-4034-939b-e33e26938841'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:41.083787 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-e12dc630-e9b7-4034-939b-e33e26938841 admin admin] The token cache is being invalidate because project d2aa01882c2b4336ab316a6361cedaca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:14:41.084078 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-e12dc630-e9b7-4034-939b-e33e26938841 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:41.084712 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-e12dc630-e9b7-4034-939b-e33e26938841 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:41.086275 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1248/2513] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 14 10:14:40 2022] DELETE /identity/v3/projects/d2aa01882c2b4336ab316a6361cedaca => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:14:41.091451 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b4434e-ad37-4230-982f-1c60a6be37e2 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:41.091883 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b4434e-ad37-4230-982f-1c60a6be37e2 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:41.092014 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b4434e-ad37-4230-982f-1c60a6be37e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:41.112494 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-d1b4434e-ad37-4230-982f-1c60a6be37e2 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:14:41.113721 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-d1b4434e-ad37-4230-982f-1c60a6be37e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:14:41.172153 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1266/2514] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 10:14:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:14:41.182137 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bf3c58-c1d5-4b09-a782-b625bf92f409 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:41.182457 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bf3c58-c1d5-4b09-a782-b625bf92f409 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:41.182735 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bf3c58-c1d5-4b09-a782-b625bf92f409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:41.201458 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-66bf3c58-c1d5-4b09-a782-b625bf92f409 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:14:41.202692 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-66bf3c58-c1d5-4b09-a782-b625bf92f409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:14:41.210728 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1249/2515] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 10:14:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:14:41.214916 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b4434e-ad37-4230-982f-1c60a6be37e2 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:41.225412 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b4434e-ad37-4230-982f-1c60a6be37e2 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:41.230026 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209dd330-c67f-4e63-9b81-df2ece08525b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:41.230717 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209dd330-c67f-4e63-9b81-df2ece08525b admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:41.231004 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209dd330-c67f-4e63-9b81-df2ece08525b admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:41.231285 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209dd330-c67f-4e63-9b81-df2ece08525b admin admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:41.232019 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209dd330-c67f-4e63-9b81-df2ece08525b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:14:41.232328 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209dd330-c67f-4e63-9b81-df2ece08525b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:41.233922 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209dd330-c67f-4e63-9b81-df2ece08525b admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:41.246354 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1267/2516] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jul 14 10:14:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:14:41.250847 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bf3c58-c1d5-4b09-a782-b625bf92f409 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:41.260291 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bf3c58-c1d5-4b09-a782-b625bf92f409 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:41.264946 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170603a9-f37a-4af8-a3cf-a1e6d2648eea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:41.265603 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170603a9-f37a-4af8-a3cf-a1e6d2648eea admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:41.265887 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170603a9-f37a-4af8-a3cf-a1e6d2648eea admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:41.266356 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170603a9-f37a-4af8-a3cf-a1e6d2648eea admin admin] PATH_INFO: `/v3/projects` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:41.267082 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170603a9-f37a-4af8-a3cf-a1e6d2648eea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:41.269014 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170603a9-f37a-4af8-a3cf-a1e6d2648eea admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:41.299516 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1250/2517] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 14 10:14:41 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:14:41.300610 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209dd330-c67f-4e63-9b81-df2ece08525b admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:41.310817 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209dd330-c67f-4e63-9b81-df2ece08525b admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:41.370495 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20c1b1d-266c-4931-963c-0fe6b221eaa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:41.371194 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20c1b1d-266c-4931-963c-0fe6b221eaa4 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:41.371467 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20c1b1d-266c-4931-963c-0fe6b221eaa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:41.371746 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20c1b1d-266c-4931-963c-0fe6b221eaa4 admin admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:41.372454 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20c1b1d-266c-4931-963c-0fe6b221eaa4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:41.374400 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20c1b1d-266c-4931-963c-0fe6b221eaa4 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:41.394582 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1268/2518] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 14 10:14:41 2022] POST /identity/v3/users => generated 293 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 10:14:41.398681 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170603a9-f37a-4af8-a3cf-a1e6d2648eea admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:41.409492 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170603a9-f37a-4af8-a3cf-a1e6d2648eea admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:41.414051 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c523ef-7113-43da-8715-573781101dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:41.414763 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c523ef-7113-43da-8715-573781101dfb admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:41.415052 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c523ef-7113-43da-8715-573781101dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:41.415327 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c523ef-7113-43da-8715-573781101dfb admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:41.416053 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c523ef-7113-43da-8715-573781101dfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:41.417642 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c523ef-7113-43da-8715-573781101dfb admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:41.428364 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1251/2519] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 10:14:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:14:41.432268 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20c1b1d-266c-4931-963c-0fe6b221eaa4 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:41.443033 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20c1b1d-266c-4931-963c-0fe6b221eaa4 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:41.449164 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480aad2e-d89c-479f-b488-e86b5c435a0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:41.450171 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480aad2e-d89c-479f-b488-e86b5c435a0e admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:41.450605 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480aad2e-d89c-479f-b488-e86b5c435a0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:41.451188 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480aad2e-d89c-479f-b488-e86b5c435a0e admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:41.452308 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480aad2e-d89c-479f-b488-e86b5c435a0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:41.454241 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480aad2e-d89c-479f-b488-e86b5c435a0e admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:41.465541 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1269/2520] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 10:14:41 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 10:14:41.469757 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c523ef-7113-43da-8715-573781101dfb admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:41.480318 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c523ef-7113-43da-8715-573781101dfb admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:41.484902 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd553d7c-acd4-4461-91e6-90094399a325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:41.485831 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd553d7c-acd4-4461-91e6-90094399a325 admin admin] REQUEST_METHOD: `PUT` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:41.486116 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd553d7c-acd4-4461-91e6-90094399a325 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:41.486427 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd553d7c-acd4-4461-91e6-90094399a325 admin admin] PATH_INFO: `/v3/projects/63375ced5b9441118fe1ae2bb4a6f607/users/e090bc0a97864d44ac62fe56eaea9823/roles/17dfac38a2e540fea229af7de99911bb` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:41.500583 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd553d7c-acd4-4461-91e6-90094399a325 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63375ced5b9441118fe1ae2bb4a6f607, user_id=e090bc0a97864d44ac62fe56eaea9823, role_id=17dfac38a2e540fea229af7de99911bb)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:41.503317 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd553d7c-acd4-4461-91e6-90094399a325 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:41.516841 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1252/2521] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 14 10:14:41 2022] PUT /identity/v3/projects/63375ced5b9441118fe1ae2bb4a6f607/users/e090bc0a97864d44ac62fe56eaea9823/roles/17dfac38a2e540fea229af7de99911bb => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:14:41.528086 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85be51d-15ee-492e-ae62-8276651360ae None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:41.528384 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85be51d-15ee-492e-ae62-8276651360ae None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:41.528672 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85be51d-15ee-492e-ae62-8276651360ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:41.535206 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:DELETE=8,keystone:SELECT=88,keystone:INSERT=4 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:14:41.558487 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-e85be51d-15ee-492e-ae62-8276651360ae None None] MFA Rules not processed for user `e090bc0a97864d44ac62fe56eaea9823`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:14:41.559713 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-e85be51d-15ee-492e-ae62-8276651360ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:14:41.630878 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1270/2522] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 10:14:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:14:41.635414 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd553d7c-acd4-4461-91e6-90094399a325 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:41.696746 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd553d7c-acd4-4461-91e6-90094399a325 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:41.701403 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb443e3f-3184-4d4f-8432-71394b875d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:41.702064 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb443e3f-3184-4d4f-8432-71394b875d46 admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:41.702390 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb443e3f-3184-4d4f-8432-71394b875d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:41.702673 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb443e3f-3184-4d4f-8432-71394b875d46 admin admin] PATH_INFO: `/v3/projects` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:41.703379 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb443e3f-3184-4d4f-8432-71394b875d46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:41.705297 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb443e3f-3184-4d4f-8432-71394b875d46 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:41.729874 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1253/2523] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 14 10:14:41 2022] POST /identity/v3/projects => generated 387 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:14:41.734237 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85be51d-15ee-492e-ae62-8276651360ae None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:41.745333 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85be51d-15ee-492e-ae62-8276651360ae None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:41.801516 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b868cb-8e37-415a-84ff-65dcce8f3a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:41.802221 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b868cb-8e37-415a-84ff-65dcce8f3a6c admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:41.802497 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b868cb-8e37-415a-84ff-65dcce8f3a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:41.802774 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b868cb-8e37-415a-84ff-65dcce8f3a6c admin admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:41.803741 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b868cb-8e37-415a-84ff-65dcce8f3a6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:41.805650 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b868cb-8e37-415a-84ff-65dcce8f3a6c admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:41.826353 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1271/2524] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 14 10:14:41 2022] POST /identity/v3/users => generated 300 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:14:41.830343 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb443e3f-3184-4d4f-8432-71394b875d46 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:41.840921 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb443e3f-3184-4d4f-8432-71394b875d46 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:41.848428 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85234a2b-c5b9-4777-986e-f429e2c68b35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:41.849102 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85234a2b-c5b9-4777-986e-f429e2c68b35 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:41.849384 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85234a2b-c5b9-4777-986e-f429e2c68b35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:41.849659 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85234a2b-c5b9-4777-986e-f429e2c68b35 admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:41.850428 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85234a2b-c5b9-4777-986e-f429e2c68b35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:41.852020 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85234a2b-c5b9-4777-986e-f429e2c68b35 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:41.863526 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1254/2525] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 10:14:41 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:14:41.867978 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b868cb-8e37-415a-84ff-65dcce8f3a6c admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:41.878644 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b868cb-8e37-415a-84ff-65dcce8f3a6c admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:41.883320 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfef381-9dc2-44e5-9092-4097024d99c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:41.884153 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfef381-9dc2-44e5-9092-4097024d99c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:41.884437 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfef381-9dc2-44e5-9092-4097024d99c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:41.884746 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfef381-9dc2-44e5-9092-4097024d99c1 admin admin] PATH_INFO: `/v3/projects/13ea9d8aadd547cebf4776bb06364630/users/13ce1e17e3a3451d9d40a53a4643e185/roles/e3965bd0d5f1427a86a313c0c90bfef3` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:41.899847 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfef381-9dc2-44e5-9092-4097024d99c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13ea9d8aadd547cebf4776bb06364630, user_id=13ce1e17e3a3451d9d40a53a4643e185, role_id=e3965bd0d5f1427a86a313c0c90bfef3)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:41.902551 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfef381-9dc2-44e5-9092-4097024d99c1 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:41.916208 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1272/2526] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 14 10:14:41 2022] PUT /identity/v3/projects/13ea9d8aadd547cebf4776bb06364630/users/13ce1e17e3a3451d9d40a53a4643e185/roles/e3965bd0d5f1427a86a313c0c90bfef3 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:14:41.920296 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85234a2b-c5b9-4777-986e-f429e2c68b35 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:41.930874 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85234a2b-c5b9-4777-986e-f429e2c68b35 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:41.947741 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:14:41.988497 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7692b4-5bd7-4e16-8eb6-b78b2ab90421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:41.989195 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7692b4-5bd7-4e16-8eb6-b78b2ab90421 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:41.989478 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7692b4-5bd7-4e16-8eb6-b78b2ab90421 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:41.989756 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7692b4-5bd7-4e16-8eb6-b78b2ab90421 admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:41.990507 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7692b4-5bd7-4e16-8eb6-b78b2ab90421 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:41.992139 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7692b4-5bd7-4e16-8eb6-b78b2ab90421 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:42.002602 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1255/2527] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 10:14:41 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:14:42.006932 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfef381-9dc2-44e5-9092-4097024d99c1 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:42.017822 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfef381-9dc2-44e5-9092-4097024d99c1 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:42.022486 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91ead46-e646-4b85-9755-08961be94ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:42.023376 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91ead46-e646-4b85-9755-08961be94ee1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:42.023660 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91ead46-e646-4b85-9755-08961be94ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:42.023938 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91ead46-e646-4b85-9755-08961be94ee1 admin admin] PATH_INFO: `/v3/projects/13ea9d8aadd547cebf4776bb06364630/users/13ce1e17e3a3451d9d40a53a4643e185/roles/e3965bd0d5f1427a86a313c0c90bfef3` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:42.025917 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91ead46-e646-4b85-9755-08961be94ee1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13ea9d8aadd547cebf4776bb06364630, user_id=13ce1e17e3a3451d9d40a53a4643e185, role_id=e3965bd0d5f1427a86a313c0c90bfef3)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:42.028747 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91ead46-e646-4b85-9755-08961be94ee1 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:42.039631 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1273/2528] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 14 10:14:42 2022] PUT /identity/v3/projects/13ea9d8aadd547cebf4776bb06364630/users/13ce1e17e3a3451d9d40a53a4643e185/roles/e3965bd0d5f1427a86a313c0c90bfef3 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:14:42.051030 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab10496-fb74-465f-8d6d-bf13ff4389d9 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:42.051350 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab10496-fb74-465f-8d6d-bf13ff4389d9 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:42.051631 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab10496-fb74-465f-8d6d-bf13ff4389d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:42.088258 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-8ab10496-fb74-465f-8d6d-bf13ff4389d9 None None] MFA Rules not processed for user `13ce1e17e3a3451d9d40a53a4643e185`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:14:42.089478 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-8ab10496-fb74-465f-8d6d-bf13ff4389d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:14:42.159844 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1256/2529] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 10:14:42 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:14:42.170624 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91ead46-e646-4b85-9755-08961be94ee1 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:42.172347 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-f91ead46-e646-4b85-9755-08961be94ee1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:14:42.219489 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:14:42.231281 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91ead46-e646-4b85-9755-08961be94ee1 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:42.235006 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d350d9-6ad8-493f-b3e0-fa0a4343b98e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25048b29787d482783ebc944f1a7df65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:42.235659 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d350d9-6ad8-493f-b3e0-fa0a4343b98e service cinder] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:42.236451 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d350d9-6ad8-493f-b3e0-fa0a4343b98e service cinder] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:42.236733 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d350d9-6ad8-493f-b3e0-fa0a4343b98e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:42.246030 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d350d9-6ad8-493f-b3e0-fa0a4343b98e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:42.247508 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d350d9-6ad8-493f-b3e0-fa0a4343b98e service cinder] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:42.257553 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1274/2530] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 10:14:42 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:14:42.817355 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab10496-fb74-465f-8d6d-bf13ff4389d9 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:42.879625 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab10496-fb74-465f-8d6d-bf13ff4389d9 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:42.884129 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b783b8-ecf3-4e31-85ee-1073e6548799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:42.885006 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b783b8-ecf3-4e31-85ee-1073e6548799 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:42.885293 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b783b8-ecf3-4e31-85ee-1073e6548799 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:42.885570 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b783b8-ecf3-4e31-85ee-1073e6548799 admin admin] PATH_INFO: `/v3/users/e090bc0a97864d44ac62fe56eaea9823` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:42.886803 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b783b8-ecf3-4e31-85ee-1073e6548799 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e090bc0a97864d44ac62fe56eaea9823)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:42.888749 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b783b8-ecf3-4e31-85ee-1073e6548799 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:42.935539 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:14:42.938394 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-e2b783b8-ecf3-4e31-85ee-1073e6548799 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e090bc0a97864d44ac62fe56eaea9823'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:42.946827 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-e2b783b8-ecf3-4e31-85ee-1073e6548799 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e090bc0a97864d44ac62fe56eaea9823'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:42.947524 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-e2b783b8-ecf3-4e31-85ee-1073e6548799 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e090bc0a97864d44ac62fe56eaea9823'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:42.956192 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-e2b783b8-ecf3-4e31-85ee-1073e6548799 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e090bc0a97864d44ac62fe56eaea9823'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:42.956803 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-e2b783b8-ecf3-4e31-85ee-1073e6548799 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e090bc0a97864d44ac62fe56eaea9823'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:42.975068 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1257/2531] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 14 10:14:42 2022] DELETE /identity/v3/users/e090bc0a97864d44ac62fe56eaea9823 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:14:42.979549 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdcec73-c362-4a17-befb-55995a5c122d None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:42.979851 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdcec73-c362-4a17-befb-55995a5c122d None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:42.980136 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdcec73-c362-4a17-befb-55995a5c122d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:42.998522 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-3fdcec73-c362-4a17-befb-55995a5c122d None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:14:42.999732 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-3fdcec73-c362-4a17-befb-55995a5c122d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:14:43.058050 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1275/2532] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 10:14:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:14:43.067598 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b783b8-ecf3-4e31-85ee-1073e6548799 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:43.069004 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-e2b783b8-ecf3-4e31-85ee-1073e6548799 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:14:43.128351 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b783b8-ecf3-4e31-85ee-1073e6548799 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:43.132151 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e73549d-8644-4b4b-aa34-dec611316d38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e4a5a8965e4802a9055d332179b7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:43.132804 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e73549d-8644-4b4b-aa34-dec611316d38 service neutron] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:43.133090 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e73549d-8644-4b4b-aa34-dec611316d38 service neutron] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:43.133369 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e73549d-8644-4b4b-aa34-dec611316d38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:43.143240 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e73549d-8644-4b4b-aa34-dec611316d38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:43.144767 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e73549d-8644-4b4b-aa34-dec611316d38 service neutron] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:43.154859 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1258/2533] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 10:14:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:14:43.433729 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdcec73-c362-4a17-befb-55995a5c122d None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:43.435483 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-3fdcec73-c362-4a17-befb-55995a5c122d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:14:43.448484 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdcec73-c362-4a17-befb-55995a5c122d None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:43.454427 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3567f163-7aeb-40bb-9296-eb0433281b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:43.455428 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3567f163-7aeb-40bb-9296-eb0433281b61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:43.455718 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3567f163-7aeb-40bb-9296-eb0433281b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:43.456000 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3567f163-7aeb-40bb-9296-eb0433281b61 admin admin] PATH_INFO: `/v3/projects/63375ced5b9441118fe1ae2bb4a6f607` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:43.457276 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3567f163-7aeb-40bb-9296-eb0433281b61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63375ced5b9441118fe1ae2bb4a6f607)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:43.459218 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3567f163-7aeb-40bb-9296-eb0433281b61 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:43.512422 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-3567f163-7aeb-40bb-9296-eb0433281b61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63375ced5b9441118fe1ae2bb4a6f607', 'request_id': 'req-3567f163-7aeb-40bb-9296-eb0433281b61'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:43.518730 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-3567f163-7aeb-40bb-9296-eb0433281b61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63375ced5b9441118fe1ae2bb4a6f607', 'request_id': 'req-3567f163-7aeb-40bb-9296-eb0433281b61'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:43.524212 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-3567f163-7aeb-40bb-9296-eb0433281b61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63375ced5b9441118fe1ae2bb4a6f607', 'request_id': 'req-3567f163-7aeb-40bb-9296-eb0433281b61'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:43.538597 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-3567f163-7aeb-40bb-9296-eb0433281b61 admin admin] The token cache is being invalidate because project 63375ced5b9441118fe1ae2bb4a6f607 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:14:43.538873 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-3567f163-7aeb-40bb-9296-eb0433281b61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:43.539513 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-3567f163-7aeb-40bb-9296-eb0433281b61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:43.541067 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1276/2534] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 14 10:14:43 2022] DELETE /identity/v3/projects/63375ced5b9441118fe1ae2bb4a6f607 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:14:43.545015 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e73549d-8644-4b4b-aa34-dec611316d38 service neutron] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:43.555948 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e73549d-8644-4b4b-aa34-dec611316d38 service neutron] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:43.612493 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475c1464-6acc-4ebd-9608-2fd7def9eebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:43.613370 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475c1464-6acc-4ebd-9608-2fd7def9eebc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:43.613656 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475c1464-6acc-4ebd-9608-2fd7def9eebc admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:43.613934 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475c1464-6acc-4ebd-9608-2fd7def9eebc admin admin] PATH_INFO: `/v3/users/13ce1e17e3a3451d9d40a53a4643e185` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:43.615160 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475c1464-6acc-4ebd-9608-2fd7def9eebc admin admin] RBAC: Authorizing `identity:delete_user(user_id=13ce1e17e3a3451d9d40a53a4643e185)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:43.617087 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475c1464-6acc-4ebd-9608-2fd7def9eebc admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:43.667765 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-475c1464-6acc-4ebd-9608-2fd7def9eebc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13ce1e17e3a3451d9d40a53a4643e185'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:43.674614 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-475c1464-6acc-4ebd-9608-2fd7def9eebc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13ce1e17e3a3451d9d40a53a4643e185'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:43.675284 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-475c1464-6acc-4ebd-9608-2fd7def9eebc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13ce1e17e3a3451d9d40a53a4643e185'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:43.682967 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-475c1464-6acc-4ebd-9608-2fd7def9eebc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13ce1e17e3a3451d9d40a53a4643e185'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:43.683624 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-475c1464-6acc-4ebd-9608-2fd7def9eebc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13ce1e17e3a3451d9d40a53a4643e185'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:43.685563 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:14:43.703180 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1259/2535] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 14 10:14:43 2022] DELETE /identity/v3/users/13ce1e17e3a3451d9d40a53a4643e185 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:14:43.979666 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3567f163-7aeb-40bb-9296-eb0433281b61 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:43.981095 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-3567f163-7aeb-40bb-9296-eb0433281b61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:14:43.996640 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3567f163-7aeb-40bb-9296-eb0433281b61 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:44.056893 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0d87a2-dfe4-43d0-8f37-46944138968b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:44.057823 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0d87a2-dfe4-43d0-8f37-46944138968b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:44.058111 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0d87a2-dfe4-43d0-8f37-46944138968b admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:44.058424 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0d87a2-dfe4-43d0-8f37-46944138968b admin admin] PATH_INFO: `/v3/projects/13ea9d8aadd547cebf4776bb06364630` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:44.059634 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0d87a2-dfe4-43d0-8f37-46944138968b admin admin] RBAC: Authorizing `identity:delete_project(project_id=13ea9d8aadd547cebf4776bb06364630)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:44.063016 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0d87a2-dfe4-43d0-8f37-46944138968b admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:44.075102 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:14:44.112024 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-2b0d87a2-dfe4-43d0-8f37-46944138968b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13ea9d8aadd547cebf4776bb06364630', 'request_id': 'req-2b0d87a2-dfe4-43d0-8f37-46944138968b'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:44.118135 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-2b0d87a2-dfe4-43d0-8f37-46944138968b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13ea9d8aadd547cebf4776bb06364630', 'request_id': 'req-2b0d87a2-dfe4-43d0-8f37-46944138968b'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:44.123868 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-2b0d87a2-dfe4-43d0-8f37-46944138968b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13ea9d8aadd547cebf4776bb06364630', 'request_id': 'req-2b0d87a2-dfe4-43d0-8f37-46944138968b'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:44.136671 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-2b0d87a2-dfe4-43d0-8f37-46944138968b admin admin] The token cache is being invalidate because project 13ea9d8aadd547cebf4776bb06364630 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:14:44.136982 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-2b0d87a2-dfe4-43d0-8f37-46944138968b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:44.137614 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-2b0d87a2-dfe4-43d0-8f37-46944138968b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:44.139230 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1277/2536] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 14 10:14:43 2022] DELETE /identity/v3/projects/13ea9d8aadd547cebf4776bb06364630 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:14:44.144388 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c765a7-ad05-4201-bdbc-e3f380cd923d None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:44.144861 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c765a7-ad05-4201-bdbc-e3f380cd923d None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:44.144960 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c765a7-ad05-4201-bdbc-e3f380cd923d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:44.162935 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-b9c765a7-ad05-4201-bdbc-e3f380cd923d None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:14:44.164199 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-b9c765a7-ad05-4201-bdbc-e3f380cd923d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:14:44.225545 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1260/2537] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 10:14:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:14:44.233343 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88928079-6b27-468d-92c2-dd3dd072701d None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:44.233632 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88928079-6b27-468d-92c2-dd3dd072701d None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:44.233913 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88928079-6b27-468d-92c2-dd3dd072701d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:44.252910 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-88928079-6b27-468d-92c2-dd3dd072701d None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:14:44.254118 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-88928079-6b27-468d-92c2-dd3dd072701d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:14:44.262027 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1278/2538] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 10:14:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:14:44.266459 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c765a7-ad05-4201-bdbc-e3f380cd923d None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:44.276306 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c765a7-ad05-4201-bdbc-e3f380cd923d None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:44.280877 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8e0e02-91d1-4dd6-8e05-c63984d87b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:44.281532 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8e0e02-91d1-4dd6-8e05-c63984d87b41 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:44.281812 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8e0e02-91d1-4dd6-8e05-c63984d87b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:44.282086 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8e0e02-91d1-4dd6-8e05-c63984d87b41 admin admin] PATH_INFO: `/v3/domains` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:44.283444 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8e0e02-91d1-4dd6-8e05-c63984d87b41 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:14:44.283751 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8e0e02-91d1-4dd6-8e05-c63984d87b41 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:44.285347 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8e0e02-91d1-4dd6-8e05-c63984d87b41 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:44.296731 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1261/2539] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jul 14 10:14:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:14:44.301536 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88928079-6b27-468d-92c2-dd3dd072701d None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:44.311305 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88928079-6b27-468d-92c2-dd3dd072701d None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:44.315956 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf3e0fb-9634-4e01-9ade-801c3395c747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:44.316609 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf3e0fb-9634-4e01-9ade-801c3395c747 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:44.316896 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf3e0fb-9634-4e01-9ade-801c3395c747 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:44.317175 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf3e0fb-9634-4e01-9ade-801c3395c747 admin admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:44.317866 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf3e0fb-9634-4e01-9ade-801c3395c747 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:44.319830 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf3e0fb-9634-4e01-9ade-801c3395c747 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:44.345667 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1279/2540] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 14 10:14:44 2022] POST /identity/v3/projects => generated 381 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:14:44.349813 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8e0e02-91d1-4dd6-8e05-c63984d87b41 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:44.359825 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8e0e02-91d1-4dd6-8e05-c63984d87b41 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:44.417024 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cf0385-f942-4d8c-a13e-de0647d2ca02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:44.417704 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cf0385-f942-4d8c-a13e-de0647d2ca02 admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:44.417992 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cf0385-f942-4d8c-a13e-de0647d2ca02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:44.418328 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cf0385-f942-4d8c-a13e-de0647d2ca02 admin admin] PATH_INFO: `/v3/users` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:44.419077 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cf0385-f942-4d8c-a13e-de0647d2ca02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:44.421027 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cf0385-f942-4d8c-a13e-de0647d2ca02 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:44.442371 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1262/2541] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 14 10:14:44 2022] POST /identity/v3/users => generated 291 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:14:44.447215 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf3e0fb-9634-4e01-9ade-801c3395c747 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:44.458543 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf3e0fb-9634-4e01-9ade-801c3395c747 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:44.463174 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d25b363-fad5-42d7-a6f4-97db358fbe98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:44.463842 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d25b363-fad5-42d7-a6f4-97db358fbe98 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:44.464125 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d25b363-fad5-42d7-a6f4-97db358fbe98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:44.464407 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d25b363-fad5-42d7-a6f4-97db358fbe98 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:44.465140 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d25b363-fad5-42d7-a6f4-97db358fbe98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:44.466776 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d25b363-fad5-42d7-a6f4-97db358fbe98 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:44.478284 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1280/2542] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 10:14:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:14:44.481806 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cf0385-f942-4d8c-a13e-de0647d2ca02 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:44.492097 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cf0385-f942-4d8c-a13e-de0647d2ca02 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:44.496924 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaf520e-d99a-46e2-bcff-7de534287310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:44.497594 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaf520e-d99a-46e2-bcff-7de534287310 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:44.497881 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaf520e-d99a-46e2-bcff-7de534287310 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:44.498160 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaf520e-d99a-46e2-bcff-7de534287310 admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:44.498929 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaf520e-d99a-46e2-bcff-7de534287310 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:44.500600 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaf520e-d99a-46e2-bcff-7de534287310 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:44.511246 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1263/2543] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 10:14:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:14:44.515563 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d25b363-fad5-42d7-a6f4-97db358fbe98 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:44.528902 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d25b363-fad5-42d7-a6f4-97db358fbe98 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:44.534487 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3208eb-33ee-4243-b036-d10f034044f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:44.535391 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3208eb-33ee-4243-b036-d10f034044f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:44.535677 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3208eb-33ee-4243-b036-d10f034044f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:44.535956 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3208eb-33ee-4243-b036-d10f034044f5 admin admin] PATH_INFO: `/v3/projects/c0f76b7a39b34205a1227c04ba5c88c3/users/10b458daf77d470382a17cf0c9c3e83c/roles/17dfac38a2e540fea229af7de99911bb` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:44.551514 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3208eb-33ee-4243-b036-d10f034044f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0f76b7a39b34205a1227c04ba5c88c3, user_id=10b458daf77d470382a17cf0c9c3e83c, role_id=17dfac38a2e540fea229af7de99911bb)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:44.554720 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3208eb-33ee-4243-b036-d10f034044f5 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:44.568101 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1281/2544] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 14 10:14:44 2022] PUT /identity/v3/projects/c0f76b7a39b34205a1227c04ba5c88c3/users/10b458daf77d470382a17cf0c9c3e83c/roles/17dfac38a2e540fea229af7de99911bb => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:14:44.578340 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbdd4ac-1fa0-4a2b-a533-68a69bf5b9a2 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:44.578639 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbdd4ac-1fa0-4a2b-a533-68a69bf5b9a2 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:44.578925 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbdd4ac-1fa0-4a2b-a533-68a69bf5b9a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:44.606109 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-afbdd4ac-1fa0-4a2b-a533-68a69bf5b9a2 None None] MFA Rules not processed for user `10b458daf77d470382a17cf0c9c3e83c`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:14:44.607392 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-afbdd4ac-1fa0-4a2b-a533-68a69bf5b9a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:14:44.645293 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:14:44.673984 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1264/2545] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 10:14:44 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:14:44.678830 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3208eb-33ee-4243-b036-d10f034044f5 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:44.740110 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3208eb-33ee-4243-b036-d10f034044f5 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:44.744688 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e419e1-2586-49b0-9a7c-3a37d3b1c84e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:44.745351 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e419e1-2586-49b0-9a7c-3a37d3b1c84e admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:44.745634 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e419e1-2586-49b0-9a7c-3a37d3b1c84e admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:44.745910 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e419e1-2586-49b0-9a7c-3a37d3b1c84e admin admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:44.746640 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e419e1-2586-49b0-9a7c-3a37d3b1c84e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:44.748530 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e419e1-2586-49b0-9a7c-3a37d3b1c84e admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:44.774401 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1282/2546] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 14 10:14:44 2022] POST /identity/v3/projects => generated 381 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:14:44.778579 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbdd4ac-1fa0-4a2b-a533-68a69bf5b9a2 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:44.789176 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbdd4ac-1fa0-4a2b-a533-68a69bf5b9a2 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:44.845876 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ae6722-c7f1-498b-9ba5-4a74927ec2d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:44.846586 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ae6722-c7f1-498b-9ba5-4a74927ec2d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:44.846880 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ae6722-c7f1-498b-9ba5-4a74927ec2d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:44.847160 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ae6722-c7f1-498b-9ba5-4a74927ec2d3 admin admin] PATH_INFO: `/v3/users` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:44.847882 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ae6722-c7f1-498b-9ba5-4a74927ec2d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:44.849787 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ae6722-c7f1-498b-9ba5-4a74927ec2d3 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:44.870008 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1265/2547] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 14 10:14:44 2022] POST /identity/v3/users => generated 297 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:14:44.873323 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e419e1-2586-49b0-9a7c-3a37d3b1c84e admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:44.884182 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e419e1-2586-49b0-9a7c-3a37d3b1c84e admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:44.889010 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6215a91f-ea39-4489-b39b-3d800a63186b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:44.889788 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6215a91f-ea39-4489-b39b-3d800a63186b admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:44.890095 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6215a91f-ea39-4489-b39b-3d800a63186b admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:44.890414 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6215a91f-ea39-4489-b39b-3d800a63186b admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:44.891178 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6215a91f-ea39-4489-b39b-3d800a63186b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:44.893401 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6215a91f-ea39-4489-b39b-3d800a63186b admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:44.904829 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1283/2548] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 10:14:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:14:44.908971 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ae6722-c7f1-498b-9ba5-4a74927ec2d3 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:44.918924 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ae6722-c7f1-498b-9ba5-4a74927ec2d3 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:44.923903 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6180f903-5b0b-41b4-9d95-2c860df30118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:44.924790 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6180f903-5b0b-41b4-9d95-2c860df30118 admin admin] REQUEST_METHOD: `PUT` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:44.925074 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6180f903-5b0b-41b4-9d95-2c860df30118 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:44.925350 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6180f903-5b0b-41b4-9d95-2c860df30118 admin admin] PATH_INFO: `/v3/projects/165dd9f4496e49768fe9c7dc6595fe8c/users/e349fe0321884aaf95e89a7b1ca6f432/roles/e3965bd0d5f1427a86a313c0c90bfef3` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:44.940991 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6180f903-5b0b-41b4-9d95-2c860df30118 admin admin] RBAC: Authorizing `identity:create_grant(project_id=165dd9f4496e49768fe9c7dc6595fe8c, user_id=e349fe0321884aaf95e89a7b1ca6f432, role_id=e3965bd0d5f1427a86a313c0c90bfef3)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:44.943680 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6180f903-5b0b-41b4-9d95-2c860df30118 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:44.956923 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1266/2549] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 14 10:14:44 2022] PUT /identity/v3/projects/165dd9f4496e49768fe9c7dc6595fe8c/users/e349fe0321884aaf95e89a7b1ca6f432/roles/e3965bd0d5f1427a86a313c0c90bfef3 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:14:44.960834 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6215a91f-ea39-4489-b39b-3d800a63186b admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:44.970732 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6215a91f-ea39-4489-b39b-3d800a63186b admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:44.979313 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:14:45.031157 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b429962c-cbcf-44f3-99f4-7abae0084ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:45.031758 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b429962c-cbcf-44f3-99f4-7abae0084ce5 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:45.032043 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b429962c-cbcf-44f3-99f4-7abae0084ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:45.032322 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b429962c-cbcf-44f3-99f4-7abae0084ce5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:45.033084 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b429962c-cbcf-44f3-99f4-7abae0084ce5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:45.034719 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b429962c-cbcf-44f3-99f4-7abae0084ce5 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:45.045114 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1284/2550] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 10:14:44 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:14:45.049345 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6180f903-5b0b-41b4-9d95-2c860df30118 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:45.059874 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6180f903-5b0b-41b4-9d95-2c860df30118 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:45.065128 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d585adfe-9254-43a5-ba80-ed7eed830da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:45.066011 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d585adfe-9254-43a5-ba80-ed7eed830da4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:45.066339 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d585adfe-9254-43a5-ba80-ed7eed830da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:45.066650 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d585adfe-9254-43a5-ba80-ed7eed830da4 admin admin] PATH_INFO: `/v3/projects/165dd9f4496e49768fe9c7dc6595fe8c/users/e349fe0321884aaf95e89a7b1ca6f432/roles/e3965bd0d5f1427a86a313c0c90bfef3` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:45.069073 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d585adfe-9254-43a5-ba80-ed7eed830da4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=165dd9f4496e49768fe9c7dc6595fe8c, user_id=e349fe0321884aaf95e89a7b1ca6f432, role_id=e3965bd0d5f1427a86a313c0c90bfef3)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:45.071667 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d585adfe-9254-43a5-ba80-ed7eed830da4 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:45.082716 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1267/2551] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 14 10:14:45 2022] PUT /identity/v3/projects/165dd9f4496e49768fe9c7dc6595fe8c/users/e349fe0321884aaf95e89a7b1ca6f432/roles/e3965bd0d5f1427a86a313c0c90bfef3 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:14:45.093732 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f2be7c-806c-47ae-9dae-9439d892b410 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:45.094030 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f2be7c-806c-47ae-9dae-9439d892b410 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:45.094386 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f2be7c-806c-47ae-9dae-9439d892b410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:45.120808 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-a2f2be7c-806c-47ae-9dae-9439d892b410 None None] MFA Rules not processed for user `e349fe0321884aaf95e89a7b1ca6f432`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:14:45.122021 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-a2f2be7c-806c-47ae-9dae-9439d892b410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:14:45.191289 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1285/2552] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 10:14:45 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:14:45.203343 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d585adfe-9254-43a5-ba80-ed7eed830da4 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:45.206564 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-d585adfe-9254-43a5-ba80-ed7eed830da4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:14:45.267887 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d585adfe-9254-43a5-ba80-ed7eed830da4 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:45.271806 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0778400a-079f-4462-becc-7654f90a74bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25048b29787d482783ebc944f1a7df65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:45.272463 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0778400a-079f-4462-becc-7654f90a74bf service cinder] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:45.272751 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0778400a-079f-4462-becc-7654f90a74bf service cinder] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:45.273049 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0778400a-079f-4462-becc-7654f90a74bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:45.283592 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0778400a-079f-4462-becc-7654f90a74bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:45.284985 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0778400a-079f-4462-becc-7654f90a74bf service cinder] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:45.295072 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1268/2553] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 10:14:45 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:14:45.369284 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f2be7c-806c-47ae-9dae-9439d892b410 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:45.376163 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f2be7c-806c-47ae-9dae-9439d892b410 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:45.381320 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598168c0-295b-4eda-96c3-9d60721a622d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25048b29787d482783ebc944f1a7df65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:45.381978 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598168c0-295b-4eda-96c3-9d60721a622d service cinder] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:45.382305 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598168c0-295b-4eda-96c3-9d60721a622d service cinder] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:45.382599 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598168c0-295b-4eda-96c3-9d60721a622d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:45.447541 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598168c0-295b-4eda-96c3-9d60721a622d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:45.448957 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598168c0-295b-4eda-96c3-9d60721a622d service cinder] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:45.458479 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1286/2554] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 10:14:45 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:14:45.723098 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0778400a-079f-4462-becc-7654f90a74bf service cinder] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:45.761770 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:14:45.807613 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0778400a-079f-4462-becc-7654f90a74bf service cinder] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:45.812095 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9d591a-cef4-45ac-a382-6f3447fedb05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:45.812962 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9d591a-cef4-45ac-a382-6f3447fedb05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:45.813260 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9d591a-cef4-45ac-a382-6f3447fedb05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:45.813522 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9d591a-cef4-45ac-a382-6f3447fedb05 admin admin] PATH_INFO: `/v3/users/10b458daf77d470382a17cf0c9c3e83c` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:45.815237 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9d591a-cef4-45ac-a382-6f3447fedb05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=10b458daf77d470382a17cf0c9c3e83c)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:45.817154 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9d591a-cef4-45ac-a382-6f3447fedb05 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:45.871414 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-bd9d591a-cef4-45ac-a382-6f3447fedb05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10b458daf77d470382a17cf0c9c3e83c'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:45.879255 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-bd9d591a-cef4-45ac-a382-6f3447fedb05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10b458daf77d470382a17cf0c9c3e83c'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:45.879933 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-bd9d591a-cef4-45ac-a382-6f3447fedb05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10b458daf77d470382a17cf0c9c3e83c'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:45.887392 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-bd9d591a-cef4-45ac-a382-6f3447fedb05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10b458daf77d470382a17cf0c9c3e83c'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:45.888016 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-bd9d591a-cef4-45ac-a382-6f3447fedb05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10b458daf77d470382a17cf0c9c3e83c'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:45.904922 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1269/2555] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 14 10:14:45 2022] DELETE /identity/v3/users/10b458daf77d470382a17cf0c9c3e83c => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:14:45.909591 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b587d3-1716-4323-b17b-e789616fa2ff None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:45.909880 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b587d3-1716-4323-b17b-e789616fa2ff None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:45.910160 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b587d3-1716-4323-b17b-e789616fa2ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:45.941842 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-72b587d3-1716-4323-b17b-e789616fa2ff None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:14:45.943080 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-72b587d3-1716-4323-b17b-e789616fa2ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:14:45.955547 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:14:46.001215 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1287/2556] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 10:14:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:14:46.011491 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9d591a-cef4-45ac-a382-6f3447fedb05 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:46.012927 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-bd9d591a-cef4-45ac-a382-6f3447fedb05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:14:46.070103 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9d591a-cef4-45ac-a382-6f3447fedb05 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:46.073887 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8b93ba-f105-4df2-a67e-869bb67a6f5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e4a5a8965e4802a9055d332179b7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:46.074585 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8b93ba-f105-4df2-a67e-869bb67a6f5f service neutron] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:46.074902 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8b93ba-f105-4df2-a67e-869bb67a6f5f service neutron] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:46.075178 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8b93ba-f105-4df2-a67e-869bb67a6f5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:46.084333 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8b93ba-f105-4df2-a67e-869bb67a6f5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:46.085772 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8b93ba-f105-4df2-a67e-869bb67a6f5f service neutron] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:46.095280 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1270/2557] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 10:14:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:14:46.366033 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b587d3-1716-4323-b17b-e789616fa2ff None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:46.367479 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-72b587d3-1716-4323-b17b-e789616fa2ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:14:46.381629 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b587d3-1716-4323-b17b-e789616fa2ff None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:46.386329 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9c1335-4c92-49d6-be87-7937fa75ced6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:46.387896 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9c1335-4c92-49d6-be87-7937fa75ced6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:46.388185 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9c1335-4c92-49d6-be87-7937fa75ced6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:46.388515 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9c1335-4c92-49d6-be87-7937fa75ced6 admin admin] PATH_INFO: `/v3/projects/c0f76b7a39b34205a1227c04ba5c88c3` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:46.389720 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9c1335-4c92-49d6-be87-7937fa75ced6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0f76b7a39b34205a1227c04ba5c88c3)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:46.391776 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9c1335-4c92-49d6-be87-7937fa75ced6 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:46.443226 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-fb9c1335-4c92-49d6-be87-7937fa75ced6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0f76b7a39b34205a1227c04ba5c88c3', 'request_id': 'req-fb9c1335-4c92-49d6-be87-7937fa75ced6'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:46.450393 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-fb9c1335-4c92-49d6-be87-7937fa75ced6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0f76b7a39b34205a1227c04ba5c88c3', 'request_id': 'req-fb9c1335-4c92-49d6-be87-7937fa75ced6'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:46.456310 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-fb9c1335-4c92-49d6-be87-7937fa75ced6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0f76b7a39b34205a1227c04ba5c88c3', 'request_id': 'req-fb9c1335-4c92-49d6-be87-7937fa75ced6'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:46.470108 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-fb9c1335-4c92-49d6-be87-7937fa75ced6 admin admin] The token cache is being invalidate because project c0f76b7a39b34205a1227c04ba5c88c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:14:46.470975 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-fb9c1335-4c92-49d6-be87-7937fa75ced6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:46.471552 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-fb9c1335-4c92-49d6-be87-7937fa75ced6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:46.473112 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1288/2558] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 14 10:14:46 2022] DELETE /identity/v3/projects/c0f76b7a39b34205a1227c04ba5c88c3 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:14:46.477097 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8b93ba-f105-4df2-a67e-869bb67a6f5f service neutron] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:46.487348 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8b93ba-f105-4df2-a67e-869bb67a6f5f service neutron] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:46.519972 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:14:46.545508 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090a8cfd-2ef9-4973-8634-f78bbc505d59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:46.546439 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090a8cfd-2ef9-4973-8634-f78bbc505d59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:46.546723 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090a8cfd-2ef9-4973-8634-f78bbc505d59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:46.546997 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090a8cfd-2ef9-4973-8634-f78bbc505d59 admin admin] PATH_INFO: `/v3/users/e349fe0321884aaf95e89a7b1ca6f432` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:46.549049 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090a8cfd-2ef9-4973-8634-f78bbc505d59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e349fe0321884aaf95e89a7b1ca6f432)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:46.551007 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090a8cfd-2ef9-4973-8634-f78bbc505d59 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:46.597757 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-090a8cfd-2ef9-4973-8634-f78bbc505d59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e349fe0321884aaf95e89a7b1ca6f432'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:46.604686 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-090a8cfd-2ef9-4973-8634-f78bbc505d59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e349fe0321884aaf95e89a7b1ca6f432'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:46.605364 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-090a8cfd-2ef9-4973-8634-f78bbc505d59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e349fe0321884aaf95e89a7b1ca6f432'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:46.613488 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-090a8cfd-2ef9-4973-8634-f78bbc505d59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e349fe0321884aaf95e89a7b1ca6f432'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:46.614064 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-090a8cfd-2ef9-4973-8634-f78bbc505d59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e349fe0321884aaf95e89a7b1ca6f432'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:46.631639 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1271/2559] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 14 10:14:46 2022] DELETE /identity/v3/users/e349fe0321884aaf95e89a7b1ca6f432 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:14:46.911836 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9c1335-4c92-49d6-be87-7937fa75ced6 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:46.919462 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-fb9c1335-4c92-49d6-be87-7937fa75ced6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:14:46.934898 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9c1335-4c92-49d6-be87-7937fa75ced6 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:47.005570 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2ca307-6ff8-4e98-8b37-bfdc06e04600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:47.006472 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2ca307-6ff8-4e98-8b37-bfdc06e04600 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:47.006771 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2ca307-6ff8-4e98-8b37-bfdc06e04600 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:47.007034 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2ca307-6ff8-4e98-8b37-bfdc06e04600 admin admin] PATH_INFO: `/v3/projects/165dd9f4496e49768fe9c7dc6595fe8c` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:47.008611 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2ca307-6ff8-4e98-8b37-bfdc06e04600 admin admin] RBAC: Authorizing `identity:delete_project(project_id=165dd9f4496e49768fe9c7dc6595fe8c)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:47.010792 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2ca307-6ff8-4e98-8b37-bfdc06e04600 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:47.056906 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:14:47.060175 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-3c2ca307-6ff8-4e98-8b37-bfdc06e04600 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '165dd9f4496e49768fe9c7dc6595fe8c', 'request_id': 'req-3c2ca307-6ff8-4e98-8b37-bfdc06e04600'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:47.068328 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-3c2ca307-6ff8-4e98-8b37-bfdc06e04600 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '165dd9f4496e49768fe9c7dc6595fe8c', 'request_id': 'req-3c2ca307-6ff8-4e98-8b37-bfdc06e04600'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:47.076227 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-3c2ca307-6ff8-4e98-8b37-bfdc06e04600 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '165dd9f4496e49768fe9c7dc6595fe8c', 'request_id': 'req-3c2ca307-6ff8-4e98-8b37-bfdc06e04600'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:47.089615 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-3c2ca307-6ff8-4e98-8b37-bfdc06e04600 admin admin] The token cache is being invalidate because project 165dd9f4496e49768fe9c7dc6595fe8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:14:47.089914 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-3c2ca307-6ff8-4e98-8b37-bfdc06e04600 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:47.090611 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-3c2ca307-6ff8-4e98-8b37-bfdc06e04600 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:47.092257 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1289/2560] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 14 10:14:46 2022] DELETE /identity/v3/projects/165dd9f4496e49768fe9c7dc6595fe8c => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:14:52.963202 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090a8cfd-2ef9-4973-8634-f78bbc505d59 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:52.964652 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-090a8cfd-2ef9-4973-8634-f78bbc505d59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:14:52.978090 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090a8cfd-2ef9-4973-8634-f78bbc505d59 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:53.035188 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbd9cf3-315a-4f8c-b367-512e062c075c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:53.036068 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbd9cf3-315a-4f8c-b367-512e062c075c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:53.036351 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbd9cf3-315a-4f8c-b367-512e062c075c admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:53.036629 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbd9cf3-315a-4f8c-b367-512e062c075c admin admin] PATH_INFO: `/v3/users/cba07d14d2c941d6bf6654da33c167c0` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:53.037818 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbd9cf3-315a-4f8c-b367-512e062c075c admin admin] RBAC: Authorizing `identity:delete_user(user_id=cba07d14d2c941d6bf6654da33c167c0)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:53.039791 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbd9cf3-315a-4f8c-b367-512e062c075c admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:53.088426 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-edbd9cf3-315a-4f8c-b367-512e062c075c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cba07d14d2c941d6bf6654da33c167c0'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:53.095485 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-edbd9cf3-315a-4f8c-b367-512e062c075c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cba07d14d2c941d6bf6654da33c167c0'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:53.096173 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-edbd9cf3-315a-4f8c-b367-512e062c075c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cba07d14d2c941d6bf6654da33c167c0'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:53.098801 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:14:53.104152 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-edbd9cf3-315a-4f8c-b367-512e062c075c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cba07d14d2c941d6bf6654da33c167c0'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:53.104957 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-edbd9cf3-315a-4f8c-b367-512e062c075c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cba07d14d2c941d6bf6654da33c167c0'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:53.124679 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1272/2561] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 14 10:14:52 2022] DELETE /identity/v3/users/cba07d14d2c941d6bf6654da33c167c0 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:14:53.129762 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7623239-7162-4ff9-9c07-b142e2655702 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:53.130279 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7623239-7162-4ff9-9c07-b142e2655702 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:53.130479 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7623239-7162-4ff9-9c07-b142e2655702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:53.148767 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-f7623239-7162-4ff9-9c07-b142e2655702 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:14:53.150386 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-f7623239-7162-4ff9-9c07-b142e2655702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:14:53.215359 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1290/2562] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 10:14:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:14:53.224991 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbd9cf3-315a-4f8c-b367-512e062c075c admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:53.226470 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-edbd9cf3-315a-4f8c-b367-512e062c075c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:14:53.285767 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbd9cf3-315a-4f8c-b367-512e062c075c admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:53.289442 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8be676-7fe5-4d03-94a9-512790c0aaa1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e4a5a8965e4802a9055d332179b7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:53.290092 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8be676-7fe5-4d03-94a9-512790c0aaa1 service neutron] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:53.290400 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8be676-7fe5-4d03-94a9-512790c0aaa1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:53.290677 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8be676-7fe5-4d03-94a9-512790c0aaa1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:53.300105 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8be676-7fe5-4d03-94a9-512790c0aaa1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:53.301523 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8be676-7fe5-4d03-94a9-512790c0aaa1 service neutron] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:53.311514 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1273/2563] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 10:14:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:14:53.587313 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7623239-7162-4ff9-9c07-b142e2655702 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:53.589134 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-f7623239-7162-4ff9-9c07-b142e2655702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:14:53.604871 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7623239-7162-4ff9-9c07-b142e2655702 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:53.609470 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bb0e9b-0609-4691-a7b7-6a135bd15870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:53.611363 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bb0e9b-0609-4691-a7b7-6a135bd15870 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:53.611515 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bb0e9b-0609-4691-a7b7-6a135bd15870 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:53.611789 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bb0e9b-0609-4691-a7b7-6a135bd15870 admin admin] PATH_INFO: `/v3/projects/a9540c0fe2d5403f9f673fc49d400153` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:53.613023 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bb0e9b-0609-4691-a7b7-6a135bd15870 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9540c0fe2d5403f9f673fc49d400153)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:53.614969 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bb0e9b-0609-4691-a7b7-6a135bd15870 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:53.669642 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-05bb0e9b-0609-4691-a7b7-6a135bd15870 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9540c0fe2d5403f9f673fc49d400153', 'request_id': 'req-05bb0e9b-0609-4691-a7b7-6a135bd15870'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:53.676696 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-05bb0e9b-0609-4691-a7b7-6a135bd15870 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9540c0fe2d5403f9f673fc49d400153', 'request_id': 'req-05bb0e9b-0609-4691-a7b7-6a135bd15870'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:53.684293 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-05bb0e9b-0609-4691-a7b7-6a135bd15870 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9540c0fe2d5403f9f673fc49d400153', 'request_id': 'req-05bb0e9b-0609-4691-a7b7-6a135bd15870'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:53.701408 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-05bb0e9b-0609-4691-a7b7-6a135bd15870 admin admin] The token cache is being invalidate because project a9540c0fe2d5403f9f673fc49d400153 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:14:53.701706 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-05bb0e9b-0609-4691-a7b7-6a135bd15870 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:53.702411 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-05bb0e9b-0609-4691-a7b7-6a135bd15870 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:53.703988 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1291/2564] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 14 10:14:53 2022] DELETE /identity/v3/projects/a9540c0fe2d5403f9f673fc49d400153 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:14:53.708435 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8be676-7fe5-4d03-94a9-512790c0aaa1 service neutron] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:53.719127 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8be676-7fe5-4d03-94a9-512790c0aaa1 service neutron] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:53.781307 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1643c7f9-4847-434a-a4d6-6167766e19bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:53.782415 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1643c7f9-4847-434a-a4d6-6167766e19bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:53.783240 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1643c7f9-4847-434a-a4d6-6167766e19bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:53.783528 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1643c7f9-4847-434a-a4d6-6167766e19bd admin admin] PATH_INFO: `/v3/users/f6cf45c2ff384e588725c90b637052be` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:53.784848 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1643c7f9-4847-434a-a4d6-6167766e19bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6cf45c2ff384e588725c90b637052be)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:53.786836 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1643c7f9-4847-434a-a4d6-6167766e19bd admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:53.840271 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-1643c7f9-4847-434a-a4d6-6167766e19bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6cf45c2ff384e588725c90b637052be'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:53.848226 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-1643c7f9-4847-434a-a4d6-6167766e19bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6cf45c2ff384e588725c90b637052be'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:53.848935 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-1643c7f9-4847-434a-a4d6-6167766e19bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6cf45c2ff384e588725c90b637052be'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:53.856403 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-1643c7f9-4847-434a-a4d6-6167766e19bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6cf45c2ff384e588725c90b637052be'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:53.857183 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-1643c7f9-4847-434a-a4d6-6167766e19bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6cf45c2ff384e588725c90b637052be'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:53.871127 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:14:53.876983 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1274/2565] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 14 10:14:53 2022] DELETE /identity/v3/users/f6cf45c2ff384e588725c90b637052be => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:14:54.165952 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bb0e9b-0609-4691-a7b7-6a135bd15870 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:54.167490 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-05bb0e9b-0609-4691-a7b7-6a135bd15870 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:14:54.190430 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bb0e9b-0609-4691-a7b7-6a135bd15870 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:54.243626 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:14:54.250532 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb81e462-85fb-4fbb-b3ec-8a02e761b856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:54.251413 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb81e462-85fb-4fbb-b3ec-8a02e761b856 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:54.252025 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb81e462-85fb-4fbb-b3ec-8a02e761b856 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:54.252444 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb81e462-85fb-4fbb-b3ec-8a02e761b856 admin admin] PATH_INFO: `/v3/projects/df8193337acc4deaa41882ae5516ff08` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:54.253867 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb81e462-85fb-4fbb-b3ec-8a02e761b856 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df8193337acc4deaa41882ae5516ff08)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:54.256415 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb81e462-85fb-4fbb-b3ec-8a02e761b856 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:54.302225 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-eb81e462-85fb-4fbb-b3ec-8a02e761b856 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df8193337acc4deaa41882ae5516ff08', 'request_id': 'req-eb81e462-85fb-4fbb-b3ec-8a02e761b856'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:54.308609 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-eb81e462-85fb-4fbb-b3ec-8a02e761b856 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df8193337acc4deaa41882ae5516ff08', 'request_id': 'req-eb81e462-85fb-4fbb-b3ec-8a02e761b856'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:54.314111 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-eb81e462-85fb-4fbb-b3ec-8a02e761b856 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df8193337acc4deaa41882ae5516ff08', 'request_id': 'req-eb81e462-85fb-4fbb-b3ec-8a02e761b856'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:54.326399 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-eb81e462-85fb-4fbb-b3ec-8a02e761b856 admin admin] The token cache is being invalidate because project df8193337acc4deaa41882ae5516ff08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:14:54.326692 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-eb81e462-85fb-4fbb-b3ec-8a02e761b856 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:54.327322 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-eb81e462-85fb-4fbb-b3ec-8a02e761b856 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:14:54.328870 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1292/2566] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 14 10:14:54 2022] DELETE /identity/v3/projects/df8193337acc4deaa41882ae5516ff08 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:14:54.334769 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4172dc0-ad0e-4cb1-8df6-e839c4892d92 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:54.335529 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4172dc0-ad0e-4cb1-8df6-e839c4892d92 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:54.335718 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4172dc0-ad0e-4cb1-8df6-e839c4892d92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:54.354729 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-b4172dc0-ad0e-4cb1-8df6-e839c4892d92 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:14:54.355939 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-b4172dc0-ad0e-4cb1-8df6-e839c4892d92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:14:54.415084 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1275/2567] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 10:14:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 10:14:54.422832 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ed7085-8cd3-4bed-8734-5c8d611471e8 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:54.423129 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ed7085-8cd3-4bed-8734-5c8d611471e8 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:54.423450 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ed7085-8cd3-4bed-8734-5c8d611471e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:54.442656 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-61ed7085-8cd3-4bed-8734-5c8d611471e8 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:14:54.443864 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-61ed7085-8cd3-4bed-8734-5c8d611471e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:14:54.453160 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1293/2568] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 10:14:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:14:54.457990 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4172dc0-ad0e-4cb1-8df6-e839c4892d92 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:54.467901 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4172dc0-ad0e-4cb1-8df6-e839c4892d92 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:54.473125 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a9f2e1-48b1-48e1-aa87-29063b21d39a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:54.473785 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a9f2e1-48b1-48e1-aa87-29063b21d39a admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:54.474074 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a9f2e1-48b1-48e1-aa87-29063b21d39a admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:54.474394 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a9f2e1-48b1-48e1-aa87-29063b21d39a admin admin] PATH_INFO: `/v3/domains` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:54.475161 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a9f2e1-48b1-48e1-aa87-29063b21d39a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:14:54.475472 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a9f2e1-48b1-48e1-aa87-29063b21d39a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:54.477118 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a9f2e1-48b1-48e1-aa87-29063b21d39a admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:54.488822 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1276/2569] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jul 14 10:14:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:14:54.493041 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ed7085-8cd3-4bed-8734-5c8d611471e8 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:54.502922 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ed7085-8cd3-4bed-8734-5c8d611471e8 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:54.507554 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38c360b-6fa7-4fc9-98d8-2dde8145a927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:54.508199 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38c360b-6fa7-4fc9-98d8-2dde8145a927 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:54.508481 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38c360b-6fa7-4fc9-98d8-2dde8145a927 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:54.508758 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38c360b-6fa7-4fc9-98d8-2dde8145a927 admin admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:54.509453 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38c360b-6fa7-4fc9-98d8-2dde8145a927 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:54.511369 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38c360b-6fa7-4fc9-98d8-2dde8145a927 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:54.538109 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1294/2570] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 14 10:14:54 2022] POST /identity/v3/projects => generated 375 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 10:14:54.542472 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a9f2e1-48b1-48e1-aa87-29063b21d39a admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:54.552923 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a9f2e1-48b1-48e1-aa87-29063b21d39a admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:54.610680 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac27f19e-e136-4934-a77e-bd1690d40ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:54.611360 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac27f19e-e136-4934-a77e-bd1690d40ac4 admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:54.611651 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac27f19e-e136-4934-a77e-bd1690d40ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:54.611934 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac27f19e-e136-4934-a77e-bd1690d40ac4 admin admin] PATH_INFO: `/v3/users` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:54.612629 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac27f19e-e136-4934-a77e-bd1690d40ac4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:54.614610 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac27f19e-e136-4934-a77e-bd1690d40ac4 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:54.634811 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1277/2571] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 14 10:14:54 2022] POST /identity/v3/users => generated 288 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 10:14:54.639101 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38c360b-6fa7-4fc9-98d8-2dde8145a927 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:54.649812 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38c360b-6fa7-4fc9-98d8-2dde8145a927 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:54.654408 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb05a47-6e98-48cc-9df7-5bcca474c077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:54.655074 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb05a47-6e98-48cc-9df7-5bcca474c077 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:54.655362 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb05a47-6e98-48cc-9df7-5bcca474c077 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:54.655647 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb05a47-6e98-48cc-9df7-5bcca474c077 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:54.656388 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb05a47-6e98-48cc-9df7-5bcca474c077 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:54.658034 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb05a47-6e98-48cc-9df7-5bcca474c077 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:54.668397 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1295/2572] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 10:14:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:14:54.672397 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac27f19e-e136-4934-a77e-bd1690d40ac4 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:54.683192 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac27f19e-e136-4934-a77e-bd1690d40ac4 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:54.687995 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb73c16-27d4-415c-bf30-db14e8aef01e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:54.688670 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb73c16-27d4-415c-bf30-db14e8aef01e admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:54.689444 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb73c16-27d4-415c-bf30-db14e8aef01e admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:54.689754 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb73c16-27d4-415c-bf30-db14e8aef01e admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:54.690552 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb73c16-27d4-415c-bf30-db14e8aef01e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:54.692191 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb73c16-27d4-415c-bf30-db14e8aef01e admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:54.704225 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1278/2573] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 10:14:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:14:54.709059 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb05a47-6e98-48cc-9df7-5bcca474c077 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:54.719474 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb05a47-6e98-48cc-9df7-5bcca474c077 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:54.724313 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f236fecb-ef79-4ffe-91c1-03b66f404fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:54.725206 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f236fecb-ef79-4ffe-91c1-03b66f404fe1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:54.725489 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f236fecb-ef79-4ffe-91c1-03b66f404fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:54.725796 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f236fecb-ef79-4ffe-91c1-03b66f404fe1 admin admin] PATH_INFO: `/v3/projects/8ecad79016234d2b86514966289169b3/users/2f5f658ce3fc41de8e27e97fa680af8a/roles/17dfac38a2e540fea229af7de99911bb` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:54.740621 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f236fecb-ef79-4ffe-91c1-03b66f404fe1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ecad79016234d2b86514966289169b3, user_id=2f5f658ce3fc41de8e27e97fa680af8a, role_id=17dfac38a2e540fea229af7de99911bb)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:54.743289 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f236fecb-ef79-4ffe-91c1-03b66f404fe1 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:54.756574 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1296/2574] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 14 10:14:54 2022] PUT /identity/v3/projects/8ecad79016234d2b86514966289169b3/users/2f5f658ce3fc41de8e27e97fa680af8a/roles/17dfac38a2e540fea229af7de99911bb => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:14:54.768479 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14fb280-9e8b-4453-bcf2-6017cccab5cc None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:54.768762 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14fb280-9e8b-4453-bcf2-6017cccab5cc None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:54.769036 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14fb280-9e8b-4453-bcf2-6017cccab5cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:54.795104 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-c14fb280-9e8b-4453-bcf2-6017cccab5cc None None] MFA Rules not processed for user `2f5f658ce3fc41de8e27e97fa680af8a`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:14:54.796310 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-c14fb280-9e8b-4453-bcf2-6017cccab5cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:14:54.860487 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:14:54.874427 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1279/2575] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 10:14:54 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:14:54.879592 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f236fecb-ef79-4ffe-91c1-03b66f404fe1 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:54.945588 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f236fecb-ef79-4ffe-91c1-03b66f404fe1 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:54.950208 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efb3db3-ccc8-4cd9-a1bb-2a41cdd2e893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:54.950888 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efb3db3-ccc8-4cd9-a1bb-2a41cdd2e893 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:54.951172 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efb3db3-ccc8-4cd9-a1bb-2a41cdd2e893 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:54.951449 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efb3db3-ccc8-4cd9-a1bb-2a41cdd2e893 admin admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:54.952171 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efb3db3-ccc8-4cd9-a1bb-2a41cdd2e893 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:54.954551 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efb3db3-ccc8-4cd9-a1bb-2a41cdd2e893 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:54.980225 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1297/2576] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 14 10:14:54 2022] POST /identity/v3/projects => generated 377 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:14:54.984273 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14fb280-9e8b-4453-bcf2-6017cccab5cc None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:54.995096 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14fb280-9e8b-4453-bcf2-6017cccab5cc None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:55.052288 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f663df1a-6334-4c82-9e74-cd87085fe247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:55.052898 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f663df1a-6334-4c82-9e74-cd87085fe247 admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:55.053189 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f663df1a-6334-4c82-9e74-cd87085fe247 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:55.053474 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f663df1a-6334-4c82-9e74-cd87085fe247 admin admin] PATH_INFO: `/v3/users` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:55.054485 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f663df1a-6334-4c82-9e74-cd87085fe247 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:55.056426 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f663df1a-6334-4c82-9e74-cd87085fe247 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:55.082179 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1280/2577] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 14 10:14:54 2022] POST /identity/v3/users => generated 295 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:14:55.083868 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efb3db3-ccc8-4cd9-a1bb-2a41cdd2e893 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:55.094396 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efb3db3-ccc8-4cd9-a1bb-2a41cdd2e893 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:55.099227 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af239cc9-cbaf-4aae-ac47-d97a685e8d31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:55.100005 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af239cc9-cbaf-4aae-ac47-d97a685e8d31 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:55.100256 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af239cc9-cbaf-4aae-ac47-d97a685e8d31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:55.100540 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af239cc9-cbaf-4aae-ac47-d97a685e8d31 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:55.101273 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af239cc9-cbaf-4aae-ac47-d97a685e8d31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:55.103038 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af239cc9-cbaf-4aae-ac47-d97a685e8d31 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:55.105367 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:14:55.116003 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1298/2578] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 10:14:55 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:14:55.120134 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f663df1a-6334-4c82-9e74-cd87085fe247 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:55.131234 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f663df1a-6334-4c82-9e74-cd87085fe247 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:55.137992 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f80ba3-c2a3-457b-b31a-250e912dd359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:55.138938 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f80ba3-c2a3-457b-b31a-250e912dd359 admin admin] REQUEST_METHOD: `PUT` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:55.139222 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f80ba3-c2a3-457b-b31a-250e912dd359 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:55.139500 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f80ba3-c2a3-457b-b31a-250e912dd359 admin admin] PATH_INFO: `/v3/projects/a9095bfad58145ec949c074e2f62a8b2/users/789e2ec1d89245d3b5081a6644d3aeb9/roles/e3965bd0d5f1427a86a313c0c90bfef3` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:55.156450 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f80ba3-c2a3-457b-b31a-250e912dd359 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9095bfad58145ec949c074e2f62a8b2, user_id=789e2ec1d89245d3b5081a6644d3aeb9, role_id=e3965bd0d5f1427a86a313c0c90bfef3)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:55.159319 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f80ba3-c2a3-457b-b31a-250e912dd359 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:55.172638 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1281/2579] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 14 10:14:55 2022] PUT /identity/v3/projects/a9095bfad58145ec949c074e2f62a8b2/users/789e2ec1d89245d3b5081a6644d3aeb9/roles/e3965bd0d5f1427a86a313c0c90bfef3 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:14:55.177529 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af239cc9-cbaf-4aae-ac47-d97a685e8d31 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:55.190089 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af239cc9-cbaf-4aae-ac47-d97a685e8d31 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:55.256445 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a13ff79-2771-478e-a031-99b80a4ac59f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:55.257135 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a13ff79-2771-478e-a031-99b80a4ac59f admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:55.257425 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a13ff79-2771-478e-a031-99b80a4ac59f admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:55.257709 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a13ff79-2771-478e-a031-99b80a4ac59f admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:55.258478 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a13ff79-2771-478e-a031-99b80a4ac59f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:55.260081 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a13ff79-2771-478e-a031-99b80a4ac59f admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:55.270457 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1299/2580] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 10:14:55 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:14:55.274465 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f80ba3-c2a3-457b-b31a-250e912dd359 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:55.286105 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f80ba3-c2a3-457b-b31a-250e912dd359 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:55.290718 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcab9348-7684-4418-91cf-9434d0297521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:55.291602 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcab9348-7684-4418-91cf-9434d0297521 admin admin] REQUEST_METHOD: `PUT` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:55.291879 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcab9348-7684-4418-91cf-9434d0297521 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:55.292150 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcab9348-7684-4418-91cf-9434d0297521 admin admin] PATH_INFO: `/v3/projects/a9095bfad58145ec949c074e2f62a8b2/users/789e2ec1d89245d3b5081a6644d3aeb9/roles/e3965bd0d5f1427a86a313c0c90bfef3` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:55.294140 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcab9348-7684-4418-91cf-9434d0297521 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9095bfad58145ec949c074e2f62a8b2, user_id=789e2ec1d89245d3b5081a6644d3aeb9, role_id=e3965bd0d5f1427a86a313c0c90bfef3)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:55.296802 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcab9348-7684-4418-91cf-9434d0297521 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:55.308456 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1282/2581] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 14 10:14:55 2022] PUT /identity/v3/projects/a9095bfad58145ec949c074e2f62a8b2/users/789e2ec1d89245d3b5081a6644d3aeb9/roles/e3965bd0d5f1427a86a313c0c90bfef3 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:14:55.318615 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c0a3d5-0b17-4264-9309-0fa80045aaa7 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:55.318911 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c0a3d5-0b17-4264-9309-0fa80045aaa7 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:55.319195 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c0a3d5-0b17-4264-9309-0fa80045aaa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:55.346567 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-06c0a3d5-0b17-4264-9309-0fa80045aaa7 None None] MFA Rules not processed for user `789e2ec1d89245d3b5081a6644d3aeb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:14:55.347783 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-06c0a3d5-0b17-4264-9309-0fa80045aaa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:14:55.414179 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1300/2582] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 10:14:55 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:14:55.425428 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcab9348-7684-4418-91cf-9434d0297521 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:55.427244 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-dcab9348-7684-4418-91cf-9434d0297521 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:14:55.483587 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcab9348-7684-4418-91cf-9434d0297521 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:55.487728 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6faa49c-745f-449a-8f4f-a6ef3acdedc0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25048b29787d482783ebc944f1a7df65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:55.488372 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6faa49c-745f-449a-8f4f-a6ef3acdedc0 service cinder] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:55.488654 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6faa49c-745f-449a-8f4f-a6ef3acdedc0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:55.488930 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6faa49c-745f-449a-8f4f-a6ef3acdedc0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:55.546674 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6faa49c-745f-449a-8f4f-a6ef3acdedc0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:55.548115 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6faa49c-745f-449a-8f4f-a6ef3acdedc0 service cinder] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:55.553337 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:14:55.563374 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1283/2583] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 10:14:55 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:14:59.627433 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c0a3d5-0b17-4264-9309-0fa80045aaa7 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:14:59.629018 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-06c0a3d5-0b17-4264-9309-0fa80045aaa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:14:59.686297 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c0a3d5-0b17-4264-9309-0fa80045aaa7 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:14:59.690662 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928867e7-ed84-4135-948d-5d718e8ca183 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e4a5a8965e4802a9055d332179b7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:14:59.691311 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928867e7-ed84-4135-948d-5d718e8ca183 service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:14:59.691600 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928867e7-ed84-4135-948d-5d718e8ca183 service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:14:59.691881 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928867e7-ed84-4135-948d-5d718e8ca183 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:14:59.693699 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-928867e7-ed84-4135-948d-5d718e8ca183 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:14:59.726683 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:14:59.785525 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928867e7-ed84-4135-948d-5d718e8ca183 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:14:59.787171 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928867e7-ed84-4135-948d-5d718e8ca183 service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:14:59.800714 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1301/2584] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 10:14:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:15:04.277801 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6faa49c-745f-449a-8f4f-a6ef3acdedc0 service cinder] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:15:04.286549 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6faa49c-745f-449a-8f4f-a6ef3acdedc0 service cinder] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:15:04.290247 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579a4f6c-fc45-4ef3-8de5-52b8557ecc88 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25048b29787d482783ebc944f1a7df65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:15:04.290891 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579a4f6c-fc45-4ef3-8de5-52b8557ecc88 service cinder] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:15:04.291179 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579a4f6c-fc45-4ef3-8de5-52b8557ecc88 service cinder] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:15:04.291460 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579a4f6c-fc45-4ef3-8de5-52b8557ecc88 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:15:04.300548 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579a4f6c-fc45-4ef3-8de5-52b8557ecc88 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:15:04.301969 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579a4f6c-fc45-4ef3-8de5-52b8557ecc88 service cinder] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:15:04.311891 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1284/2585] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 10:15:04 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:15:09.793579 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=23 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:15:14.308646 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=6 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:15:44.545398 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928867e7-ed84-4135-948d-5d718e8ca183 service neutron] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:15:44.605818 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928867e7-ed84-4135-948d-5d718e8ca183 service neutron] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:15:44.610412 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8593c5f3-15cb-43dd-b00e-594dec3a568b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:15:44.611221 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8593c5f3-15cb-43dd-b00e-594dec3a568b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:15:44.611504 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8593c5f3-15cb-43dd-b00e-594dec3a568b admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:15:44.611780 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8593c5f3-15cb-43dd-b00e-594dec3a568b admin admin] PATH_INFO: `/v3/users/2f5f658ce3fc41de8e27e97fa680af8a` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:15:44.612957 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8593c5f3-15cb-43dd-b00e-594dec3a568b admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f5f658ce3fc41de8e27e97fa680af8a)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:15:44.614940 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8593c5f3-15cb-43dd-b00e-594dec3a568b admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:15:44.660094 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-8593c5f3-15cb-43dd-b00e-594dec3a568b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f5f658ce3fc41de8e27e97fa680af8a'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:15:44.672536 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-8593c5f3-15cb-43dd-b00e-594dec3a568b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f5f658ce3fc41de8e27e97fa680af8a'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:15:44.673267 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-8593c5f3-15cb-43dd-b00e-594dec3a568b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f5f658ce3fc41de8e27e97fa680af8a'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:15:44.680393 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-8593c5f3-15cb-43dd-b00e-594dec3a568b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f5f658ce3fc41de8e27e97fa680af8a'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:15:44.687600 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-8593c5f3-15cb-43dd-b00e-594dec3a568b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f5f658ce3fc41de8e27e97fa680af8a'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:15:44.693978 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1302/2586] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 14 10:15:44 2022] DELETE /identity/v3/users/2f5f658ce3fc41de8e27e97fa680af8a => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:15:44.698499 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c608e287-4825-4b1c-97f2-2a19302e6a66 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:15:44.698992 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c608e287-4825-4b1c-97f2-2a19302e6a66 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:15:44.699101 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c608e287-4825-4b1c-97f2-2a19302e6a66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:15:44.716285 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-c608e287-4825-4b1c-97f2-2a19302e6a66 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:15:44.717472 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-c608e287-4825-4b1c-97f2-2a19302e6a66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:15:44.775550 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1285/2587] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 10:15:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:15:44.784948 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8593c5f3-15cb-43dd-b00e-594dec3a568b admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:15:44.786397 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-8593c5f3-15cb-43dd-b00e-594dec3a568b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:15:44.843865 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8593c5f3-15cb-43dd-b00e-594dec3a568b admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:15:44.847454 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e3a4fa-1c03-4dd0-a19d-ea6074e22ef3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e4a5a8965e4802a9055d332179b7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:15:44.848098 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e3a4fa-1c03-4dd0-a19d-ea6074e22ef3 service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:15:44.848382 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e3a4fa-1c03-4dd0-a19d-ea6074e22ef3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:15:44.848664 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e3a4fa-1c03-4dd0-a19d-ea6074e22ef3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:15:44.857519 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e3a4fa-1c03-4dd0-a19d-ea6074e22ef3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:15:44.858976 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e3a4fa-1c03-4dd0-a19d-ea6074e22ef3 service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:15:44.868468 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1303/2588] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 10:15:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 10:15:45.138752 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c608e287-4825-4b1c-97f2-2a19302e6a66 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:15:45.140280 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-c608e287-4825-4b1c-97f2-2a19302e6a66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:15:45.152934 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c608e287-4825-4b1c-97f2-2a19302e6a66 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:15:45.162968 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050511c2-ff10-4bc6-8ff9-7e1ce85946d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:15:45.164695 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050511c2-ff10-4bc6-8ff9-7e1ce85946d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:15:45.164986 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050511c2-ff10-4bc6-8ff9-7e1ce85946d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:15:45.165263 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050511c2-ff10-4bc6-8ff9-7e1ce85946d2 admin admin] PATH_INFO: `/v3/projects/8ecad79016234d2b86514966289169b3` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:15:45.166628 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050511c2-ff10-4bc6-8ff9-7e1ce85946d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ecad79016234d2b86514966289169b3)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:15:45.168620 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050511c2-ff10-4bc6-8ff9-7e1ce85946d2 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:15:45.222906 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-050511c2-ff10-4bc6-8ff9-7e1ce85946d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ecad79016234d2b86514966289169b3', 'request_id': 'req-050511c2-ff10-4bc6-8ff9-7e1ce85946d2'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:15:45.230439 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-050511c2-ff10-4bc6-8ff9-7e1ce85946d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ecad79016234d2b86514966289169b3', 'request_id': 'req-050511c2-ff10-4bc6-8ff9-7e1ce85946d2'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:15:45.236328 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-050511c2-ff10-4bc6-8ff9-7e1ce85946d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ecad79016234d2b86514966289169b3', 'request_id': 'req-050511c2-ff10-4bc6-8ff9-7e1ce85946d2'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:15:45.247763 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-050511c2-ff10-4bc6-8ff9-7e1ce85946d2 admin admin] The token cache is being invalidate because project 8ecad79016234d2b86514966289169b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:15:45.248055 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-050511c2-ff10-4bc6-8ff9-7e1ce85946d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:15:45.248752 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-050511c2-ff10-4bc6-8ff9-7e1ce85946d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:15:45.250415 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1286/2589] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 14 10:15:45 2022] DELETE /identity/v3/projects/8ecad79016234d2b86514966289169b3 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:15:45.254440 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e3a4fa-1c03-4dd0-a19d-ea6074e22ef3 service neutron] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:15:45.264732 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e3a4fa-1c03-4dd0-a19d-ea6074e22ef3 service neutron] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:15:45.282645 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:15:45.324903 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2643cd59-237f-4fcc-a5d8-8dd158c74d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:15:45.325895 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2643cd59-237f-4fcc-a5d8-8dd158c74d89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:15:45.326226 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2643cd59-237f-4fcc-a5d8-8dd158c74d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:15:45.326510 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2643cd59-237f-4fcc-a5d8-8dd158c74d89 admin admin] PATH_INFO: `/v3/users/789e2ec1d89245d3b5081a6644d3aeb9` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:15:45.328041 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2643cd59-237f-4fcc-a5d8-8dd158c74d89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=789e2ec1d89245d3b5081a6644d3aeb9)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:15:45.330289 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2643cd59-237f-4fcc-a5d8-8dd158c74d89 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:15:45.379703 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-2643cd59-237f-4fcc-a5d8-8dd158c74d89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '789e2ec1d89245d3b5081a6644d3aeb9'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:15:45.394565 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-2643cd59-237f-4fcc-a5d8-8dd158c74d89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '789e2ec1d89245d3b5081a6644d3aeb9'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:15:45.395309 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-2643cd59-237f-4fcc-a5d8-8dd158c74d89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '789e2ec1d89245d3b5081a6644d3aeb9'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:15:45.403440 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-2643cd59-237f-4fcc-a5d8-8dd158c74d89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '789e2ec1d89245d3b5081a6644d3aeb9'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:15:45.410600 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-2643cd59-237f-4fcc-a5d8-8dd158c74d89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '789e2ec1d89245d3b5081a6644d3aeb9'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:15:45.417863 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1304/2590] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 14 10:15:45 2022] DELETE /identity/v3/users/789e2ec1d89245d3b5081a6644d3aeb9 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:15:45.685682 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050511c2-ff10-4bc6-8ff9-7e1ce85946d2 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:15:45.687180 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-050511c2-ff10-4bc6-8ff9-7e1ce85946d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:15:45.700833 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050511c2-ff10-4bc6-8ff9-7e1ce85946d2 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:15:45.761288 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac608cb-1a26-44e4-aa0d-41e472331ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:15:45.762146 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac608cb-1a26-44e4-aa0d-41e472331ebf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:15:45.762459 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac608cb-1a26-44e4-aa0d-41e472331ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:15:45.762736 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac608cb-1a26-44e4-aa0d-41e472331ebf admin admin] PATH_INFO: `/v3/projects/a9095bfad58145ec949c074e2f62a8b2` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:15:45.763915 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac608cb-1a26-44e4-aa0d-41e472331ebf admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9095bfad58145ec949c074e2f62a8b2)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:15:45.765801 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac608cb-1a26-44e4-aa0d-41e472331ebf admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:15:45.795309 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:15:45.813563 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-6ac608cb-1a26-44e4-aa0d-41e472331ebf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9095bfad58145ec949c074e2f62a8b2', 'request_id': 'req-6ac608cb-1a26-44e4-aa0d-41e472331ebf'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:15:45.822692 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-6ac608cb-1a26-44e4-aa0d-41e472331ebf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9095bfad58145ec949c074e2f62a8b2', 'request_id': 'req-6ac608cb-1a26-44e4-aa0d-41e472331ebf'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:15:45.828494 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-6ac608cb-1a26-44e4-aa0d-41e472331ebf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9095bfad58145ec949c074e2f62a8b2', 'request_id': 'req-6ac608cb-1a26-44e4-aa0d-41e472331ebf'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:15:45.839857 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-6ac608cb-1a26-44e4-aa0d-41e472331ebf admin admin] The token cache is being invalidate because project a9095bfad58145ec949c074e2f62a8b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:15:45.840148 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-6ac608cb-1a26-44e4-aa0d-41e472331ebf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:15:45.840790 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-6ac608cb-1a26-44e4-aa0d-41e472331ebf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:15:45.842394 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1287/2591] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 14 10:15:45 2022] DELETE /identity/v3/projects/a9095bfad58145ec949c074e2f62a8b2 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:15:45.847277 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a614b423-9e0d-4a53-9825-0e4f6b127699 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:15:45.847739 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a614b423-9e0d-4a53-9825-0e4f6b127699 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:15:45.848007 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a614b423-9e0d-4a53-9825-0e4f6b127699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:15:45.867067 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-a614b423-9e0d-4a53-9825-0e4f6b127699 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:15:45.868332 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-a614b423-9e0d-4a53-9825-0e4f6b127699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:15:45.931520 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1305/2592] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 10:15:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:15:45.939618 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1ead21-26cb-4cf1-abf8-fde32ba72051 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:15:45.939903 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1ead21-26cb-4cf1-abf8-fde32ba72051 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:15:45.940182 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1ead21-26cb-4cf1-abf8-fde32ba72051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:15:45.959000 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-5b1ead21-26cb-4cf1-abf8-fde32ba72051 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:15:45.960199 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-5b1ead21-26cb-4cf1-abf8-fde32ba72051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:15:45.968273 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1288/2593] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 10:15:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:15:45.972470 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a614b423-9e0d-4a53-9825-0e4f6b127699 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:15:45.982041 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a614b423-9e0d-4a53-9825-0e4f6b127699 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:15:45.986928 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fef51b-57dd-4437-8c64-155a308853d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:15:45.987595 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fef51b-57dd-4437-8c64-155a308853d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:15:45.987880 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fef51b-57dd-4437-8c64-155a308853d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:15:45.988157 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fef51b-57dd-4437-8c64-155a308853d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:15:45.988895 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fef51b-57dd-4437-8c64-155a308853d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:15:45.989203 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fef51b-57dd-4437-8c64-155a308853d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:15:45.991334 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fef51b-57dd-4437-8c64-155a308853d0 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:15:46.002727 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1306/2594] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jul 14 10:15:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:15:46.007506 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1ead21-26cb-4cf1-abf8-fde32ba72051 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:15:46.016801 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1ead21-26cb-4cf1-abf8-fde32ba72051 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:15:46.021396 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4d7a80-17e5-4dd7-9b10-6c58f7aa2398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:15:46.022093 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4d7a80-17e5-4dd7-9b10-6c58f7aa2398 admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:15:46.022415 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4d7a80-17e5-4dd7-9b10-6c58f7aa2398 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:15:46.022696 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4d7a80-17e5-4dd7-9b10-6c58f7aa2398 admin admin] PATH_INFO: `/v3/projects` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:15:46.023422 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4d7a80-17e5-4dd7-9b10-6c58f7aa2398 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:15:46.025329 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4d7a80-17e5-4dd7-9b10-6c58f7aa2398 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:15:46.051573 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1289/2595] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 14 10:15:46 2022] POST /identity/v3/projects => generated 371 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:15:46.056402 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fef51b-57dd-4437-8c64-155a308853d0 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:15:46.066330 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fef51b-57dd-4437-8c64-155a308853d0 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:15:46.091466 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:15:46.123703 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a10c3a0-527a-44e2-bd79-913b35306d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:15:46.124372 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a10c3a0-527a-44e2-bd79-913b35306d3d admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:15:46.124659 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a10c3a0-527a-44e2-bd79-913b35306d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:15:46.124937 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a10c3a0-527a-44e2-bd79-913b35306d3d admin admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:15:46.125653 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a10c3a0-527a-44e2-bd79-913b35306d3d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:15:46.127596 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a10c3a0-527a-44e2-bd79-913b35306d3d admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:15:46.147393 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1307/2596] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 14 10:15:46 2022] POST /identity/v3/users => generated 286 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:15:46.151376 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4d7a80-17e5-4dd7-9b10-6c58f7aa2398 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:15:46.161462 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4d7a80-17e5-4dd7-9b10-6c58f7aa2398 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:15:46.166616 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fe8dc6-af56-4e43-8e11-bc377c1194fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:15:46.167266 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fe8dc6-af56-4e43-8e11-bc377c1194fe admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:15:46.167546 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fe8dc6-af56-4e43-8e11-bc377c1194fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:15:46.167822 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fe8dc6-af56-4e43-8e11-bc377c1194fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:15:46.168550 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fe8dc6-af56-4e43-8e11-bc377c1194fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:15:46.170121 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fe8dc6-af56-4e43-8e11-bc377c1194fe admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:15:46.182246 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1290/2597] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 10:15:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:15:46.185883 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a10c3a0-527a-44e2-bd79-913b35306d3d admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:15:46.196202 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a10c3a0-527a-44e2-bd79-913b35306d3d admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:15:46.200913 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab9bef0-a0b0-4e97-ad19-6280b20fcfd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:15:46.201572 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab9bef0-a0b0-4e97-ad19-6280b20fcfd7 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:15:46.201855 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab9bef0-a0b0-4e97-ad19-6280b20fcfd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:15:46.202138 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab9bef0-a0b0-4e97-ad19-6280b20fcfd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:15:46.202896 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab9bef0-a0b0-4e97-ad19-6280b20fcfd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:15:46.204591 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab9bef0-a0b0-4e97-ad19-6280b20fcfd7 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:15:46.219688 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1308/2598] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 10:15:46 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:15:46.223832 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fe8dc6-af56-4e43-8e11-bc377c1194fe admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:15:46.234879 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fe8dc6-af56-4e43-8e11-bc377c1194fe admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:15:46.239567 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05571b5c-b24a-4539-b1c9-f3ee86ae2e21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:15:46.241271 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05571b5c-b24a-4539-b1c9-f3ee86ae2e21 admin admin] REQUEST_METHOD: `PUT` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:15:46.241548 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05571b5c-b24a-4539-b1c9-f3ee86ae2e21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:15:46.241828 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05571b5c-b24a-4539-b1c9-f3ee86ae2e21 admin admin] PATH_INFO: `/v3/projects/72caa5cc7fb247fb8957f69dbdb591b6/users/537510a14d91466290e3a6d2c71e08c8/roles/17dfac38a2e540fea229af7de99911bb` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:15:46.258219 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05571b5c-b24a-4539-b1c9-f3ee86ae2e21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72caa5cc7fb247fb8957f69dbdb591b6, user_id=537510a14d91466290e3a6d2c71e08c8, role_id=17dfac38a2e540fea229af7de99911bb)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:15:46.260990 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05571b5c-b24a-4539-b1c9-f3ee86ae2e21 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:15:46.277727 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1291/2599] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 14 10:15:46 2022] PUT /identity/v3/projects/72caa5cc7fb247fb8957f69dbdb591b6/users/537510a14d91466290e3a6d2c71e08c8/roles/17dfac38a2e540fea229af7de99911bb => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:15:46.343011 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a648ced-88b6-447a-a9a3-f8303d301970 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:15:46.343289 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a648ced-88b6-447a-a9a3-f8303d301970 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:15:46.343568 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a648ced-88b6-447a-a9a3-f8303d301970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:15:46.370258 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-8a648ced-88b6-447a-a9a3-f8303d301970 None None] MFA Rules not processed for user `537510a14d91466290e3a6d2c71e08c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:15:46.371475 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-8a648ced-88b6-447a-a9a3-f8303d301970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:15:46.436891 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1309/2600] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 10:15:46 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:15:46.448313 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05571b5c-b24a-4539-b1c9-f3ee86ae2e21 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:15:46.450226 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-05571b5c-b24a-4539-b1c9-f3ee86ae2e21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:15:46.529929 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05571b5c-b24a-4539-b1c9-f3ee86ae2e21 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:15:46.533749 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a580bd25-d958-40b9-a547-e304f499318b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ba461800d6845e6a767c83777ae5213', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:15:46.534435 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a580bd25-d958-40b9-a547-e304f499318b service glance] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:15:46.534730 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a580bd25-d958-40b9-a547-e304f499318b service glance] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:15:46.535011 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a580bd25-d958-40b9-a547-e304f499318b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:15:46.545218 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a580bd25-d958-40b9-a547-e304f499318b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:15:46.546702 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a580bd25-d958-40b9-a547-e304f499318b service glance] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:15:46.559295 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1292/2601] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 10:15:46 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:15:50.755068 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a648ced-88b6-447a-a9a3-f8303d301970 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:15:50.757289 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-8a648ced-88b6-447a-a9a3-f8303d301970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:15:50.834106 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a648ced-88b6-447a-a9a3-f8303d301970 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:15:50.837608 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9b4ad6-8b7c-4e36-ace7-7c9088fdeb61 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25048b29787d482783ebc944f1a7df65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:15:50.838295 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9b4ad6-8b7c-4e36-ace7-7c9088fdeb61 service cinder] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:15:50.838597 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9b4ad6-8b7c-4e36-ace7-7c9088fdeb61 service cinder] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:15:50.838854 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9b4ad6-8b7c-4e36-ace7-7c9088fdeb61 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:15:50.840611 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-0b9b4ad6-8b7c-4e36-ace7-7c9088fdeb61 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:15:50.875550 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:15:50.926681 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9b4ad6-8b7c-4e36-ace7-7c9088fdeb61 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:15:50.928165 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9b4ad6-8b7c-4e36-ace7-7c9088fdeb61 service cinder] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:15:50.948109 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1310/2602] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 10:15:50 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 10:15:54.340819 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a580bd25-d958-40b9-a547-e304f499318b service glance] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:15:54.342238 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-a580bd25-d958-40b9-a547-e304f499318b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:15:54.377253 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:15:54.403792 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a580bd25-d958-40b9-a547-e304f499318b service glance] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:15:54.407587 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8b147c-0641-40fd-a4c5-df6f245912e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e4a5a8965e4802a9055d332179b7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:15:54.408272 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8b147c-0641-40fd-a4c5-df6f245912e5 service neutron] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:15:54.408561 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8b147c-0641-40fd-a4c5-df6f245912e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:15:54.408839 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8b147c-0641-40fd-a4c5-df6f245912e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:15:54.410770 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-cf8b147c-0641-40fd-a4c5-df6f245912e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:15:54.477156 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8b147c-0641-40fd-a4c5-df6f245912e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:15:54.478656 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8b147c-0641-40fd-a4c5-df6f245912e5 service neutron] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:15:54.488230 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1293/2603] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 10:15:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:15:54.936352 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9b4ad6-8b7c-4e36-ace7-7c9088fdeb61 service cinder] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:15:54.937913 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-0b9b4ad6-8b7c-4e36-ace7-7c9088fdeb61 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:15:55.000819 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8b147c-0641-40fd-a4c5-df6f245912e5 service neutron] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:15:55.002437 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-cf8b147c-0641-40fd-a4c5-df6f245912e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:15:55.015297 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9b4ad6-8b7c-4e36-ace7-7c9088fdeb61 service cinder] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:15:55.020235 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8b147c-0641-40fd-a4c5-df6f245912e5 service neutron] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:15:55.022519 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cfe967-cb65-4508-9e93-27a76e508f86 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc5a80144b84c609944a51a84fd5e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:15:55.023275 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cfe967-cb65-4508-9e93-27a76e508f86 service placement] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:15:55.023686 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cfe967-cb65-4508-9e93-27a76e508f86 service placement] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:15:55.024131 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cfe967-cb65-4508-9e93-27a76e508f86 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:15:55.026672 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-35cfe967-cb65-4508-9e93-27a76e508f86 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:15:55.027566 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f953380-25a3-405e-bdfe-eb1f8f0412ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:15:55.028478 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f953380-25a3-405e-bdfe-eb1f8f0412ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:15:55.028768 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f953380-25a3-405e-bdfe-eb1f8f0412ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:15:55.029052 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f953380-25a3-405e-bdfe-eb1f8f0412ef admin admin] PATH_INFO: `/v3/users/08962a3ebb194189b2ab68e62fee6e60` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:15:55.030344 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f953380-25a3-405e-bdfe-eb1f8f0412ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=08962a3ebb194189b2ab68e62fee6e60)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:15:55.032308 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f953380-25a3-405e-bdfe-eb1f8f0412ef admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:15:55.040440 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cfe967-cb65-4508-9e93-27a76e508f86 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:15:55.042032 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cfe967-cb65-4508-9e93-27a76e508f86 service placement] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:15:55.052440 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1311/2604] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 10:15:54 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:15:55.082791 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-0f953380-25a3-405e-bdfe-eb1f8f0412ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08962a3ebb194189b2ab68e62fee6e60'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:15:55.089951 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-0f953380-25a3-405e-bdfe-eb1f8f0412ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08962a3ebb194189b2ab68e62fee6e60'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:15:55.090665 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-0f953380-25a3-405e-bdfe-eb1f8f0412ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08962a3ebb194189b2ab68e62fee6e60'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:15:55.098610 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-0f953380-25a3-405e-bdfe-eb1f8f0412ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08962a3ebb194189b2ab68e62fee6e60'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:15:55.099235 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-0f953380-25a3-405e-bdfe-eb1f8f0412ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08962a3ebb194189b2ab68e62fee6e60'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:15:55.122310 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1294/2605] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 14 10:15:54 2022] DELETE /identity/v3/users/08962a3ebb194189b2ab68e62fee6e60 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:15:55.312554 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cfe967-cb65-4508-9e93-27a76e508f86 service placement] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:15:55.323071 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cfe967-cb65-4508-9e93-27a76e508f86 service placement] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:15:55.387691 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4307746-67bd-4d8a-af93-327a0af3dc9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:15:55.388563 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4307746-67bd-4d8a-af93-327a0af3dc9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:15:55.388844 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4307746-67bd-4d8a-af93-327a0af3dc9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:15:55.389122 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4307746-67bd-4d8a-af93-327a0af3dc9e admin admin] PATH_INFO: `/v3/projects/6bf7eec88bc64cd2be062020a72563de` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:15:55.390328 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4307746-67bd-4d8a-af93-327a0af3dc9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=6bf7eec88bc64cd2be062020a72563de)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:15:55.392327 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4307746-67bd-4d8a-af93-327a0af3dc9e admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:15:55.431237 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:15:55.440600 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-e4307746-67bd-4d8a-af93-327a0af3dc9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6bf7eec88bc64cd2be062020a72563de', 'request_id': 'req-e4307746-67bd-4d8a-af93-327a0af3dc9e'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:15:55.446946 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-e4307746-67bd-4d8a-af93-327a0af3dc9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6bf7eec88bc64cd2be062020a72563de', 'request_id': 'req-e4307746-67bd-4d8a-af93-327a0af3dc9e'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:15:55.452786 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-e4307746-67bd-4d8a-af93-327a0af3dc9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6bf7eec88bc64cd2be062020a72563de', 'request_id': 'req-e4307746-67bd-4d8a-af93-327a0af3dc9e'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:15:55.464896 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-e4307746-67bd-4d8a-af93-327a0af3dc9e admin admin] The token cache is being invalidate because project 6bf7eec88bc64cd2be062020a72563de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:15:55.465183 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-e4307746-67bd-4d8a-af93-327a0af3dc9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:15:55.465800 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-e4307746-67bd-4d8a-af93-327a0af3dc9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:15:55.467359 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1312/2606] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 14 10:15:55 2022] DELETE /identity/v3/projects/6bf7eec88bc64cd2be062020a72563de => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:15:55.472311 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0106d7-a810-420b-9ea0-f3f91c22d8a0 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:15:55.472793 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0106d7-a810-420b-9ea0-f3f91c22d8a0 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:15:55.472907 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0106d7-a810-420b-9ea0-f3f91c22d8a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:15:55.494888 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-6b0106d7-a810-420b-9ea0-f3f91c22d8a0 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:15:55.496111 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-6b0106d7-a810-420b-9ea0-f3f91c22d8a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:15:55.544706 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:15:55.558514 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1295/2607] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 10:15:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:15:55.566046 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc2d52e-262b-497c-851a-9e0ce931257a None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:15:55.566372 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc2d52e-262b-497c-851a-9e0ce931257a None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:15:55.566650 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc2d52e-262b-497c-851a-9e0ce931257a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:15:55.592151 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-fdc2d52e-262b-497c-851a-9e0ce931257a None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:15:55.593623 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-fdc2d52e-262b-497c-851a-9e0ce931257a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:15:55.602795 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1313/2608] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 10:15:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:15:55.607036 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0106d7-a810-420b-9ea0-f3f91c22d8a0 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:15:55.617274 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0106d7-a810-420b-9ea0-f3f91c22d8a0 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:15:55.621835 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22d6146-164b-4d2d-ab20-6ca7efbeb3a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:15:55.622539 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22d6146-164b-4d2d-ab20-6ca7efbeb3a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:15:55.622824 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22d6146-164b-4d2d-ab20-6ca7efbeb3a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:15:55.623101 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22d6146-164b-4d2d-ab20-6ca7efbeb3a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:15:55.623835 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22d6146-164b-4d2d-ab20-6ca7efbeb3a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:15:55.624144 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22d6146-164b-4d2d-ab20-6ca7efbeb3a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:15:55.625727 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22d6146-164b-4d2d-ab20-6ca7efbeb3a6 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:15:55.637737 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1296/2609] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jul 14 10:15:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:15:55.641742 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc2d52e-262b-497c-851a-9e0ce931257a None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:15:55.651406 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc2d52e-262b-497c-851a-9e0ce931257a None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:15:55.656101 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998d4df8-281a-4db5-a3f4-4c63f08a5465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:15:55.656754 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998d4df8-281a-4db5-a3f4-4c63f08a5465 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:15:55.657050 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998d4df8-281a-4db5-a3f4-4c63f08a5465 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:15:55.657333 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998d4df8-281a-4db5-a3f4-4c63f08a5465 admin admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:15:55.658078 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998d4df8-281a-4db5-a3f4-4c63f08a5465 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:15:55.660280 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998d4df8-281a-4db5-a3f4-4c63f08a5465 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:15:55.686338 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1314/2610] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 14 10:15:55 2022] POST /identity/v3/projects => generated 389 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:15:55.690481 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22d6146-164b-4d2d-ab20-6ca7efbeb3a6 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:15:55.701206 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22d6146-164b-4d2d-ab20-6ca7efbeb3a6 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:15:55.760497 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62967390-293f-403f-bfef-dc3cd58aef5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:15:55.761175 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62967390-293f-403f-bfef-dc3cd58aef5c admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:15:55.761462 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62967390-293f-403f-bfef-dc3cd58aef5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:15:55.761740 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62967390-293f-403f-bfef-dc3cd58aef5c admin admin] PATH_INFO: `/v3/users` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:15:55.762473 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62967390-293f-403f-bfef-dc3cd58aef5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:15:55.764420 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62967390-293f-403f-bfef-dc3cd58aef5c admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:15:55.783161 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1297/2611] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 14 10:15:55 2022] POST /identity/v3/users => generated 295 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:15:55.787286 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998d4df8-281a-4db5-a3f4-4c63f08a5465 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:15:55.797812 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998d4df8-281a-4db5-a3f4-4c63f08a5465 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:15:55.808028 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaf44ad-afd4-4395-8a50-4452999e2833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:15:55.809414 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaf44ad-afd4-4395-8a50-4452999e2833 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:15:55.809705 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaf44ad-afd4-4395-8a50-4452999e2833 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:15:55.810794 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaf44ad-afd4-4395-8a50-4452999e2833 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:15:55.811901 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaf44ad-afd4-4395-8a50-4452999e2833 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:15:55.815073 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaf44ad-afd4-4395-8a50-4452999e2833 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:15:55.826901 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1315/2612] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 10:15:55 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 10:15:55.830884 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62967390-293f-403f-bfef-dc3cd58aef5c admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:15:55.840980 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62967390-293f-403f-bfef-dc3cd58aef5c admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:15:55.846127 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d33e5a6-8cd4-473f-b19c-01e76a7809dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:15:55.846820 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d33e5a6-8cd4-473f-b19c-01e76a7809dc admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:15:55.847108 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d33e5a6-8cd4-473f-b19c-01e76a7809dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:15:55.847390 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d33e5a6-8cd4-473f-b19c-01e76a7809dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:15:55.848153 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d33e5a6-8cd4-473f-b19c-01e76a7809dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:15:55.849769 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d33e5a6-8cd4-473f-b19c-01e76a7809dc admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:15:55.861009 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1298/2613] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 10:15:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:15:55.864197 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaf44ad-afd4-4395-8a50-4452999e2833 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:15:55.874924 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaf44ad-afd4-4395-8a50-4452999e2833 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:15:55.879710 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfcbbcc-3722-4244-a4c1-5bd45ef7b216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:15:55.880602 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfcbbcc-3722-4244-a4c1-5bd45ef7b216 admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:15:55.880997 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfcbbcc-3722-4244-a4c1-5bd45ef7b216 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:15:55.881281 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfcbbcc-3722-4244-a4c1-5bd45ef7b216 admin admin] PATH_INFO: `/v3/projects/b958f5c3f0674906978d899e36797c90/users/db8374b88a2a44758b5025d0757c00ef/roles/17dfac38a2e540fea229af7de99911bb` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:15:55.895936 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfcbbcc-3722-4244-a4c1-5bd45ef7b216 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b958f5c3f0674906978d899e36797c90, user_id=db8374b88a2a44758b5025d0757c00ef, role_id=17dfac38a2e540fea229af7de99911bb)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:15:55.899097 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfcbbcc-3722-4244-a4c1-5bd45ef7b216 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:15:55.911782 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1316/2614] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 14 10:15:55 2022] PUT /identity/v3/projects/b958f5c3f0674906978d899e36797c90/users/db8374b88a2a44758b5025d0757c00ef/roles/17dfac38a2e540fea229af7de99911bb => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:15:55.923128 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbeab5d-feb2-422a-b91d-0e683bec51ce None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:15:55.923420 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbeab5d-feb2-422a-b91d-0e683bec51ce None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:15:55.923699 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbeab5d-feb2-422a-b91d-0e683bec51ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:15:55.953898 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-acbeab5d-feb2-422a-b91d-0e683bec51ce None None] MFA Rules not processed for user `db8374b88a2a44758b5025d0757c00ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:15:55.955142 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-acbeab5d-feb2-422a-b91d-0e683bec51ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:15:56.021430 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1299/2615] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 10:15:55 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:15:56.032896 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfcbbcc-3722-4244-a4c1-5bd45ef7b216 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:15:56.034710 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-4bfcbbcc-3722-4244-a4c1-5bd45ef7b216 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:15:56.092992 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfcbbcc-3722-4244-a4c1-5bd45ef7b216 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:15:56.096752 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb7003c-b9c5-47ee-a6b7-02a2c9faa441 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25048b29787d482783ebc944f1a7df65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:15:56.097399 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb7003c-b9c5-47ee-a6b7-02a2c9faa441 service cinder] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:15:56.097688 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb7003c-b9c5-47ee-a6b7-02a2c9faa441 service cinder] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:15:56.097971 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb7003c-b9c5-47ee-a6b7-02a2c9faa441 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:15:56.106396 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb7003c-b9c5-47ee-a6b7-02a2c9faa441 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:15:56.107835 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb7003c-b9c5-47ee-a6b7-02a2c9faa441 service cinder] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:15:56.116669 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1317/2616] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 10:15:56 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:16:06.018602 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=74,keystone:INSERT=3 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:16:06.112692 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=64,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:16:32.806233 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbeab5d-feb2-422a-b91d-0e683bec51ce None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:16:32.870229 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbeab5d-feb2-422a-b91d-0e683bec51ce None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:16:32.874643 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b90099-780c-432d-ac60-a93c9b40220a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:16:32.875515 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b90099-780c-432d-ac60-a93c9b40220a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:16:32.875807 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b90099-780c-432d-ac60-a93c9b40220a admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:16:32.876076 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b90099-780c-432d-ac60-a93c9b40220a admin admin] PATH_INFO: `/v3/users/db8374b88a2a44758b5025d0757c00ef` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:16:32.877271 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b90099-780c-432d-ac60-a93c9b40220a admin admin] RBAC: Authorizing `identity:delete_user(user_id=db8374b88a2a44758b5025d0757c00ef)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:16:32.879217 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b90099-780c-432d-ac60-a93c9b40220a admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:16:32.926295 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-83b90099-780c-432d-ac60-a93c9b40220a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db8374b88a2a44758b5025d0757c00ef'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:16:32.933439 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-83b90099-780c-432d-ac60-a93c9b40220a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db8374b88a2a44758b5025d0757c00ef'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:16:32.934098 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-83b90099-780c-432d-ac60-a93c9b40220a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db8374b88a2a44758b5025d0757c00ef'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:16:32.941369 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-83b90099-780c-432d-ac60-a93c9b40220a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db8374b88a2a44758b5025d0757c00ef'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:16:32.942035 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-83b90099-780c-432d-ac60-a93c9b40220a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db8374b88a2a44758b5025d0757c00ef'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:16:32.959674 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1300/2617] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 14 10:16:32 2022] DELETE /identity/v3/users/db8374b88a2a44758b5025d0757c00ef => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:16:32.964788 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8898e7a-a72b-4bac-9dd9-a899448717d6 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:16:32.965313 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8898e7a-a72b-4bac-9dd9-a899448717d6 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:16:32.965422 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8898e7a-a72b-4bac-9dd9-a899448717d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:16:32.982688 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-d8898e7a-a72b-4bac-9dd9-a899448717d6 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:16:32.983889 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-d8898e7a-a72b-4bac-9dd9-a899448717d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:16:33.043456 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1318/2618] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 10:16:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:16:33.053059 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b90099-780c-432d-ac60-a93c9b40220a admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:16:33.054491 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-83b90099-780c-432d-ac60-a93c9b40220a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:16:33.113277 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b90099-780c-432d-ac60-a93c9b40220a admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:16:33.116975 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4641665-fe70-4ef9-8e7b-41990589b03e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e4a5a8965e4802a9055d332179b7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:16:33.118111 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4641665-fe70-4ef9-8e7b-41990589b03e service neutron] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:16:33.118632 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4641665-fe70-4ef9-8e7b-41990589b03e service neutron] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:16:33.118917 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4641665-fe70-4ef9-8e7b-41990589b03e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:16:33.128292 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4641665-fe70-4ef9-8e7b-41990589b03e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:16:33.129722 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4641665-fe70-4ef9-8e7b-41990589b03e service neutron] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:16:33.139893 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1301/2619] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 10:16:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:16:33.416993 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8898e7a-a72b-4bac-9dd9-a899448717d6 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:16:33.418564 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-d8898e7a-a72b-4bac-9dd9-a899448717d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:16:33.432004 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8898e7a-a72b-4bac-9dd9-a899448717d6 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:16:33.436897 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b472dee-7a80-4eb9-83b8-dc1dfd114c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:16:33.437774 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b472dee-7a80-4eb9-83b8-dc1dfd114c29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:16:33.438144 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b472dee-7a80-4eb9-83b8-dc1dfd114c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:16:33.438491 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b472dee-7a80-4eb9-83b8-dc1dfd114c29 admin admin] PATH_INFO: `/v3/projects/b958f5c3f0674906978d899e36797c90` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:16:33.439617 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b472dee-7a80-4eb9-83b8-dc1dfd114c29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b958f5c3f0674906978d899e36797c90)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:16:33.441661 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b472dee-7a80-4eb9-83b8-dc1dfd114c29 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:16:33.488894 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-2b472dee-7a80-4eb9-83b8-dc1dfd114c29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b958f5c3f0674906978d899e36797c90', 'request_id': 'req-2b472dee-7a80-4eb9-83b8-dc1dfd114c29'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:16:33.495509 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-2b472dee-7a80-4eb9-83b8-dc1dfd114c29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b958f5c3f0674906978d899e36797c90', 'request_id': 'req-2b472dee-7a80-4eb9-83b8-dc1dfd114c29'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:16:33.501262 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-2b472dee-7a80-4eb9-83b8-dc1dfd114c29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b958f5c3f0674906978d899e36797c90', 'request_id': 'req-2b472dee-7a80-4eb9-83b8-dc1dfd114c29'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:16:33.514254 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-2b472dee-7a80-4eb9-83b8-dc1dfd114c29 admin admin] The token cache is being invalidate because project b958f5c3f0674906978d899e36797c90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:16:33.514548 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-2b472dee-7a80-4eb9-83b8-dc1dfd114c29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:16:33.515168 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-2b472dee-7a80-4eb9-83b8-dc1dfd114c29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:16:33.516699 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1319/2620] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 14 10:16:33 2022] DELETE /identity/v3/projects/b958f5c3f0674906978d899e36797c90 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:16:43.135523 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:16:43.511236 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:16:45.649044 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4641665-fe70-4ef9-8e7b-41990589b03e service neutron] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:16:45.650501 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-e4641665-fe70-4ef9-8e7b-41990589b03e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:16:45.663716 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4641665-fe70-4ef9-8e7b-41990589b03e service neutron] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:16:45.719490 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd84edb-c24b-4082-b231-2f9d6c7b7864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:16:45.720465 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd84edb-c24b-4082-b231-2f9d6c7b7864 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:16:45.720750 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd84edb-c24b-4082-b231-2f9d6c7b7864 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:16:45.721030 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd84edb-c24b-4082-b231-2f9d6c7b7864 admin admin] PATH_INFO: `/v3/users/537510a14d91466290e3a6d2c71e08c8` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:16:45.722262 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd84edb-c24b-4082-b231-2f9d6c7b7864 admin admin] RBAC: Authorizing `identity:delete_user(user_id=537510a14d91466290e3a6d2c71e08c8)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:16:45.724220 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd84edb-c24b-4082-b231-2f9d6c7b7864 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:16:45.770881 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-4cd84edb-c24b-4082-b231-2f9d6c7b7864 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '537510a14d91466290e3a6d2c71e08c8'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:16:45.777855 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-4cd84edb-c24b-4082-b231-2f9d6c7b7864 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '537510a14d91466290e3a6d2c71e08c8'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:16:45.778564 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-4cd84edb-c24b-4082-b231-2f9d6c7b7864 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '537510a14d91466290e3a6d2c71e08c8'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:16:45.786732 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-4cd84edb-c24b-4082-b231-2f9d6c7b7864 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '537510a14d91466290e3a6d2c71e08c8'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:16:45.787338 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-4cd84edb-c24b-4082-b231-2f9d6c7b7864 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '537510a14d91466290e3a6d2c71e08c8'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:16:45.805521 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1302/2621] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 14 10:16:45 2022] DELETE /identity/v3/users/537510a14d91466290e3a6d2c71e08c8 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:16:45.810870 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9404bce-2d4f-4ca6-b3d0-8107c272f20d None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:16:45.811405 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9404bce-2d4f-4ca6-b3d0-8107c272f20d None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:16:45.811405 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9404bce-2d4f-4ca6-b3d0-8107c272f20d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:16:45.830485 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-f9404bce-2d4f-4ca6-b3d0-8107c272f20d None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:16:45.831696 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-f9404bce-2d4f-4ca6-b3d0-8107c272f20d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:16:45.889323 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1320/2622] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 10:16:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:16:45.898924 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd84edb-c24b-4082-b231-2f9d6c7b7864 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:16:45.900973 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-4cd84edb-c24b-4082-b231-2f9d6c7b7864 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:16:45.958481 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd84edb-c24b-4082-b231-2f9d6c7b7864 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:16:45.962176 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e312dcf-0433-4f8a-8c02-804e3a49abaf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e4a5a8965e4802a9055d332179b7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:16:45.962850 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e312dcf-0433-4f8a-8c02-804e3a49abaf service neutron] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:16:45.963150 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e312dcf-0433-4f8a-8c02-804e3a49abaf service neutron] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:16:45.963439 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e312dcf-0433-4f8a-8c02-804e3a49abaf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:16:45.972437 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e312dcf-0433-4f8a-8c02-804e3a49abaf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:16:45.973880 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e312dcf-0433-4f8a-8c02-804e3a49abaf service neutron] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:16:45.983322 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1303/2623] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 10:16:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:16:46.255595 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9404bce-2d4f-4ca6-b3d0-8107c272f20d None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:16:46.257092 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-f9404bce-2d4f-4ca6-b3d0-8107c272f20d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:16:46.268784 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9404bce-2d4f-4ca6-b3d0-8107c272f20d None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:16:46.273329 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cbd204-efc5-4d4b-a493-81f500843ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:16:46.274205 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cbd204-efc5-4d4b-a493-81f500843ee2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:16:46.274496 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cbd204-efc5-4d4b-a493-81f500843ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:16:46.274776 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cbd204-efc5-4d4b-a493-81f500843ee2 admin admin] PATH_INFO: `/v3/projects/72caa5cc7fb247fb8957f69dbdb591b6` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:16:46.276059 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cbd204-efc5-4d4b-a493-81f500843ee2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=72caa5cc7fb247fb8957f69dbdb591b6)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:16:46.277963 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cbd204-efc5-4d4b-a493-81f500843ee2 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:16:46.327703 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-d1cbd204-efc5-4d4b-a493-81f500843ee2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72caa5cc7fb247fb8957f69dbdb591b6', 'request_id': 'req-d1cbd204-efc5-4d4b-a493-81f500843ee2'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:16:46.333745 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-d1cbd204-efc5-4d4b-a493-81f500843ee2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72caa5cc7fb247fb8957f69dbdb591b6', 'request_id': 'req-d1cbd204-efc5-4d4b-a493-81f500843ee2'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:16:46.339364 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-d1cbd204-efc5-4d4b-a493-81f500843ee2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72caa5cc7fb247fb8957f69dbdb591b6', 'request_id': 'req-d1cbd204-efc5-4d4b-a493-81f500843ee2'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:16:46.351441 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-d1cbd204-efc5-4d4b-a493-81f500843ee2 admin admin] The token cache is being invalidate because project 72caa5cc7fb247fb8957f69dbdb591b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:16:46.351751 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-d1cbd204-efc5-4d4b-a493-81f500843ee2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:16:46.352361 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-d1cbd204-efc5-4d4b-a493-81f500843ee2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:16:46.354526 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1321/2624] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 14 10:16:46 2022] DELETE /identity/v3/projects/72caa5cc7fb247fb8957f69dbdb591b6 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:16:46.359601 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee0400a-0cfd-4de3-a4d1-733ac92492f0 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:16:46.359893 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee0400a-0cfd-4de3-a4d1-733ac92492f0 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:16:46.360172 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee0400a-0cfd-4de3-a4d1-733ac92492f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:16:46.378176 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-5ee0400a-0cfd-4de3-a4d1-733ac92492f0 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:16:46.379417 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-5ee0400a-0cfd-4de3-a4d1-733ac92492f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:16:46.396220 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:16:46.441664 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1304/2625] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 10:16:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:16:46.449697 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eac382-e02b-4bcf-a8b9-b75916098529 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:16:46.450015 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eac382-e02b-4bcf-a8b9-b75916098529 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:16:46.450365 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eac382-e02b-4bcf-a8b9-b75916098529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:16:46.468959 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-92eac382-e02b-4bcf-a8b9-b75916098529 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:16:46.470170 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-92eac382-e02b-4bcf-a8b9-b75916098529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:16:46.478089 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1322/2626] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 10:16:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:16:46.482907 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee0400a-0cfd-4de3-a4d1-733ac92492f0 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:16:46.492786 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee0400a-0cfd-4de3-a4d1-733ac92492f0 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:16:46.497460 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c66c2b-f41b-411f-90e0-c4ff62890dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:16:46.498122 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c66c2b-f41b-411f-90e0-c4ff62890dce admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:16:46.498437 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c66c2b-f41b-411f-90e0-c4ff62890dce admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:16:46.498714 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c66c2b-f41b-411f-90e0-c4ff62890dce admin admin] PATH_INFO: `/v3/domains` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:16:46.499472 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c66c2b-f41b-411f-90e0-c4ff62890dce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:16:46.499809 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c66c2b-f41b-411f-90e0-c4ff62890dce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:16:46.501453 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c66c2b-f41b-411f-90e0-c4ff62890dce admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:16:46.513021 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1305/2627] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jul 14 10:16:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:16:46.517213 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eac382-e02b-4bcf-a8b9-b75916098529 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:16:46.527083 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eac382-e02b-4bcf-a8b9-b75916098529 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:16:46.531771 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2733a3ca-6c24-454c-bcd7-163c550797c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:16:46.532441 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2733a3ca-6c24-454c-bcd7-163c550797c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:16:46.532732 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2733a3ca-6c24-454c-bcd7-163c550797c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:16:46.533008 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2733a3ca-6c24-454c-bcd7-163c550797c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:16:46.533805 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2733a3ca-6c24-454c-bcd7-163c550797c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:16:46.535764 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2733a3ca-6c24-454c-bcd7-163c550797c9 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:16:46.562342 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1323/2628] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 14 10:16:46 2022] POST /identity/v3/projects => generated 371 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 10:16:46.566598 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c66c2b-f41b-411f-90e0-c4ff62890dce admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:16:46.576442 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c66c2b-f41b-411f-90e0-c4ff62890dce admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:16:46.632126 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12022116-263c-4465-ba8e-7a5fa2a7b4a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:16:46.632713 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12022116-263c-4465-ba8e-7a5fa2a7b4a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:16:46.632995 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12022116-263c-4465-ba8e-7a5fa2a7b4a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:16:46.633270 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12022116-263c-4465-ba8e-7a5fa2a7b4a0 admin admin] PATH_INFO: `/v3/users` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:16:46.633967 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12022116-263c-4465-ba8e-7a5fa2a7b4a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:16:46.635997 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12022116-263c-4465-ba8e-7a5fa2a7b4a0 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:16:46.656498 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1306/2629] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 14 10:16:46 2022] POST /identity/v3/users => generated 286 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:16:46.660766 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2733a3ca-6c24-454c-bcd7-163c550797c9 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:16:46.671516 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2733a3ca-6c24-454c-bcd7-163c550797c9 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:16:46.676129 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cad06b-2c2c-48f3-b65e-4ab4732cb73d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:16:46.676784 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cad06b-2c2c-48f3-b65e-4ab4732cb73d admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:16:46.677067 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cad06b-2c2c-48f3-b65e-4ab4732cb73d admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:16:46.677344 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cad06b-2c2c-48f3-b65e-4ab4732cb73d admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:16:46.678066 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cad06b-2c2c-48f3-b65e-4ab4732cb73d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:16:46.679700 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cad06b-2c2c-48f3-b65e-4ab4732cb73d admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:16:46.690180 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1324/2630] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 10:16:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:16:46.693944 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12022116-263c-4465-ba8e-7a5fa2a7b4a0 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:16:46.704053 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12022116-263c-4465-ba8e-7a5fa2a7b4a0 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:16:46.708567 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4cbd84-69d8-4c0a-ba62-6a5cb116d68b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:16:46.709336 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4cbd84-69d8-4c0a-ba62-6a5cb116d68b admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:16:46.709622 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4cbd84-69d8-4c0a-ba62-6a5cb116d68b admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:16:46.709898 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4cbd84-69d8-4c0a-ba62-6a5cb116d68b admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:16:46.710657 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4cbd84-69d8-4c0a-ba62-6a5cb116d68b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:16:46.712223 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4cbd84-69d8-4c0a-ba62-6a5cb116d68b admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:16:46.722865 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1307/2631] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 10:16:46 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:16:46.727015 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cad06b-2c2c-48f3-b65e-4ab4732cb73d admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:16:46.737475 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cad06b-2c2c-48f3-b65e-4ab4732cb73d admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:16:46.742384 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40e4112-51fd-4075-8b6d-d3d7afa01267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:16:46.743446 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40e4112-51fd-4075-8b6d-d3d7afa01267 admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:16:46.743725 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40e4112-51fd-4075-8b6d-d3d7afa01267 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:16:46.744024 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40e4112-51fd-4075-8b6d-d3d7afa01267 admin admin] PATH_INFO: `/v3/projects/01c84418ce7344e289468a50f11be3c6/users/846b1229e9824df5bb0e3e454b55ab9e/roles/17dfac38a2e540fea229af7de99911bb` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:16:46.758751 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40e4112-51fd-4075-8b6d-d3d7afa01267 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01c84418ce7344e289468a50f11be3c6, user_id=846b1229e9824df5bb0e3e454b55ab9e, role_id=17dfac38a2e540fea229af7de99911bb)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:16:46.761464 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40e4112-51fd-4075-8b6d-d3d7afa01267 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:16:46.774444 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1325/2632] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 14 10:16:46 2022] PUT /identity/v3/projects/01c84418ce7344e289468a50f11be3c6/users/846b1229e9824df5bb0e3e454b55ab9e/roles/17dfac38a2e540fea229af7de99911bb => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:16:46.785929 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00e1f7c-0b4b-4cd4-a5bb-27de2f48a68c None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:16:46.786241 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00e1f7c-0b4b-4cd4-a5bb-27de2f48a68c None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:16:46.786529 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00e1f7c-0b4b-4cd4-a5bb-27de2f48a68c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:16:46.814558 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-a00e1f7c-0b4b-4cd4-a5bb-27de2f48a68c None None] MFA Rules not processed for user `846b1229e9824df5bb0e3e454b55ab9e`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:16:46.815815 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-a00e1f7c-0b4b-4cd4-a5bb-27de2f48a68c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:16:46.880204 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1308/2633] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 10:16:46 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:16:46.891864 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40e4112-51fd-4075-8b6d-d3d7afa01267 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:16:46.893594 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-c40e4112-51fd-4075-8b6d-d3d7afa01267 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:16:46.915897 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:16:46.954744 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40e4112-51fd-4075-8b6d-d3d7afa01267 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:16:46.958515 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe24ca0-384e-491d-bbef-bd2fad9b480d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25048b29787d482783ebc944f1a7df65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:16:46.959174 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe24ca0-384e-491d-bbef-bd2fad9b480d service cinder] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:16:46.959463 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe24ca0-384e-491d-bbef-bd2fad9b480d service cinder] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:16:46.959744 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe24ca0-384e-491d-bbef-bd2fad9b480d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:16:46.969135 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe24ca0-384e-491d-bbef-bd2fad9b480d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:16:46.970642 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe24ca0-384e-491d-bbef-bd2fad9b480d service cinder] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:16:46.979456 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1326/2634] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 10:16:46 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:16:47.004102 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00e1f7c-0b4b-4cd4-a5bb-27de2f48a68c None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:16:47.024574 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:16:47.069420 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00e1f7c-0b4b-4cd4-a5bb-27de2f48a68c None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:16:47.074624 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f57e7c2-5721-4a65-a89d-cd4685698753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:16:47.075528 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f57e7c2-5721-4a65-a89d-cd4685698753 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:16:47.075812 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f57e7c2-5721-4a65-a89d-cd4685698753 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:16:47.076116 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f57e7c2-5721-4a65-a89d-cd4685698753 admin admin] PATH_INFO: `/v3/users/846b1229e9824df5bb0e3e454b55ab9e` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:16:47.077318 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f57e7c2-5721-4a65-a89d-cd4685698753 admin admin] RBAC: Authorizing `identity:delete_user(user_id=846b1229e9824df5bb0e3e454b55ab9e)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:16:47.079256 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f57e7c2-5721-4a65-a89d-cd4685698753 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:16:47.126660 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-1f57e7c2-5721-4a65-a89d-cd4685698753 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '846b1229e9824df5bb0e3e454b55ab9e'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:16:47.133509 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-1f57e7c2-5721-4a65-a89d-cd4685698753 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '846b1229e9824df5bb0e3e454b55ab9e'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:16:47.134209 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-1f57e7c2-5721-4a65-a89d-cd4685698753 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '846b1229e9824df5bb0e3e454b55ab9e'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:16:47.141518 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-1f57e7c2-5721-4a65-a89d-cd4685698753 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '846b1229e9824df5bb0e3e454b55ab9e'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:16:47.142081 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-1f57e7c2-5721-4a65-a89d-cd4685698753 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '846b1229e9824df5bb0e3e454b55ab9e'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:16:47.158944 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1309/2635] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 14 10:16:47 2022] DELETE /identity/v3/users/846b1229e9824df5bb0e3e454b55ab9e => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:16:47.163419 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c0a1cb-7939-459e-b8dc-361ec20d619a None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:16:47.163721 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c0a1cb-7939-459e-b8dc-361ec20d619a None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:16:47.164011 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c0a1cb-7939-459e-b8dc-361ec20d619a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:16:47.181738 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-39c0a1cb-7939-459e-b8dc-361ec20d619a None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:16:47.183826 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-39c0a1cb-7939-459e-b8dc-361ec20d619a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:16:47.241295 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1327/2636] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 10:16:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:16:47.250828 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f57e7c2-5721-4a65-a89d-cd4685698753 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:16:47.252207 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-1f57e7c2-5721-4a65-a89d-cd4685698753 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:16:47.309466 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f57e7c2-5721-4a65-a89d-cd4685698753 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:16:47.313242 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f61f402-64c4-4e28-b862-349a293fcb62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e4a5a8965e4802a9055d332179b7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:16:47.313981 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f61f402-64c4-4e28-b862-349a293fcb62 service neutron] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:16:47.314331 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f61f402-64c4-4e28-b862-349a293fcb62 service neutron] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:16:47.314570 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f61f402-64c4-4e28-b862-349a293fcb62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:16:47.323784 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f61f402-64c4-4e28-b862-349a293fcb62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:16:47.325218 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f61f402-64c4-4e28-b862-349a293fcb62 service neutron] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:16:47.334668 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1310/2637] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 10:16:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:16:47.607114 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c0a1cb-7939-459e-b8dc-361ec20d619a None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:16:47.608643 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-39c0a1cb-7939-459e-b8dc-361ec20d619a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:16:47.621266 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c0a1cb-7939-459e-b8dc-361ec20d619a None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:16:47.625942 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f8d830-030b-42e1-917a-8161694b7989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:16:47.626848 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f8d830-030b-42e1-917a-8161694b7989 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:16:47.627128 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f8d830-030b-42e1-917a-8161694b7989 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:16:47.627404 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f8d830-030b-42e1-917a-8161694b7989 admin admin] PATH_INFO: `/v3/projects/01c84418ce7344e289468a50f11be3c6` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:16:47.628730 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f8d830-030b-42e1-917a-8161694b7989 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01c84418ce7344e289468a50f11be3c6)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:16:47.630669 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f8d830-030b-42e1-917a-8161694b7989 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:16:47.679744 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-67f8d830-030b-42e1-917a-8161694b7989 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01c84418ce7344e289468a50f11be3c6', 'request_id': 'req-67f8d830-030b-42e1-917a-8161694b7989'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:16:47.686181 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-67f8d830-030b-42e1-917a-8161694b7989 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01c84418ce7344e289468a50f11be3c6', 'request_id': 'req-67f8d830-030b-42e1-917a-8161694b7989'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:16:47.691980 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-67f8d830-030b-42e1-917a-8161694b7989 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01c84418ce7344e289468a50f11be3c6', 'request_id': 'req-67f8d830-030b-42e1-917a-8161694b7989'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:16:47.705321 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-67f8d830-030b-42e1-917a-8161694b7989 admin admin] The token cache is being invalidate because project 01c84418ce7344e289468a50f11be3c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:16:47.705611 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-67f8d830-030b-42e1-917a-8161694b7989 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:16:47.706272 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-67f8d830-030b-42e1-917a-8161694b7989 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:16:47.707826 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1328/2638] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 14 10:16:47 2022] DELETE /identity/v3/projects/01c84418ce7344e289468a50f11be3c6 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:16:47.712937 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab25121-ee2e-4672-ac03-46d7867a8ffd None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:16:47.714019 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab25121-ee2e-4672-ac03-46d7867a8ffd None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:16:47.714266 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab25121-ee2e-4672-ac03-46d7867a8ffd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:16:47.731441 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-bab25121-ee2e-4672-ac03-46d7867a8ffd None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:16:47.732706 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-bab25121-ee2e-4672-ac03-46d7867a8ffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:16:47.766284 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:16:47.797770 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1311/2639] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 10:16:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:16:47.805590 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dae594-57cc-4fab-a18c-eac50562ff49 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:16:47.805886 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dae594-57cc-4fab-a18c-eac50562ff49 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:16:47.806166 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dae594-57cc-4fab-a18c-eac50562ff49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:16:47.824942 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-14dae594-57cc-4fab-a18c-eac50562ff49 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:16:47.826131 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-14dae594-57cc-4fab-a18c-eac50562ff49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:16:47.834490 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1329/2640] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 10:16:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:16:47.839414 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab25121-ee2e-4672-ac03-46d7867a8ffd None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:16:47.848986 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab25121-ee2e-4672-ac03-46d7867a8ffd None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:16:47.853638 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ffd834-06d1-4e2b-be77-cbbb1f417abe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:16:47.854379 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ffd834-06d1-4e2b-be77-cbbb1f417abe admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:16:47.854664 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ffd834-06d1-4e2b-be77-cbbb1f417abe admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:16:47.854939 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ffd834-06d1-4e2b-be77-cbbb1f417abe admin admin] PATH_INFO: `/v3/domains` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:16:47.855662 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ffd834-06d1-4e2b-be77-cbbb1f417abe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:16:47.855976 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ffd834-06d1-4e2b-be77-cbbb1f417abe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:16:47.857559 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ffd834-06d1-4e2b-be77-cbbb1f417abe admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:16:47.869003 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1312/2641] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jul 14 10:16:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:16:47.873104 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dae594-57cc-4fab-a18c-eac50562ff49 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:16:47.882300 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dae594-57cc-4fab-a18c-eac50562ff49 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:16:47.887557 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb57e267-c067-4f7a-8dde-8e140369fd62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:16:47.888204 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb57e267-c067-4f7a-8dde-8e140369fd62 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:16:47.888489 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb57e267-c067-4f7a-8dde-8e140369fd62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:16:47.888767 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb57e267-c067-4f7a-8dde-8e140369fd62 admin admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:16:47.889460 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb57e267-c067-4f7a-8dde-8e140369fd62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:16:47.891376 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb57e267-c067-4f7a-8dde-8e140369fd62 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:16:47.916507 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1330/2642] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 14 10:16:47 2022] POST /identity/v3/projects => generated 399 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:16:47.920563 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ffd834-06d1-4e2b-be77-cbbb1f417abe admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:16:47.930555 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ffd834-06d1-4e2b-be77-cbbb1f417abe admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:16:47.986466 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ad5774-dad0-4083-8d4d-cf4b7dd9226a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:16:47.987127 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ad5774-dad0-4083-8d4d-cf4b7dd9226a admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:16:47.987415 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ad5774-dad0-4083-8d4d-cf4b7dd9226a admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:16:47.987697 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ad5774-dad0-4083-8d4d-cf4b7dd9226a admin admin] PATH_INFO: `/v3/users` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:16:47.988381 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ad5774-dad0-4083-8d4d-cf4b7dd9226a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:16:47.990311 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ad5774-dad0-4083-8d4d-cf4b7dd9226a admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:16:48.011346 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1313/2643] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 14 10:16:47 2022] POST /identity/v3/users => generated 300 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:16:48.015524 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb57e267-c067-4f7a-8dde-8e140369fd62 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:16:48.025971 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb57e267-c067-4f7a-8dde-8e140369fd62 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:16:48.030653 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2247e2f-e412-4ca4-87fb-ffe91ccf8256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:16:48.031332 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2247e2f-e412-4ca4-87fb-ffe91ccf8256 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:16:48.031616 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2247e2f-e412-4ca4-87fb-ffe91ccf8256 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:16:48.031891 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2247e2f-e412-4ca4-87fb-ffe91ccf8256 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:16:48.032612 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2247e2f-e412-4ca4-87fb-ffe91ccf8256 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:16:48.034213 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2247e2f-e412-4ca4-87fb-ffe91ccf8256 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:16:48.044391 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1331/2644] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 10:16:48 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:16:48.048292 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ad5774-dad0-4083-8d4d-cf4b7dd9226a admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:16:48.059464 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ad5774-dad0-4083-8d4d-cf4b7dd9226a admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:16:48.063679 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6a29c9-7a9a-4d7a-b2f3-bfb5f99791b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:16:48.064338 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6a29c9-7a9a-4d7a-b2f3-bfb5f99791b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:16:48.064624 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6a29c9-7a9a-4d7a-b2f3-bfb5f99791b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:16:48.064904 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6a29c9-7a9a-4d7a-b2f3-bfb5f99791b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:16:48.065632 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6a29c9-7a9a-4d7a-b2f3-bfb5f99791b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:16:48.067261 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6a29c9-7a9a-4d7a-b2f3-bfb5f99791b4 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:16:48.078877 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1314/2645] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 10:16:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:16:48.082876 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2247e2f-e412-4ca4-87fb-ffe91ccf8256 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:16:48.092853 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2247e2f-e412-4ca4-87fb-ffe91ccf8256 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:16:48.097400 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5257fc-e678-44a8-b39a-a8422442b5c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:16:48.098301 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5257fc-e678-44a8-b39a-a8422442b5c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:16:48.098589 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5257fc-e678-44a8-b39a-a8422442b5c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:16:48.098886 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5257fc-e678-44a8-b39a-a8422442b5c6 admin admin] PATH_INFO: `/v3/projects/bab1cf2fc90a4ca3a836c3406e5c804e/users/a3887e871d8e49f3bc72e5405703dc76/roles/17dfac38a2e540fea229af7de99911bb` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:16:48.101057 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:16:48.117236 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5257fc-e678-44a8-b39a-a8422442b5c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bab1cf2fc90a4ca3a836c3406e5c804e, user_id=a3887e871d8e49f3bc72e5405703dc76, role_id=17dfac38a2e540fea229af7de99911bb)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:16:48.120516 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5257fc-e678-44a8-b39a-a8422442b5c6 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:16:48.135953 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1332/2646] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 14 10:16:48 2022] PUT /identity/v3/projects/bab1cf2fc90a4ca3a836c3406e5c804e/users/a3887e871d8e49f3bc72e5405703dc76/roles/17dfac38a2e540fea229af7de99911bb => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:16:48.147595 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c71055-6d32-4478-97f0-7288d89a270f None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:16:48.147889 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c71055-6d32-4478-97f0-7288d89a270f None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:16:48.148226 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c71055-6d32-4478-97f0-7288d89a270f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:16:48.177292 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-b4c71055-6d32-4478-97f0-7288d89a270f None None] MFA Rules not processed for user `a3887e871d8e49f3bc72e5405703dc76`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:16:48.178560 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-b4c71055-6d32-4478-97f0-7288d89a270f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:16:48.242640 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1315/2647] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 10:16:48 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:16:48.254348 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5257fc-e678-44a8-b39a-a8422442b5c6 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:16:48.256034 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-ed5257fc-e678-44a8-b39a-a8422442b5c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:16:48.311882 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5257fc-e678-44a8-b39a-a8422442b5c6 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:16:48.315609 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7153d718-b0ab-428a-815e-5efc5d50a5c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25048b29787d482783ebc944f1a7df65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:16:48.316247 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7153d718-b0ab-428a-815e-5efc5d50a5c8 service cinder] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:16:48.316529 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7153d718-b0ab-428a-815e-5efc5d50a5c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:16:48.316804 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7153d718-b0ab-428a-815e-5efc5d50a5c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:16:48.325681 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7153d718-b0ab-428a-815e-5efc5d50a5c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:16:48.327120 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7153d718-b0ab-428a-815e-5efc5d50a5c8 service cinder] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:16:48.335814 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1333/2648] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 10:16:48 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:16:57.391184 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c71055-6d32-4478-97f0-7288d89a270f None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:16:57.429671 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:16:57.455786 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c71055-6d32-4478-97f0-7288d89a270f None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:16:57.460591 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cee2ab-5180-4636-931c-d720993746bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:16:57.461457 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cee2ab-5180-4636-931c-d720993746bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:16:57.461736 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cee2ab-5180-4636-931c-d720993746bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:16:57.462010 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cee2ab-5180-4636-931c-d720993746bd admin admin] PATH_INFO: `/v3/users/a3887e871d8e49f3bc72e5405703dc76` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:16:57.463240 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cee2ab-5180-4636-931c-d720993746bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3887e871d8e49f3bc72e5405703dc76)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:16:57.465268 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cee2ab-5180-4636-931c-d720993746bd admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:16:57.512644 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-93cee2ab-5180-4636-931c-d720993746bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3887e871d8e49f3bc72e5405703dc76'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:16:57.519598 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-93cee2ab-5180-4636-931c-d720993746bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3887e871d8e49f3bc72e5405703dc76'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:16:57.520265 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-93cee2ab-5180-4636-931c-d720993746bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3887e871d8e49f3bc72e5405703dc76'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:16:57.527493 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-93cee2ab-5180-4636-931c-d720993746bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3887e871d8e49f3bc72e5405703dc76'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:16:57.528114 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-93cee2ab-5180-4636-931c-d720993746bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3887e871d8e49f3bc72e5405703dc76'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:16:57.546051 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1316/2649] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 14 10:16:57 2022] DELETE /identity/v3/users/a3887e871d8e49f3bc72e5405703dc76 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:16:57.550796 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e42e6b4-f8aa-4610-8e67-0883b315027d None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:16:57.551308 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e42e6b4-f8aa-4610-8e67-0883b315027d None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:16:57.551422 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e42e6b4-f8aa-4610-8e67-0883b315027d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:16:57.569477 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-0e42e6b4-f8aa-4610-8e67-0883b315027d None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:16:57.570703 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-0e42e6b4-f8aa-4610-8e67-0883b315027d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:16:57.630775 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1334/2650] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 10:16:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:16:57.640599 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cee2ab-5180-4636-931c-d720993746bd admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:16:57.642007 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-93cee2ab-5180-4636-931c-d720993746bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:16:57.698232 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cee2ab-5180-4636-931c-d720993746bd admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:16:57.702446 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6add718-3d0e-413d-af87-04d9b657a739 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e4a5a8965e4802a9055d332179b7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:16:57.703099 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6add718-3d0e-413d-af87-04d9b657a739 service neutron] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:16:57.703386 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6add718-3d0e-413d-af87-04d9b657a739 service neutron] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:16:57.703668 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6add718-3d0e-413d-af87-04d9b657a739 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:16:57.712729 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6add718-3d0e-413d-af87-04d9b657a739 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:16:57.714153 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6add718-3d0e-413d-af87-04d9b657a739 service neutron] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:16:57.723707 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1317/2651] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 10:16:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:16:57.985919 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e42e6b4-f8aa-4610-8e67-0883b315027d None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:16:57.987393 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-0e42e6b4-f8aa-4610-8e67-0883b315027d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:16:58.001854 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e42e6b4-f8aa-4610-8e67-0883b315027d None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:16:58.006998 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095d8aec-818b-49ad-bc3f-2a7f38f4f457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:16:58.008165 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095d8aec-818b-49ad-bc3f-2a7f38f4f457 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:16:58.008451 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095d8aec-818b-49ad-bc3f-2a7f38f4f457 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:16:58.008729 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095d8aec-818b-49ad-bc3f-2a7f38f4f457 admin admin] PATH_INFO: `/v3/projects/bab1cf2fc90a4ca3a836c3406e5c804e` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:16:58.010704 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095d8aec-818b-49ad-bc3f-2a7f38f4f457 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bab1cf2fc90a4ca3a836c3406e5c804e)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:16:58.012601 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095d8aec-818b-49ad-bc3f-2a7f38f4f457 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:16:58.063154 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-095d8aec-818b-49ad-bc3f-2a7f38f4f457 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bab1cf2fc90a4ca3a836c3406e5c804e', 'request_id': 'req-095d8aec-818b-49ad-bc3f-2a7f38f4f457'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:16:58.069237 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-095d8aec-818b-49ad-bc3f-2a7f38f4f457 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bab1cf2fc90a4ca3a836c3406e5c804e', 'request_id': 'req-095d8aec-818b-49ad-bc3f-2a7f38f4f457'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:16:58.074715 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-095d8aec-818b-49ad-bc3f-2a7f38f4f457 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bab1cf2fc90a4ca3a836c3406e5c804e', 'request_id': 'req-095d8aec-818b-49ad-bc3f-2a7f38f4f457'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:16:58.086989 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-095d8aec-818b-49ad-bc3f-2a7f38f4f457 admin admin] The token cache is being invalidate because project bab1cf2fc90a4ca3a836c3406e5c804e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:16:58.087280 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-095d8aec-818b-49ad-bc3f-2a7f38f4f457 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:16:58.087892 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-095d8aec-818b-49ad-bc3f-2a7f38f4f457 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:16:58.089416 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1335/2652] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 14 10:16:57 2022] DELETE /identity/v3/projects/bab1cf2fc90a4ca3a836c3406e5c804e => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:17:07.719482 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=63,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:17:08.084031 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:17:20.928766 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6add718-3d0e-413d-af87-04d9b657a739 service neutron] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:17:20.930244 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-b6add718-3d0e-413d-af87-04d9b657a739 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:17:20.985847 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6add718-3d0e-413d-af87-04d9b657a739 service neutron] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:17:21.033923 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bf7eac-556e-4fa3-a921-1ff65656e828 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25048b29787d482783ebc944f1a7df65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:17:21.034612 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bf7eac-556e-4fa3-a921-1ff65656e828 service cinder] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:17:21.034899 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bf7eac-556e-4fa3-a921-1ff65656e828 service cinder] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:17:21.035180 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bf7eac-556e-4fa3-a921-1ff65656e828 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:17:21.036952 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-d8bf7eac-556e-4fa3-a921-1ff65656e828 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:17:21.131722 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bf7eac-556e-4fa3-a921-1ff65656e828 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:17:21.133205 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bf7eac-556e-4fa3-a921-1ff65656e828 service cinder] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:17:21.154768 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1318/2653] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 10:17:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:17:31.151508 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=81 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:17:47.524868 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095d8aec-818b-49ad-bc3f-2a7f38f4f457 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:17:47.526439 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-095d8aec-818b-49ad-bc3f-2a7f38f4f457 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:17:47.547576 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095d8aec-818b-49ad-bc3f-2a7f38f4f457 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:17:47.562387 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d57c5e3-05ad-4d78-b925-95e824af9fdf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f6962106dfa4c4c9af551053f8095e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:17:47.563223 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d57c5e3-05ad-4d78-b925-95e824af9fdf service nova] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:17:47.563517 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d57c5e3-05ad-4d78-b925-95e824af9fdf service nova] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:17:47.563903 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d57c5e3-05ad-4d78-b925-95e824af9fdf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:17:47.568172 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-4d57c5e3-05ad-4d78-b925-95e824af9fdf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:17:47.586117 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d57c5e3-05ad-4d78-b925-95e824af9fdf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:17:47.588495 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d57c5e3-05ad-4d78-b925-95e824af9fdf service nova] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:17:47.614427 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1336/2654] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 10:17:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:17:50.170025 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be045222-abaf-4791-97b1-c3c5fbed1667 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:17:50.170606 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be045222-abaf-4791-97b1-c3c5fbed1667 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:17:50.170606 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be045222-abaf-4791-97b1-c3c5fbed1667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:17:50.191364 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-be045222-abaf-4791-97b1-c3c5fbed1667 None None] MFA Rules not processed for user `1d7ae3d2f56a491baf26a83a34d86ccf`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:17:50.192578 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-be045222-abaf-4791-97b1-c3c5fbed1667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:17:50.250487 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1319/2655] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 10:17:50 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:17:50.567865 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d57c5e3-05ad-4d78-b925-95e824af9fdf service nova] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:17:50.569305 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-4d57c5e3-05ad-4d78-b925-95e824af9fdf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:17:50.613336 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be045222-abaf-4791-97b1-c3c5fbed1667 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:17:50.614546 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-be045222-abaf-4791-97b1-c3c5fbed1667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:17:50.626538 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d57c5e3-05ad-4d78-b925-95e824af9fdf service nova] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:17:50.630174 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682338c0-4619-441f-bc12-ab3c8b333193 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e4a5a8965e4802a9055d332179b7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:17:50.630846 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682338c0-4619-441f-bc12-ab3c8b333193 service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:17:50.631133 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682338c0-4619-441f-bc12-ab3c8b333193 service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:17:50.631418 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682338c0-4619-441f-bc12-ab3c8b333193 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:17:50.633180 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-682338c0-4619-441f-bc12-ab3c8b333193 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:17:50.643566 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682338c0-4619-441f-bc12-ab3c8b333193 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:17:50.645058 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682338c0-4619-441f-bc12-ab3c8b333193 service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:17:50.653575 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1337/2656] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 10:17:50 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:17:50.671964 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be045222-abaf-4791-97b1-c3c5fbed1667 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:17:50.675571 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5925ea8-813b-41f4-b6e8-dc6eb08d77d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e4a5a8965e4802a9055d332179b7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:17:50.676220 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5925ea8-813b-41f4-b6e8-dc6eb08d77d5 service neutron] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:17:50.676503 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5925ea8-813b-41f4-b6e8-dc6eb08d77d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:17:50.676775 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5925ea8-813b-41f4-b6e8-dc6eb08d77d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:17:50.678595 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-c5925ea8-813b-41f4-b6e8-dc6eb08d77d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:17:50.737065 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5925ea8-813b-41f4-b6e8-dc6eb08d77d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:17:50.738672 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5925ea8-813b-41f4-b6e8-dc6eb08d77d5 service neutron] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:17:50.748341 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1320/2657] 10.222.0.40 () {60 vars in 1396 bytes} [Thu Jul 14 10:17:50 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3242 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 10:17:50.982688 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682338c0-4619-441f-bc12-ab3c8b333193 service neutron] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:17:50.995847 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682338c0-4619-441f-bc12-ab3c8b333193 service neutron] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:17:51.002658 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed639a53-e0b1-4482-b9f9-dfd192e2a197 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f6962106dfa4c4c9af551053f8095e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:17:51.003800 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed639a53-e0b1-4482-b9f9-dfd192e2a197 service nova] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:17:51.004089 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed639a53-e0b1-4482-b9f9-dfd192e2a197 service nova] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:17:51.004462 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed639a53-e0b1-4482-b9f9-dfd192e2a197 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:17:51.005454 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5925ea8-813b-41f4-b6e8-dc6eb08d77d5 service neutron] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:17:51.006573 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-ed639a53-e0b1-4482-b9f9-dfd192e2a197 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:17:51.006807 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-c5925ea8-813b-41f4-b6e8-dc6eb08d77d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:17:51.018278 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed639a53-e0b1-4482-b9f9-dfd192e2a197 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:17:51.019902 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed639a53-e0b1-4482-b9f9-dfd192e2a197 service nova] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:17:51.029035 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1338/2658] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 10:17:50 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:17:51.071305 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:17:51.078053 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5925ea8-813b-41f4-b6e8-dc6eb08d77d5 service neutron] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:17:51.083172 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55b4370-c444-45bd-a171-d4139034e630 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc5a80144b84c609944a51a84fd5e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:17:51.083827 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55b4370-c444-45bd-a171-d4139034e630 service placement] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:17:51.084112 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55b4370-c444-45bd-a171-d4139034e630 service placement] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:17:51.084392 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55b4370-c444-45bd-a171-d4139034e630 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:17:51.086181 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-b55b4370-c444-45bd-a171-d4139034e630 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:17:51.098510 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55b4370-c444-45bd-a171-d4139034e630 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:17:51.100116 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55b4370-c444-45bd-a171-d4139034e630 service placement] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:17:51.110485 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1321/2659] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 10:17:51 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 10:17:57.439382 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed639a53-e0b1-4482-b9f9-dfd192e2a197 service nova] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:17:57.440763 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-ed639a53-e0b1-4482-b9f9-dfd192e2a197 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:17:57.452281 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed639a53-e0b1-4482-b9f9-dfd192e2a197 service nova] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:17:57.455835 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed946784-bb8e-4d76-b3c6-4ead47e86fc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e4a5a8965e4802a9055d332179b7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:17:57.456469 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed946784-bb8e-4d76-b3c6-4ead47e86fc5 service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:17:57.456789 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed946784-bb8e-4d76-b3c6-4ead47e86fc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:17:57.457187 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed946784-bb8e-4d76-b3c6-4ead47e86fc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:17:57.458864 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-ed946784-bb8e-4d76-b3c6-4ead47e86fc5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:17:57.520103 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed946784-bb8e-4d76-b3c6-4ead47e86fc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:17:57.521522 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed946784-bb8e-4d76-b3c6-4ead47e86fc5 service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:17:57.531380 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1339/2660] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 10:17:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:18:00.629856 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55b4370-c444-45bd-a171-d4139034e630 service placement] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:18:00.631403 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-b55b4370-c444-45bd-a171-d4139034e630 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:18:00.646675 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55b4370-c444-45bd-a171-d4139034e630 service placement] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:18:00.652423 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cc4041-69b8-4ece-ba34-163eb534c968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:18:00.653394 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cc4041-69b8-4ece-ba34-163eb534c968 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:18:00.653681 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cc4041-69b8-4ece-ba34-163eb534c968 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:18:00.653987 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cc4041-69b8-4ece-ba34-163eb534c968 admin admin] PATH_INFO: `/v3/users/688f473972144fb6b7a398c1f775a5c1` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:18:00.669708 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cc4041-69b8-4ece-ba34-163eb534c968 admin admin] RBAC: Authorizing `identity:delete_user(user_id=688f473972144fb6b7a398c1f775a5c1)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:18:00.672262 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cc4041-69b8-4ece-ba34-163eb534c968 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:18:00.723670 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-04cc4041-69b8-4ece-ba34-163eb534c968 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '688f473972144fb6b7a398c1f775a5c1'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:18:00.730342 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-04cc4041-69b8-4ece-ba34-163eb534c968 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '688f473972144fb6b7a398c1f775a5c1'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:18:00.731001 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-04cc4041-69b8-4ece-ba34-163eb534c968 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '688f473972144fb6b7a398c1f775a5c1'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:18:00.738497 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-04cc4041-69b8-4ece-ba34-163eb534c968 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '688f473972144fb6b7a398c1f775a5c1'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:18:00.739123 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-04cc4041-69b8-4ece-ba34-163eb534c968 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '688f473972144fb6b7a398c1f775a5c1'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:18:00.756027 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1322/2661] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 14 10:18:00 2022] DELETE /identity/v3/users/688f473972144fb6b7a398c1f775a5c1 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:18:00.930998 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed946784-bb8e-4d76-b3c6-4ead47e86fc5 service neutron] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:18:00.949044 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed946784-bb8e-4d76-b3c6-4ead47e86fc5 service neutron] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:18:01.009612 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbab270-ee61-4373-99c4-39f4c394f578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:18:01.010449 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbab270-ee61-4373-99c4-39f4c394f578 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:18:01.010740 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbab270-ee61-4373-99c4-39f4c394f578 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:18:01.011025 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbab270-ee61-4373-99c4-39f4c394f578 admin admin] PATH_INFO: `/v3/projects/140620648e604251bc9c5c1a0e9c483b` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:18:01.012237 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbab270-ee61-4373-99c4-39f4c394f578 admin admin] RBAC: Authorizing `identity:delete_project(project_id=140620648e604251bc9c5c1a0e9c483b)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:18:01.014157 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbab270-ee61-4373-99c4-39f4c394f578 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:18:01.027445 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=100 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:18:01.032311 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cc4041-69b8-4ece-ba34-163eb534c968 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:18:01.033838 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-04cc4041-69b8-4ece-ba34-163eb534c968 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:18:01.070803 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-3cbab270-ee61-4373-99c4-39f4c394f578 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '140620648e604251bc9c5c1a0e9c483b', 'request_id': 'req-3cbab270-ee61-4373-99c4-39f4c394f578'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:18:01.079001 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-3cbab270-ee61-4373-99c4-39f4c394f578 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '140620648e604251bc9c5c1a0e9c483b', 'request_id': 'req-3cbab270-ee61-4373-99c4-39f4c394f578'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:18:01.085814 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-3cbab270-ee61-4373-99c4-39f4c394f578 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '140620648e604251bc9c5c1a0e9c483b', 'request_id': 'req-3cbab270-ee61-4373-99c4-39f4c394f578'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:18:01.100707 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-3cbab270-ee61-4373-99c4-39f4c394f578 admin admin] The token cache is being invalidate because project 140620648e604251bc9c5c1a0e9c483b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:18:01.101004 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-3cbab270-ee61-4373-99c4-39f4c394f578 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:18:01.101799 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-3cbab270-ee61-4373-99c4-39f4c394f578 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:18:01.103438 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1340/2662] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 14 10:18:00 2022] DELETE /identity/v3/projects/140620648e604251bc9c5c1a0e9c483b => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:18:01.108385 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a21de92-efba-48de-9d03-a4b8245b398b None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:18:01.108751 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a21de92-efba-48de-9d03-a4b8245b398b None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:18:01.109064 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a21de92-efba-48de-9d03-a4b8245b398b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:18:01.122102 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cc4041-69b8-4ece-ba34-163eb534c968 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:18:01.126765 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-2a21de92-efba-48de-9d03-a4b8245b398b None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:18:01.127967 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-2a21de92-efba-48de-9d03-a4b8245b398b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:18:01.167712 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:18:01.188663 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1341/2663] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 10:18:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:18:01.189002 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0c95e8-ec94-445a-950b-3d9e2f601a1e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f6962106dfa4c4c9af551053f8095e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:18:01.189657 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0c95e8-ec94-445a-950b-3d9e2f601a1e service nova] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:18:01.189939 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0c95e8-ec94-445a-950b-3d9e2f601a1e service nova] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:18:01.190238 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0c95e8-ec94-445a-950b-3d9e2f601a1e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:18:01.191999 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-4a0c95e8-ec94-445a-950b-3d9e2f601a1e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:18:01.197128 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfba2cbe-2bda-4d9e-9e1d-abebe15d329b None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:18:01.197426 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfba2cbe-2bda-4d9e-9e1d-abebe15d329b None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:18:01.197711 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfba2cbe-2bda-4d9e-9e1d-abebe15d329b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:18:01.205380 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0c95e8-ec94-445a-950b-3d9e2f601a1e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:18:01.207006 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0c95e8-ec94-445a-950b-3d9e2f601a1e service nova] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:18:01.216397 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-bfba2cbe-2bda-4d9e-9e1d-abebe15d329b None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:18:01.217593 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-bfba2cbe-2bda-4d9e-9e1d-abebe15d329b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:18:01.217989 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1323/2664] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 10:18:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 10:18:01.226217 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1342/2665] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 10:18:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 10:18:01.230298 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0c95e8-ec94-445a-950b-3d9e2f601a1e service nova] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:18:01.240622 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0c95e8-ec94-445a-950b-3d9e2f601a1e service nova] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:18:01.245482 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd3d8a9-c649-4e72-9e94-d1db44045e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:18:01.246178 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd3d8a9-c649-4e72-9e94-d1db44045e49 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:18:01.246496 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd3d8a9-c649-4e72-9e94-d1db44045e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:18:01.246827 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd3d8a9-c649-4e72-9e94-d1db44045e49 admin admin] PATH_INFO: `/v3/domains` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:18:01.247567 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd3d8a9-c649-4e72-9e94-d1db44045e49 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:18:01.247896 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd3d8a9-c649-4e72-9e94-d1db44045e49 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:18:01.249573 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd3d8a9-c649-4e72-9e94-d1db44045e49 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:18:01.261654 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1324/2666] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jul 14 10:18:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:18:01.266410 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfba2cbe-2bda-4d9e-9e1d-abebe15d329b None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:18:01.275644 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfba2cbe-2bda-4d9e-9e1d-abebe15d329b None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:18:01.280326 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9dbc87-a468-4693-aa3a-ee98a6b3e779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:18:01.281563 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9dbc87-a468-4693-aa3a-ee98a6b3e779 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:18:01.281849 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9dbc87-a468-4693-aa3a-ee98a6b3e779 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:18:01.282131 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9dbc87-a468-4693-aa3a-ee98a6b3e779 admin admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:18:01.282862 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9dbc87-a468-4693-aa3a-ee98a6b3e779 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:18:01.284857 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9dbc87-a468-4693-aa3a-ee98a6b3e779 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:18:01.312449 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1343/2667] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 14 10:18:01 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:18:01.316456 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd3d8a9-c649-4e72-9e94-d1db44045e49 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:18:01.326551 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd3d8a9-c649-4e72-9e94-d1db44045e49 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:18:01.387905 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2fb511-79a2-4efc-b8ba-fe16323038d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:18:01.388563 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2fb511-79a2-4efc-b8ba-fe16323038d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:18:01.388845 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2fb511-79a2-4efc-b8ba-fe16323038d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:18:01.389120 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2fb511-79a2-4efc-b8ba-fe16323038d1 admin admin] PATH_INFO: `/v3/users` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:18:01.389822 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2fb511-79a2-4efc-b8ba-fe16323038d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:18:01.393152 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2fb511-79a2-4efc-b8ba-fe16323038d1 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:18:01.412931 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1325/2668] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 14 10:18:01 2022] POST /identity/v3/users => generated 287 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:18:01.417206 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9dbc87-a468-4693-aa3a-ee98a6b3e779 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:18:01.428176 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9dbc87-a468-4693-aa3a-ee98a6b3e779 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:18:01.432835 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4fac59-e942-4a4a-bd1b-02a4db94fad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:18:01.433503 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4fac59-e942-4a4a-bd1b-02a4db94fad7 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:18:01.433786 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4fac59-e942-4a4a-bd1b-02a4db94fad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:18:01.434063 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4fac59-e942-4a4a-bd1b-02a4db94fad7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:18:01.434828 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4fac59-e942-4a4a-bd1b-02a4db94fad7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:18:01.436693 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4fac59-e942-4a4a-bd1b-02a4db94fad7 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:18:01.449408 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1344/2669] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 10:18:01 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:18:01.454051 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2fb511-79a2-4efc-b8ba-fe16323038d1 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:18:01.465405 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2fb511-79a2-4efc-b8ba-fe16323038d1 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:18:01.470983 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98bf517-facd-41ca-996a-da09123ac559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:18:01.471661 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98bf517-facd-41ca-996a-da09123ac559 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:18:01.471948 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98bf517-facd-41ca-996a-da09123ac559 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:18:01.472227 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98bf517-facd-41ca-996a-da09123ac559 admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:18:01.472966 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98bf517-facd-41ca-996a-da09123ac559 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:18:01.474627 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98bf517-facd-41ca-996a-da09123ac559 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:18:01.485290 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1326/2670] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 10:18:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:18:01.489382 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4fac59-e942-4a4a-bd1b-02a4db94fad7 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:18:01.499302 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4fac59-e942-4a4a-bd1b-02a4db94fad7 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:18:01.504710 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5358cd7-c528-4890-824c-9163c1cc37da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:18:01.505591 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5358cd7-c528-4890-824c-9163c1cc37da admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:18:01.505876 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5358cd7-c528-4890-824c-9163c1cc37da admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:18:01.506152 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5358cd7-c528-4890-824c-9163c1cc37da admin admin] PATH_INFO: `/v3/projects/de331673cc274ed6b75f81dcf6e1ce33/users/0e3845b59b3b45e2b84bcd6cb274f49a/roles/17dfac38a2e540fea229af7de99911bb` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:18:01.521252 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5358cd7-c528-4890-824c-9163c1cc37da admin admin] RBAC: Authorizing `identity:create_grant(project_id=de331673cc274ed6b75f81dcf6e1ce33, user_id=0e3845b59b3b45e2b84bcd6cb274f49a, role_id=17dfac38a2e540fea229af7de99911bb)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:18:01.524132 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5358cd7-c528-4890-824c-9163c1cc37da admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:18:01.537086 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1345/2671] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 14 10:18:01 2022] PUT /identity/v3/projects/de331673cc274ed6b75f81dcf6e1ce33/users/0e3845b59b3b45e2b84bcd6cb274f49a/roles/17dfac38a2e540fea229af7de99911bb => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:18:01.546862 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58598b7b-61c5-4838-9564-799fc5ca5c5c None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:18:01.547154 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58598b7b-61c5-4838-9564-799fc5ca5c5c None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:18:01.547432 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58598b7b-61c5-4838-9564-799fc5ca5c5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:18:01.575055 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-58598b7b-61c5-4838-9564-799fc5ca5c5c None None] MFA Rules not processed for user `0e3845b59b3b45e2b84bcd6cb274f49a`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:18:01.576267 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-58598b7b-61c5-4838-9564-799fc5ca5c5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:18:01.641655 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1327/2672] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 10:18:01 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:18:01.646172 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5358cd7-c528-4890-824c-9163c1cc37da admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:18:01.688288 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:18:01.712857 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5358cd7-c528-4890-824c-9163c1cc37da admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:18:01.717465 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db00d0c0-6d31-4e74-bbc0-b19b9599811f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:18:01.718133 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db00d0c0-6d31-4e74-bbc0-b19b9599811f admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:18:01.718478 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db00d0c0-6d31-4e74-bbc0-b19b9599811f admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:18:01.718873 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db00d0c0-6d31-4e74-bbc0-b19b9599811f admin admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:18:01.719585 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db00d0c0-6d31-4e74-bbc0-b19b9599811f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:18:01.721477 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db00d0c0-6d31-4e74-bbc0-b19b9599811f admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:18:01.751232 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1346/2673] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 14 10:18:01 2022] POST /identity/v3/projects => generated 373 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:18:01.752483 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58598b7b-61c5-4838-9564-799fc5ca5c5c None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:18:01.763723 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58598b7b-61c5-4838-9564-799fc5ca5c5c None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:18:01.790150 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:18:01.821824 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544539fb-b202-4b97-81e1-e6737df5e37f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:18:01.822526 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544539fb-b202-4b97-81e1-e6737df5e37f admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:18:01.822814 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544539fb-b202-4b97-81e1-e6737df5e37f admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:18:01.823092 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544539fb-b202-4b97-81e1-e6737df5e37f admin admin] PATH_INFO: `/v3/users` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:18:01.823784 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544539fb-b202-4b97-81e1-e6737df5e37f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:18:01.825683 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544539fb-b202-4b97-81e1-e6737df5e37f admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:18:01.844713 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1328/2674] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 14 10:18:01 2022] POST /identity/v3/users => generated 293 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:18:01.848618 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db00d0c0-6d31-4e74-bbc0-b19b9599811f admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:18:01.863398 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db00d0c0-6d31-4e74-bbc0-b19b9599811f admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:18:01.868384 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33707cac-9008-4918-8ebd-490e3aa9132b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:18:01.869062 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33707cac-9008-4918-8ebd-490e3aa9132b admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:18:01.869352 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33707cac-9008-4918-8ebd-490e3aa9132b admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:18:01.869664 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33707cac-9008-4918-8ebd-490e3aa9132b admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:18:01.870442 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33707cac-9008-4918-8ebd-490e3aa9132b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:18:01.872051 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33707cac-9008-4918-8ebd-490e3aa9132b admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:18:01.883179 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1347/2675] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 10:18:01 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 10:18:01.887269 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544539fb-b202-4b97-81e1-e6737df5e37f admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:18:01.897142 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544539fb-b202-4b97-81e1-e6737df5e37f admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:18:01.901685 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14384e3a-33f1-4653-94f7-5d8e4fc7b0fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:18:01.902587 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14384e3a-33f1-4653-94f7-5d8e4fc7b0fc admin admin] REQUEST_METHOD: `PUT` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:18:01.902876 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14384e3a-33f1-4653-94f7-5d8e4fc7b0fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:18:01.903154 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14384e3a-33f1-4653-94f7-5d8e4fc7b0fc admin admin] PATH_INFO: `/v3/projects/c8915fb5d5cc4c988f834cf2eb5d2ff6/users/14fe16bc2f014c4ab66ac2487546e532/roles/e3965bd0d5f1427a86a313c0c90bfef3` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:18:01.917589 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14384e3a-33f1-4653-94f7-5d8e4fc7b0fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8915fb5d5cc4c988f834cf2eb5d2ff6, user_id=14fe16bc2f014c4ab66ac2487546e532, role_id=e3965bd0d5f1427a86a313c0c90bfef3)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:18:01.920240 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14384e3a-33f1-4653-94f7-5d8e4fc7b0fc admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:18:01.935947 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1329/2676] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 14 10:18:01 2022] PUT /identity/v3/projects/c8915fb5d5cc4c988f834cf2eb5d2ff6/users/14fe16bc2f014c4ab66ac2487546e532/roles/e3965bd0d5f1427a86a313c0c90bfef3 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:18:01.940842 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33707cac-9008-4918-8ebd-490e3aa9132b admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:18:01.951231 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33707cac-9008-4918-8ebd-490e3aa9132b admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:18:02.009321 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cbcfdd-248d-48ed-9bd9-a9eb8417a204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:18:02.010087 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cbcfdd-248d-48ed-9bd9-a9eb8417a204 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:18:02.010408 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cbcfdd-248d-48ed-9bd9-a9eb8417a204 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:18:02.010693 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cbcfdd-248d-48ed-9bd9-a9eb8417a204 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:18:02.011431 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cbcfdd-248d-48ed-9bd9-a9eb8417a204 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:18:02.013029 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cbcfdd-248d-48ed-9bd9-a9eb8417a204 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:18:02.022908 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1348/2677] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 10:18:01 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:18:02.027111 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14384e3a-33f1-4653-94f7-5d8e4fc7b0fc admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:18:02.037468 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14384e3a-33f1-4653-94f7-5d8e4fc7b0fc admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:18:02.042766 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d2ead1-c845-49c7-a741-a2e36c129d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:18:02.043561 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d2ead1-c845-49c7-a741-a2e36c129d30 admin admin] REQUEST_METHOD: `PUT` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:18:02.043843 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d2ead1-c845-49c7-a741-a2e36c129d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:18:02.044119 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d2ead1-c845-49c7-a741-a2e36c129d30 admin admin] PATH_INFO: `/v3/projects/c8915fb5d5cc4c988f834cf2eb5d2ff6/users/14fe16bc2f014c4ab66ac2487546e532/roles/e3965bd0d5f1427a86a313c0c90bfef3` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:18:02.047469 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d2ead1-c845-49c7-a741-a2e36c129d30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8915fb5d5cc4c988f834cf2eb5d2ff6, user_id=14fe16bc2f014c4ab66ac2487546e532, role_id=e3965bd0d5f1427a86a313c0c90bfef3)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:18:02.050564 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d2ead1-c845-49c7-a741-a2e36c129d30 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:18:02.061439 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1330/2678] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 14 10:18:02 2022] PUT /identity/v3/projects/c8915fb5d5cc4c988f834cf2eb5d2ff6/users/14fe16bc2f014c4ab66ac2487546e532/roles/e3965bd0d5f1427a86a313c0c90bfef3 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:18:02.073410 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377899a2-1a7a-47f6-b8ca-dbd73ab8b508 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:18:02.073708 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377899a2-1a7a-47f6-b8ca-dbd73ab8b508 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:18:02.073992 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377899a2-1a7a-47f6-b8ca-dbd73ab8b508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:18:02.100255 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-377899a2-1a7a-47f6-b8ca-dbd73ab8b508 None None] MFA Rules not processed for user `14fe16bc2f014c4ab66ac2487546e532`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:18:02.101477 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-377899a2-1a7a-47f6-b8ca-dbd73ab8b508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:18:02.167922 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1349/2679] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 10:18:02 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:18:02.179552 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d2ead1-c845-49c7-a741-a2e36c129d30 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:18:02.181245 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-66d2ead1-c845-49c7-a741-a2e36c129d30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:18:02.237824 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d2ead1-c845-49c7-a741-a2e36c129d30 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:18:02.241493 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eab4e5f-2579-4d8e-8c1b-1d69922c2915 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25048b29787d482783ebc944f1a7df65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:18:02.242131 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eab4e5f-2579-4d8e-8c1b-1d69922c2915 service cinder] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:18:02.242456 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eab4e5f-2579-4d8e-8c1b-1d69922c2915 service cinder] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:18:02.242736 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eab4e5f-2579-4d8e-8c1b-1d69922c2915 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:18:02.252042 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eab4e5f-2579-4d8e-8c1b-1d69922c2915 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:18:02.253466 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eab4e5f-2579-4d8e-8c1b-1d69922c2915 service cinder] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:18:02.262888 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1331/2680] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 10:18:02 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 10:18:02.330718 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377899a2-1a7a-47f6-b8ca-dbd73ab8b508 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:18:02.340264 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377899a2-1a7a-47f6-b8ca-dbd73ab8b508 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:18:02.344478 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a134ccda-ea75-456f-9230-5eede1f34cb8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25048b29787d482783ebc944f1a7df65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:18:02.345121 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a134ccda-ea75-456f-9230-5eede1f34cb8 service cinder] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:18:02.345435 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a134ccda-ea75-456f-9230-5eede1f34cb8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:18:02.345714 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a134ccda-ea75-456f-9230-5eede1f34cb8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:18:02.375690 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:18:02.402709 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a134ccda-ea75-456f-9230-5eede1f34cb8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:18:02.404143 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a134ccda-ea75-456f-9230-5eede1f34cb8 service cinder] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:18:02.413547 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1350/2681] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 10:18:02 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:18:12.258632 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=57,keystone:INSERT=5 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:18:12.409477 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=13 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:18:22.084645 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eab4e5f-2579-4d8e-8c1b-1d69922c2915 service cinder] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:18:22.086075 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-4eab4e5f-2579-4d8e-8c1b-1d69922c2915 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:18:22.198710 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eab4e5f-2579-4d8e-8c1b-1d69922c2915 service cinder] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:18:22.204375 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0cf841-e109-4b3c-838e-7b9a25283bc2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc5a80144b84c609944a51a84fd5e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:18:22.204946 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0cf841-e109-4b3c-838e-7b9a25283bc2 service placement] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:18:22.205230 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0cf841-e109-4b3c-838e-7b9a25283bc2 service placement] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:18:22.205508 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0cf841-e109-4b3c-838e-7b9a25283bc2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:18:22.207838 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-ab0cf841-e109-4b3c-838e-7b9a25283bc2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:18:22.219025 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0cf841-e109-4b3c-838e-7b9a25283bc2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:18:22.220579 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0cf841-e109-4b3c-838e-7b9a25283bc2 service placement] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:18:22.230791 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1332/2682] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 10:18:22 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:18:32.226728 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=50 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:18:50.598701 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a134ccda-ea75-456f-9230-5eede1f34cb8 service cinder] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:18:50.680382 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a134ccda-ea75-456f-9230-5eede1f34cb8 service cinder] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:18:50.690809 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7921ff62-0f7a-4871-8c50-09c20d76fae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:18:50.691621 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7921ff62-0f7a-4871-8c50-09c20d76fae9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:18:50.692524 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7921ff62-0f7a-4871-8c50-09c20d76fae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:18:50.692805 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7921ff62-0f7a-4871-8c50-09c20d76fae9 admin admin] PATH_INFO: `/v3/users/0e3845b59b3b45e2b84bcd6cb274f49a` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:18:50.694017 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7921ff62-0f7a-4871-8c50-09c20d76fae9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e3845b59b3b45e2b84bcd6cb274f49a)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:18:50.695958 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7921ff62-0f7a-4871-8c50-09c20d76fae9 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:18:50.743574 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-7921ff62-0f7a-4871-8c50-09c20d76fae9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e3845b59b3b45e2b84bcd6cb274f49a'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:18:50.755774 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-7921ff62-0f7a-4871-8c50-09c20d76fae9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e3845b59b3b45e2b84bcd6cb274f49a'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:18:50.756430 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-7921ff62-0f7a-4871-8c50-09c20d76fae9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e3845b59b3b45e2b84bcd6cb274f49a'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:18:50.763686 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-7921ff62-0f7a-4871-8c50-09c20d76fae9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e3845b59b3b45e2b84bcd6cb274f49a'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:18:50.771057 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-7921ff62-0f7a-4871-8c50-09c20d76fae9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e3845b59b3b45e2b84bcd6cb274f49a'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:18:50.776834 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1351/2683] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 14 10:18:50 2022] DELETE /identity/v3/users/0e3845b59b3b45e2b84bcd6cb274f49a => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:18:50.781279 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e390b7b-1971-4994-9077-4859a13d4ac8 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:18:50.781779 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e390b7b-1971-4994-9077-4859a13d4ac8 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:18:50.781899 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e390b7b-1971-4994-9077-4859a13d4ac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:18:50.798945 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-3e390b7b-1971-4994-9077-4859a13d4ac8 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:18:50.800154 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-3e390b7b-1971-4994-9077-4859a13d4ac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:18:50.858007 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1333/2684] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 10:18:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:18:50.867595 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7921ff62-0f7a-4871-8c50-09c20d76fae9 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:18:50.868985 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-7921ff62-0f7a-4871-8c50-09c20d76fae9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:18:50.925196 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7921ff62-0f7a-4871-8c50-09c20d76fae9 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:18:50.928833 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd71bce7-abea-407c-9c83-19ced191d888 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e4a5a8965e4802a9055d332179b7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:18:50.929475 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd71bce7-abea-407c-9c83-19ced191d888 service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:18:50.929763 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd71bce7-abea-407c-9c83-19ced191d888 service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:18:50.930044 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd71bce7-abea-407c-9c83-19ced191d888 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:18:50.939268 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd71bce7-abea-407c-9c83-19ced191d888 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:18:50.940695 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd71bce7-abea-407c-9c83-19ced191d888 service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:18:50.950726 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1352/2685] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 10:18:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 10:18:51.216598 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e390b7b-1971-4994-9077-4859a13d4ac8 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:18:51.218153 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-3e390b7b-1971-4994-9077-4859a13d4ac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:18:51.230064 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e390b7b-1971-4994-9077-4859a13d4ac8 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:18:51.234751 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c93810-045d-4ea1-b48f-94a68dbaa4f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:18:51.235622 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c93810-045d-4ea1-b48f-94a68dbaa4f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:18:51.235906 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c93810-045d-4ea1-b48f-94a68dbaa4f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:18:51.236185 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c93810-045d-4ea1-b48f-94a68dbaa4f8 admin admin] PATH_INFO: `/v3/projects/de331673cc274ed6b75f81dcf6e1ce33` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:18:51.237377 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c93810-045d-4ea1-b48f-94a68dbaa4f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de331673cc274ed6b75f81dcf6e1ce33)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:18:51.239844 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c93810-045d-4ea1-b48f-94a68dbaa4f8 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:18:51.287016 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-62c93810-045d-4ea1-b48f-94a68dbaa4f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de331673cc274ed6b75f81dcf6e1ce33', 'request_id': 'req-62c93810-045d-4ea1-b48f-94a68dbaa4f8'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:18:51.294952 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-62c93810-045d-4ea1-b48f-94a68dbaa4f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de331673cc274ed6b75f81dcf6e1ce33', 'request_id': 'req-62c93810-045d-4ea1-b48f-94a68dbaa4f8'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:18:51.301792 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-62c93810-045d-4ea1-b48f-94a68dbaa4f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de331673cc274ed6b75f81dcf6e1ce33', 'request_id': 'req-62c93810-045d-4ea1-b48f-94a68dbaa4f8'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:18:51.312862 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-62c93810-045d-4ea1-b48f-94a68dbaa4f8 admin admin] The token cache is being invalidate because project de331673cc274ed6b75f81dcf6e1ce33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:18:51.313149 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-62c93810-045d-4ea1-b48f-94a68dbaa4f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:18:51.314032 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-62c93810-045d-4ea1-b48f-94a68dbaa4f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:18:51.315702 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1334/2686] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 14 10:18:51 2022] DELETE /identity/v3/projects/de331673cc274ed6b75f81dcf6e1ce33 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:18:51.320433 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd71bce7-abea-407c-9c83-19ced191d888 service neutron] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:18:51.329785 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd71bce7-abea-407c-9c83-19ced191d888 service neutron] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:18:51.334281 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:18:51.387202 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d382d3f4-63f9-4b28-9604-0fae8062ecb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:18:51.388257 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d382d3f4-63f9-4b28-9604-0fae8062ecb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:18:51.388551 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d382d3f4-63f9-4b28-9604-0fae8062ecb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:18:51.388831 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d382d3f4-63f9-4b28-9604-0fae8062ecb7 admin admin] PATH_INFO: `/v3/users/14fe16bc2f014c4ab66ac2487546e532` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:18:51.390234 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d382d3f4-63f9-4b28-9604-0fae8062ecb7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=14fe16bc2f014c4ab66ac2487546e532)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:18:51.392152 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d382d3f4-63f9-4b28-9604-0fae8062ecb7 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:18:51.437070 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-d382d3f4-63f9-4b28-9604-0fae8062ecb7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14fe16bc2f014c4ab66ac2487546e532'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:18:51.449588 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-d382d3f4-63f9-4b28-9604-0fae8062ecb7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14fe16bc2f014c4ab66ac2487546e532'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:18:51.450265 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-d382d3f4-63f9-4b28-9604-0fae8062ecb7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14fe16bc2f014c4ab66ac2487546e532'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:18:51.457343 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-d382d3f4-63f9-4b28-9604-0fae8062ecb7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14fe16bc2f014c4ab66ac2487546e532'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:18:51.464762 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-d382d3f4-63f9-4b28-9604-0fae8062ecb7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14fe16bc2f014c4ab66ac2487546e532'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:18:51.471133 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1353/2687] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 14 10:18:51 2022] DELETE /identity/v3/users/14fe16bc2f014c4ab66ac2487546e532 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:18:51.737821 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c93810-045d-4ea1-b48f-94a68dbaa4f8 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:18:51.740237 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-62c93810-045d-4ea1-b48f-94a68dbaa4f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:18:51.753202 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c93810-045d-4ea1-b48f-94a68dbaa4f8 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:18:51.810784 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0c6e63-0a4e-4ab7-b4a0-19a16cb98402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:18:51.811658 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0c6e63-0a4e-4ab7-b4a0-19a16cb98402 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:18:51.811965 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0c6e63-0a4e-4ab7-b4a0-19a16cb98402 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:18:51.812224 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0c6e63-0a4e-4ab7-b4a0-19a16cb98402 admin admin] PATH_INFO: `/v3/projects/c8915fb5d5cc4c988f834cf2eb5d2ff6` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:18:51.813669 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0c6e63-0a4e-4ab7-b4a0-19a16cb98402 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8915fb5d5cc4c988f834cf2eb5d2ff6)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:18:51.815605 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0c6e63-0a4e-4ab7-b4a0-19a16cb98402 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:18:51.844083 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:18:51.861690 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-df0c6e63-0a4e-4ab7-b4a0-19a16cb98402 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8915fb5d5cc4c988f834cf2eb5d2ff6', 'request_id': 'req-df0c6e63-0a4e-4ab7-b4a0-19a16cb98402'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:18:51.869046 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-df0c6e63-0a4e-4ab7-b4a0-19a16cb98402 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8915fb5d5cc4c988f834cf2eb5d2ff6', 'request_id': 'req-df0c6e63-0a4e-4ab7-b4a0-19a16cb98402'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:18:51.874768 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-df0c6e63-0a4e-4ab7-b4a0-19a16cb98402 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8915fb5d5cc4c988f834cf2eb5d2ff6', 'request_id': 'req-df0c6e63-0a4e-4ab7-b4a0-19a16cb98402'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:18:51.885467 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-df0c6e63-0a4e-4ab7-b4a0-19a16cb98402 admin admin] The token cache is being invalidate because project c8915fb5d5cc4c988f834cf2eb5d2ff6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:18:51.885762 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-df0c6e63-0a4e-4ab7-b4a0-19a16cb98402 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:18:51.886436 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-df0c6e63-0a4e-4ab7-b4a0-19a16cb98402 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:18:51.887964 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1335/2688] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 14 10:18:51 2022] DELETE /identity/v3/projects/c8915fb5d5cc4c988f834cf2eb5d2ff6 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:18:51.892809 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f38748f-0149-4760-a061-12e81c86ccb0 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:18:51.893311 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f38748f-0149-4760-a061-12e81c86ccb0 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:18:51.893420 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f38748f-0149-4760-a061-12e81c86ccb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:18:51.911601 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-5f38748f-0149-4760-a061-12e81c86ccb0 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:18:51.912807 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-5f38748f-0149-4760-a061-12e81c86ccb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:18:51.969975 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1354/2689] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 10:18:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:18:51.978243 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d2a34e-072d-46a2-ac5a-d07addd38077 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:18:51.978539 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d2a34e-072d-46a2-ac5a-d07addd38077 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:18:51.978820 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d2a34e-072d-46a2-ac5a-d07addd38077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:18:51.996649 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-02d2a34e-072d-46a2-ac5a-d07addd38077 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:18:51.997781 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-02d2a34e-072d-46a2-ac5a-d07addd38077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:18:52.005608 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1336/2690] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 10:18:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:18:52.009634 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f38748f-0149-4760-a061-12e81c86ccb0 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:18:52.019431 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f38748f-0149-4760-a061-12e81c86ccb0 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:18:52.024489 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca99aba4-c01d-45a9-be1e-dc697ee771c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:18:52.025140 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca99aba4-c01d-45a9-be1e-dc697ee771c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:18:52.025454 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca99aba4-c01d-45a9-be1e-dc697ee771c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:18:52.025732 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca99aba4-c01d-45a9-be1e-dc697ee771c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:18:52.026759 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca99aba4-c01d-45a9-be1e-dc697ee771c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:18:52.027072 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca99aba4-c01d-45a9-be1e-dc697ee771c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:18:52.029208 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca99aba4-c01d-45a9-be1e-dc697ee771c5 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:18:52.043540 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1355/2691] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jul 14 10:18:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:18:52.048662 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d2a34e-072d-46a2-ac5a-d07addd38077 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:18:52.059361 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d2a34e-072d-46a2-ac5a-d07addd38077 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:18:52.064605 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a0392c-8b37-40f0-abb5-ae45e472dd30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:18:52.065276 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a0392c-8b37-40f0-abb5-ae45e472dd30 admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:18:52.065562 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a0392c-8b37-40f0-abb5-ae45e472dd30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:18:52.065841 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a0392c-8b37-40f0-abb5-ae45e472dd30 admin admin] PATH_INFO: `/v3/projects` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:18:52.066588 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a0392c-8b37-40f0-abb5-ae45e472dd30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:18:52.068667 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a0392c-8b37-40f0-abb5-ae45e472dd30 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:18:52.096625 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1337/2692] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 14 10:18:52 2022] POST /identity/v3/projects => generated 381 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 10:18:52.099324 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca99aba4-c01d-45a9-be1e-dc697ee771c5 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:18:52.109179 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca99aba4-c01d-45a9-be1e-dc697ee771c5 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:18:52.120420 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:18:52.166878 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da6543c-c74d-4fc0-9c92-78cdab4c3104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:18:52.167545 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da6543c-c74d-4fc0-9c92-78cdab4c3104 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:18:52.167833 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da6543c-c74d-4fc0-9c92-78cdab4c3104 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:18:52.168134 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da6543c-c74d-4fc0-9c92-78cdab4c3104 admin admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:18:52.168830 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da6543c-c74d-4fc0-9c92-78cdab4c3104 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:18:52.170796 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da6543c-c74d-4fc0-9c92-78cdab4c3104 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:18:52.189868 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1356/2693] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 14 10:18:52 2022] POST /identity/v3/users => generated 291 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 10:18:52.193895 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a0392c-8b37-40f0-abb5-ae45e472dd30 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:18:52.204186 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a0392c-8b37-40f0-abb5-ae45e472dd30 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:18:52.209360 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006542a3-b88d-4e30-b9d2-882a5682a57a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:18:52.210016 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006542a3-b88d-4e30-b9d2-882a5682a57a admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:18:52.210344 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006542a3-b88d-4e30-b9d2-882a5682a57a admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:18:52.210628 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006542a3-b88d-4e30-b9d2-882a5682a57a admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:18:52.211395 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006542a3-b88d-4e30-b9d2-882a5682a57a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:18:52.213012 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006542a3-b88d-4e30-b9d2-882a5682a57a admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:18:52.224129 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1338/2694] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 10:18:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:18:52.227865 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da6543c-c74d-4fc0-9c92-78cdab4c3104 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:18:52.237858 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da6543c-c74d-4fc0-9c92-78cdab4c3104 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:18:52.242672 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f96051f-1ee1-4fe0-926f-20d1448bb5ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:18:52.243352 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f96051f-1ee1-4fe0-926f-20d1448bb5ac admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:18:52.243639 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f96051f-1ee1-4fe0-926f-20d1448bb5ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:18:52.243917 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f96051f-1ee1-4fe0-926f-20d1448bb5ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:18:52.244639 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f96051f-1ee1-4fe0-926f-20d1448bb5ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:18:52.246242 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f96051f-1ee1-4fe0-926f-20d1448bb5ac admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:18:52.256764 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1357/2695] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 10:18:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:18:52.260599 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006542a3-b88d-4e30-b9d2-882a5682a57a admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:18:52.270818 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006542a3-b88d-4e30-b9d2-882a5682a57a admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:18:52.275594 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31291f09-6dd6-4f26-b75c-be15d9e0ada3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:18:52.276472 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31291f09-6dd6-4f26-b75c-be15d9e0ada3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:18:52.276754 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31291f09-6dd6-4f26-b75c-be15d9e0ada3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:18:52.277033 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31291f09-6dd6-4f26-b75c-be15d9e0ada3 admin admin] PATH_INFO: `/v3/projects/3e7652954a6845e584f75c1ea1311e2b/users/0e9c25cfcb024e94a86605bf058425bd/roles/17dfac38a2e540fea229af7de99911bb` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:18:52.291352 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31291f09-6dd6-4f26-b75c-be15d9e0ada3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e7652954a6845e584f75c1ea1311e2b, user_id=0e9c25cfcb024e94a86605bf058425bd, role_id=17dfac38a2e540fea229af7de99911bb)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:18:52.293958 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31291f09-6dd6-4f26-b75c-be15d9e0ada3 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:18:52.306520 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1339/2696] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 14 10:18:52 2022] PUT /identity/v3/projects/3e7652954a6845e584f75c1ea1311e2b/users/0e9c25cfcb024e94a86605bf058425bd/roles/17dfac38a2e540fea229af7de99911bb => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:18:52.318443 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca217c0-f4d6-4a08-9b53-354cb8694937 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:18:52.318740 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca217c0-f4d6-4a08-9b53-354cb8694937 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:18:52.319024 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca217c0-f4d6-4a08-9b53-354cb8694937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:18:52.345326 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-7ca217c0-f4d6-4a08-9b53-354cb8694937 None None] MFA Rules not processed for user `0e9c25cfcb024e94a86605bf058425bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:18:52.346613 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-7ca217c0-f4d6-4a08-9b53-354cb8694937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:18:52.410737 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1358/2697] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 10:18:52 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:18:52.415447 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31291f09-6dd6-4f26-b75c-be15d9e0ada3 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:18:52.476893 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31291f09-6dd6-4f26-b75c-be15d9e0ada3 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:18:52.481554 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d770f83-c094-4bf9-aa88-027325780cda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:18:52.482234 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d770f83-c094-4bf9-aa88-027325780cda admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:18:52.482527 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d770f83-c094-4bf9-aa88-027325780cda admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:18:52.482806 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d770f83-c094-4bf9-aa88-027325780cda admin admin] PATH_INFO: `/v3/projects` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:18:52.483496 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d770f83-c094-4bf9-aa88-027325780cda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:18:52.485387 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d770f83-c094-4bf9-aa88-027325780cda admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:18:52.510044 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1340/2698] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 14 10:18:52 2022] POST /identity/v3/projects => generated 381 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:18:52.514081 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca217c0-f4d6-4a08-9b53-354cb8694937 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:18:52.525663 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca217c0-f4d6-4a08-9b53-354cb8694937 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:18:52.581341 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548d32cc-5cf2-4ced-a7d7-dcb67371d0fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:18:52.582017 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548d32cc-5cf2-4ced-a7d7-dcb67371d0fa admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:18:52.582343 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548d32cc-5cf2-4ced-a7d7-dcb67371d0fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:18:52.583245 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548d32cc-5cf2-4ced-a7d7-dcb67371d0fa admin admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:18:52.583951 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548d32cc-5cf2-4ced-a7d7-dcb67371d0fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:18:52.585869 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548d32cc-5cf2-4ced-a7d7-dcb67371d0fa admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:18:52.605719 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1359/2699] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 14 10:18:52 2022] POST /identity/v3/users => generated 297 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:18:52.609748 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d770f83-c094-4bf9-aa88-027325780cda admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:18:52.620569 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d770f83-c094-4bf9-aa88-027325780cda admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:18:52.625455 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2297bda-87ed-4edd-a04c-278cfdbaa2f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:18:52.626111 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2297bda-87ed-4edd-a04c-278cfdbaa2f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:18:52.626428 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2297bda-87ed-4edd-a04c-278cfdbaa2f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:18:52.626716 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2297bda-87ed-4edd-a04c-278cfdbaa2f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:18:52.627482 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2297bda-87ed-4edd-a04c-278cfdbaa2f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:18:52.629113 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2297bda-87ed-4edd-a04c-278cfdbaa2f2 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:18:52.647273 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1341/2700] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 10:18:52 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:18:52.651625 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548d32cc-5cf2-4ced-a7d7-dcb67371d0fa admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:18:52.661587 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548d32cc-5cf2-4ced-a7d7-dcb67371d0fa admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:18:52.666140 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37013e4d-8f05-4281-899d-04627cddc70b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:18:52.667041 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37013e4d-8f05-4281-899d-04627cddc70b admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:18:52.667321 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37013e4d-8f05-4281-899d-04627cddc70b admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:18:52.667598 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37013e4d-8f05-4281-899d-04627cddc70b admin admin] PATH_INFO: `/v3/projects/a8b2d200b03246539221b142479376f1/users/55db9759aa8e4e0ba439ef5278848cc3/roles/e3965bd0d5f1427a86a313c0c90bfef3` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:18:52.679457 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:18:52.684159 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37013e4d-8f05-4281-899d-04627cddc70b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8b2d200b03246539221b142479376f1, user_id=55db9759aa8e4e0ba439ef5278848cc3, role_id=e3965bd0d5f1427a86a313c0c90bfef3)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:18:52.687372 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37013e4d-8f05-4281-899d-04627cddc70b admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:18:52.700680 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1360/2701] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 14 10:18:52 2022] PUT /identity/v3/projects/a8b2d200b03246539221b142479376f1/users/55db9759aa8e4e0ba439ef5278848cc3/roles/e3965bd0d5f1427a86a313c0c90bfef3 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:18:52.704645 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2297bda-87ed-4edd-a04c-278cfdbaa2f2 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:18:52.714821 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2297bda-87ed-4edd-a04c-278cfdbaa2f2 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:18:52.734542 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:18:52.773995 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a287027d-638f-409a-90ec-284a17ab9c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:18:52.774607 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a287027d-638f-409a-90ec-284a17ab9c99 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:18:52.774889 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a287027d-638f-409a-90ec-284a17ab9c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:18:52.775164 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a287027d-638f-409a-90ec-284a17ab9c99 admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:18:52.775889 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a287027d-638f-409a-90ec-284a17ab9c99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:18:52.777468 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a287027d-638f-409a-90ec-284a17ab9c99 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:18:52.787426 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1342/2702] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 10:18:52 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:18:52.791599 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37013e4d-8f05-4281-899d-04627cddc70b admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:18:52.802365 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37013e4d-8f05-4281-899d-04627cddc70b admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:18:52.806834 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e88553-6f67-43b5-a984-ff5c014cc60f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:18:52.807711 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e88553-6f67-43b5-a984-ff5c014cc60f admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:18:52.808156 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e88553-6f67-43b5-a984-ff5c014cc60f admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:18:52.808449 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e88553-6f67-43b5-a984-ff5c014cc60f admin admin] PATH_INFO: `/v3/projects/a8b2d200b03246539221b142479376f1/users/55db9759aa8e4e0ba439ef5278848cc3/roles/e3965bd0d5f1427a86a313c0c90bfef3` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:18:52.810451 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e88553-6f67-43b5-a984-ff5c014cc60f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8b2d200b03246539221b142479376f1, user_id=55db9759aa8e4e0ba439ef5278848cc3, role_id=e3965bd0d5f1427a86a313c0c90bfef3)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:18:52.813048 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e88553-6f67-43b5-a984-ff5c014cc60f admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:18:52.824384 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1361/2703] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 14 10:18:52 2022] PUT /identity/v3/projects/a8b2d200b03246539221b142479376f1/users/55db9759aa8e4e0ba439ef5278848cc3/roles/e3965bd0d5f1427a86a313c0c90bfef3 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:18:52.834064 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2df1cc-a021-4317-bafd-ab8b4da533e6 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:18:52.834576 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2df1cc-a021-4317-bafd-ab8b4da533e6 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:18:52.834683 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2df1cc-a021-4317-bafd-ab8b4da533e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:18:52.860239 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-da2df1cc-a021-4317-bafd-ab8b4da533e6 None None] MFA Rules not processed for user `55db9759aa8e4e0ba439ef5278848cc3`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:18:52.861446 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-da2df1cc-a021-4317-bafd-ab8b4da533e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:18:52.927877 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1343/2704] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 10:18:52 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 10:18:52.938846 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e88553-6f67-43b5-a984-ff5c014cc60f admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:18:52.940784 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-32e88553-6f67-43b5-a984-ff5c014cc60f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:18:52.997557 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e88553-6f67-43b5-a984-ff5c014cc60f admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:18:53.001188 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f177e2fa-ba11-4b0f-8590-add815ed3d2f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25048b29787d482783ebc944f1a7df65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:18:53.001819 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f177e2fa-ba11-4b0f-8590-add815ed3d2f service cinder] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:18:53.002104 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f177e2fa-ba11-4b0f-8590-add815ed3d2f service cinder] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:18:53.002411 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f177e2fa-ba11-4b0f-8590-add815ed3d2f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:18:53.011991 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f177e2fa-ba11-4b0f-8590-add815ed3d2f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:18:53.013416 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f177e2fa-ba11-4b0f-8590-add815ed3d2f service cinder] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:18:53.023409 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1362/2705] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 10:18:52 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:18:53.119026 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2df1cc-a021-4317-bafd-ab8b4da533e6 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:18:53.128581 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2df1cc-a021-4317-bafd-ab8b4da533e6 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:18:53.132135 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da853b55-459f-4950-a854-c9feadb9b895 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25048b29787d482783ebc944f1a7df65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:18:53.132778 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da853b55-459f-4950-a854-c9feadb9b895 service cinder] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:18:53.133064 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da853b55-459f-4950-a854-c9feadb9b895 service cinder] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:18:53.133342 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da853b55-459f-4950-a854-c9feadb9b895 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:18:53.189282 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da853b55-459f-4950-a854-c9feadb9b895 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:18:53.190755 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da853b55-459f-4950-a854-c9feadb9b895 service cinder] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:18:53.199642 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1344/2706] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 10:18:53 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:18:55.757300 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f177e2fa-ba11-4b0f-8590-add815ed3d2f service cinder] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:18:55.819168 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f177e2fa-ba11-4b0f-8590-add815ed3d2f service cinder] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:18:55.823657 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abcfadf-5bc0-49c0-9c07-8b25e0a3a19a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:18:55.824529 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abcfadf-5bc0-49c0-9c07-8b25e0a3a19a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:18:55.824821 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abcfadf-5bc0-49c0-9c07-8b25e0a3a19a admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:18:55.825103 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abcfadf-5bc0-49c0-9c07-8b25e0a3a19a admin admin] PATH_INFO: `/v3/users/0e9c25cfcb024e94a86605bf058425bd` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:18:55.826325 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abcfadf-5bc0-49c0-9c07-8b25e0a3a19a admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e9c25cfcb024e94a86605bf058425bd)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:18:55.828275 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abcfadf-5bc0-49c0-9c07-8b25e0a3a19a admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:18:55.874972 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-8abcfadf-5bc0-49c0-9c07-8b25e0a3a19a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e9c25cfcb024e94a86605bf058425bd'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:18:55.886405 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-8abcfadf-5bc0-49c0-9c07-8b25e0a3a19a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e9c25cfcb024e94a86605bf058425bd'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:18:55.887058 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-8abcfadf-5bc0-49c0-9c07-8b25e0a3a19a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e9c25cfcb024e94a86605bf058425bd'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:18:55.894016 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-8abcfadf-5bc0-49c0-9c07-8b25e0a3a19a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e9c25cfcb024e94a86605bf058425bd'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:18:55.900996 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-8abcfadf-5bc0-49c0-9c07-8b25e0a3a19a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e9c25cfcb024e94a86605bf058425bd'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:18:55.902430 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:18:55.908039 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1363/2707] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 14 10:18:55 2022] DELETE /identity/v3/users/0e9c25cfcb024e94a86605bf058425bd => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:18:55.913112 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef0bff6-cdcb-42ed-81fa-8bb8eb84d034 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:18:55.913635 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef0bff6-cdcb-42ed-81fa-8bb8eb84d034 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:18:55.913753 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef0bff6-cdcb-42ed-81fa-8bb8eb84d034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:18:55.931224 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-0ef0bff6-cdcb-42ed-81fa-8bb8eb84d034 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:18:55.932421 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-0ef0bff6-cdcb-42ed-81fa-8bb8eb84d034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:18:55.973686 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:18:55.993395 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1345/2708] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 10:18:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:18:56.002937 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abcfadf-5bc0-49c0-9c07-8b25e0a3a19a admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:18:56.004327 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-8abcfadf-5bc0-49c0-9c07-8b25e0a3a19a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:18:56.060578 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abcfadf-5bc0-49c0-9c07-8b25e0a3a19a admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:18:56.064475 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2c6286-754c-4767-8d64-21a0a4cdaf7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e4a5a8965e4802a9055d332179b7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:18:56.065116 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2c6286-754c-4767-8d64-21a0a4cdaf7e service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:18:56.065405 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2c6286-754c-4767-8d64-21a0a4cdaf7e service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:18:56.065689 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2c6286-754c-4767-8d64-21a0a4cdaf7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:18:56.074646 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2c6286-754c-4767-8d64-21a0a4cdaf7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:18:56.075998 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2c6286-754c-4767-8d64-21a0a4cdaf7e service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:18:56.085814 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1364/2709] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 10:18:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:18:56.345904 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef0bff6-cdcb-42ed-81fa-8bb8eb84d034 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:18:56.347433 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-0ef0bff6-cdcb-42ed-81fa-8bb8eb84d034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:18:56.360557 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef0bff6-cdcb-42ed-81fa-8bb8eb84d034 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:18:56.365471 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81215b1-533e-4c46-a875-4de38704364d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:18:56.366393 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81215b1-533e-4c46-a875-4de38704364d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:18:56.366684 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81215b1-533e-4c46-a875-4de38704364d admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:18:56.366997 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81215b1-533e-4c46-a875-4de38704364d admin admin] PATH_INFO: `/v3/projects/3e7652954a6845e584f75c1ea1311e2b` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:18:56.368212 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81215b1-533e-4c46-a875-4de38704364d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e7652954a6845e584f75c1ea1311e2b)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:18:56.370131 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81215b1-533e-4c46-a875-4de38704364d admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:18:56.415933 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-a81215b1-533e-4c46-a875-4de38704364d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e7652954a6845e584f75c1ea1311e2b', 'request_id': 'req-a81215b1-533e-4c46-a875-4de38704364d'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:18:56.422937 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-a81215b1-533e-4c46-a875-4de38704364d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e7652954a6845e584f75c1ea1311e2b', 'request_id': 'req-a81215b1-533e-4c46-a875-4de38704364d'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:18:56.428519 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-a81215b1-533e-4c46-a875-4de38704364d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e7652954a6845e584f75c1ea1311e2b', 'request_id': 'req-a81215b1-533e-4c46-a875-4de38704364d'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:18:56.439596 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-a81215b1-533e-4c46-a875-4de38704364d admin admin] The token cache is being invalidate because project 3e7652954a6845e584f75c1ea1311e2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:18:56.439881 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-a81215b1-533e-4c46-a875-4de38704364d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:18:56.440502 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-a81215b1-533e-4c46-a875-4de38704364d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:18:56.442534 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1346/2710] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 14 10:18:56 2022] DELETE /identity/v3/projects/3e7652954a6845e584f75c1ea1311e2b => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:18:56.446503 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2c6286-754c-4767-8d64-21a0a4cdaf7e service neutron] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:18:56.456239 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2c6286-754c-4767-8d64-21a0a4cdaf7e service neutron] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:18:56.512078 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87e2c52-2f25-4254-9178-858431735f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:18:56.512963 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87e2c52-2f25-4254-9178-858431735f1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:18:56.513252 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87e2c52-2f25-4254-9178-858431735f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:18:56.513536 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87e2c52-2f25-4254-9178-858431735f1e admin admin] PATH_INFO: `/v3/users/55db9759aa8e4e0ba439ef5278848cc3` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:18:56.514772 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87e2c52-2f25-4254-9178-858431735f1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=55db9759aa8e4e0ba439ef5278848cc3)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:18:56.516725 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87e2c52-2f25-4254-9178-858431735f1e admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:18:56.560749 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-f87e2c52-2f25-4254-9178-858431735f1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55db9759aa8e4e0ba439ef5278848cc3'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:18:56.573114 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-f87e2c52-2f25-4254-9178-858431735f1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55db9759aa8e4e0ba439ef5278848cc3'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:18:56.573767 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-f87e2c52-2f25-4254-9178-858431735f1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55db9759aa8e4e0ba439ef5278848cc3'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:18:56.580297 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-f87e2c52-2f25-4254-9178-858431735f1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55db9759aa8e4e0ba439ef5278848cc3'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:18:56.587813 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-f87e2c52-2f25-4254-9178-858431735f1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55db9759aa8e4e0ba439ef5278848cc3'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:18:56.593669 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1365/2711] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 14 10:18:56 2022] DELETE /identity/v3/users/55db9759aa8e4e0ba439ef5278848cc3 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:18:56.855135 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81215b1-533e-4c46-a875-4de38704364d admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:18:56.856622 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-a81215b1-533e-4c46-a875-4de38704364d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:18:56.870259 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81215b1-533e-4c46-a875-4de38704364d admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:18:56.926901 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259b2200-f258-4354-abd5-64b85b46f7dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:18:56.927773 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259b2200-f258-4354-abd5-64b85b46f7dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:18:56.928058 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259b2200-f258-4354-abd5-64b85b46f7dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:18:56.928334 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259b2200-f258-4354-abd5-64b85b46f7dc admin admin] PATH_INFO: `/v3/projects/a8b2d200b03246539221b142479376f1` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:18:56.929518 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259b2200-f258-4354-abd5-64b85b46f7dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8b2d200b03246539221b142479376f1)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:18:56.931456 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259b2200-f258-4354-abd5-64b85b46f7dc admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:18:56.977047 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-259b2200-f258-4354-abd5-64b85b46f7dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8b2d200b03246539221b142479376f1', 'request_id': 'req-259b2200-f258-4354-abd5-64b85b46f7dc'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:18:56.984076 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-259b2200-f258-4354-abd5-64b85b46f7dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8b2d200b03246539221b142479376f1', 'request_id': 'req-259b2200-f258-4354-abd5-64b85b46f7dc'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:18:56.990131 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-259b2200-f258-4354-abd5-64b85b46f7dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8b2d200b03246539221b142479376f1', 'request_id': 'req-259b2200-f258-4354-abd5-64b85b46f7dc'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:18:56.996932 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:18:57.001894 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-259b2200-f258-4354-abd5-64b85b46f7dc admin admin] The token cache is being invalidate because project a8b2d200b03246539221b142479376f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:18:57.002483 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-259b2200-f258-4354-abd5-64b85b46f7dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:18:57.003544 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-259b2200-f258-4354-abd5-64b85b46f7dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:18:57.005751 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1347/2712] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 14 10:18:56 2022] DELETE /identity/v3/projects/a8b2d200b03246539221b142479376f1 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:18:57.010770 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a23bd70-a6f5-4601-b357-4f468b2d56e3 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:18:57.011255 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a23bd70-a6f5-4601-b357-4f468b2d56e3 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:18:57.011362 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a23bd70-a6f5-4601-b357-4f468b2d56e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:18:57.029200 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-1a23bd70-a6f5-4601-b357-4f468b2d56e3 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:18:57.030434 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-1a23bd70-a6f5-4601-b357-4f468b2d56e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:18:57.042849 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:18:57.090482 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1366/2713] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 10:18:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:18:57.098389 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb6a4d7-a3fa-4638-b533-4871ad52eda7 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:18:57.098622 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb6a4d7-a3fa-4638-b533-4871ad52eda7 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:18:57.098911 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb6a4d7-a3fa-4638-b533-4871ad52eda7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:18:57.118354 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-5cb6a4d7-a3fa-4638-b533-4871ad52eda7 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:18:57.119562 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-5cb6a4d7-a3fa-4638-b533-4871ad52eda7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:18:57.127513 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1348/2714] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 10:18:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:18:57.132215 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a23bd70-a6f5-4601-b357-4f468b2d56e3 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:18:57.141816 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a23bd70-a6f5-4601-b357-4f468b2d56e3 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:18:57.146346 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cf700b-a100-4613-8afa-334de704f5f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:18:57.147000 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cf700b-a100-4613-8afa-334de704f5f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:18:57.147284 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cf700b-a100-4613-8afa-334de704f5f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:18:57.147560 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cf700b-a100-4613-8afa-334de704f5f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:18:57.148281 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cf700b-a100-4613-8afa-334de704f5f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:18:57.148587 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cf700b-a100-4613-8afa-334de704f5f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:18:57.150222 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cf700b-a100-4613-8afa-334de704f5f5 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:18:57.161786 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1367/2715] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jul 14 10:18:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:18:57.165782 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb6a4d7-a3fa-4638-b533-4871ad52eda7 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:18:57.174958 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb6a4d7-a3fa-4638-b533-4871ad52eda7 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:18:57.180135 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22a21f0-93aa-4084-813a-2651a2e3d366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:18:57.180785 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22a21f0-93aa-4084-813a-2651a2e3d366 admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:18:57.181075 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22a21f0-93aa-4084-813a-2651a2e3d366 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:18:57.181355 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22a21f0-93aa-4084-813a-2651a2e3d366 admin admin] PATH_INFO: `/v3/projects` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:18:57.182045 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22a21f0-93aa-4084-813a-2651a2e3d366 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:18:57.183971 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22a21f0-93aa-4084-813a-2651a2e3d366 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:18:57.209165 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1349/2716] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 14 10:18:57 2022] POST /identity/v3/projects => generated 379 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:18:57.213151 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cf700b-a100-4613-8afa-334de704f5f5 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:18:57.223727 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cf700b-a100-4613-8afa-334de704f5f5 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:18:57.278079 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2e72bd-b22d-498a-a667-6d9f6fd87784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:18:57.278773 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2e72bd-b22d-498a-a667-6d9f6fd87784 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:18:57.279062 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2e72bd-b22d-498a-a667-6d9f6fd87784 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:18:57.279340 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2e72bd-b22d-498a-a667-6d9f6fd87784 admin admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:18:57.280047 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2e72bd-b22d-498a-a667-6d9f6fd87784 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:18:57.281954 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2e72bd-b22d-498a-a667-6d9f6fd87784 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:18:57.301995 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1368/2717] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 14 10:18:57 2022] POST /identity/v3/users => generated 290 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:18:57.306005 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22a21f0-93aa-4084-813a-2651a2e3d366 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:18:57.316445 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22a21f0-93aa-4084-813a-2651a2e3d366 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:18:57.321043 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a66b8d4-4db5-4e1d-8926-778eb5e4d2cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:18:57.321714 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a66b8d4-4db5-4e1d-8926-778eb5e4d2cf admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:18:57.322002 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a66b8d4-4db5-4e1d-8926-778eb5e4d2cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:18:57.322322 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a66b8d4-4db5-4e1d-8926-778eb5e4d2cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:18:57.323091 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a66b8d4-4db5-4e1d-8926-778eb5e4d2cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:18:57.325037 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a66b8d4-4db5-4e1d-8926-778eb5e4d2cf admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:18:57.335664 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1350/2718] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 10:18:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:18:57.339116 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2e72bd-b22d-498a-a667-6d9f6fd87784 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:18:57.349451 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2e72bd-b22d-498a-a667-6d9f6fd87784 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:18:57.353985 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd30c88-59ac-4303-825e-8c2cd1b226d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:18:57.354682 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd30c88-59ac-4303-825e-8c2cd1b226d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:18:57.354971 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd30c88-59ac-4303-825e-8c2cd1b226d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:18:57.355248 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd30c88-59ac-4303-825e-8c2cd1b226d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:18:57.356003 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd30c88-59ac-4303-825e-8c2cd1b226d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:18:57.357587 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd30c88-59ac-4303-825e-8c2cd1b226d2 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:18:57.367881 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1369/2719] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 10:18:57 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 10:18:57.372090 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a66b8d4-4db5-4e1d-8926-778eb5e4d2cf admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:18:57.381927 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a66b8d4-4db5-4e1d-8926-778eb5e4d2cf admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:18:57.386620 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d241116f-0617-448a-bcdc-38ebebf0fd1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:18:57.387496 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d241116f-0617-448a-bcdc-38ebebf0fd1e admin admin] REQUEST_METHOD: `PUT` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:18:57.387811 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d241116f-0617-448a-bcdc-38ebebf0fd1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:18:57.388094 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d241116f-0617-448a-bcdc-38ebebf0fd1e admin admin] PATH_INFO: `/v3/projects/eb68648dba8b49f3981552b09a2392cd/users/ae2acbaa217940008ca2f61f39b2aaf4/roles/17dfac38a2e540fea229af7de99911bb` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:18:57.402163 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d241116f-0617-448a-bcdc-38ebebf0fd1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb68648dba8b49f3981552b09a2392cd, user_id=ae2acbaa217940008ca2f61f39b2aaf4, role_id=17dfac38a2e540fea229af7de99911bb)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:18:57.404864 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d241116f-0617-448a-bcdc-38ebebf0fd1e admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:18:57.418069 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1351/2720] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 14 10:18:57 2022] PUT /identity/v3/projects/eb68648dba8b49f3981552b09a2392cd/users/ae2acbaa217940008ca2f61f39b2aaf4/roles/17dfac38a2e540fea229af7de99911bb => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:18:57.429810 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1891c071-a304-4a23-8879-7a891407e23e None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:18:57.430105 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1891c071-a304-4a23-8879-7a891407e23e None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:18:57.430423 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1891c071-a304-4a23-8879-7a891407e23e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:18:57.456710 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-1891c071-a304-4a23-8879-7a891407e23e None None] MFA Rules not processed for user `ae2acbaa217940008ca2f61f39b2aaf4`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:18:57.457921 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-1891c071-a304-4a23-8879-7a891407e23e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:18:57.521603 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1370/2721] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 10:18:57 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 10:18:57.526269 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d241116f-0617-448a-bcdc-38ebebf0fd1e admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:18:57.586952 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d241116f-0617-448a-bcdc-38ebebf0fd1e admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:18:57.591521 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830161c6-57a4-4d95-b85a-4c2706508365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:18:57.592196 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830161c6-57a4-4d95-b85a-4c2706508365 admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:18:57.592477 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830161c6-57a4-4d95-b85a-4c2706508365 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:18:57.592751 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830161c6-57a4-4d95-b85a-4c2706508365 admin admin] PATH_INFO: `/v3/projects` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:18:57.593446 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830161c6-57a4-4d95-b85a-4c2706508365 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:18:57.595361 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830161c6-57a4-4d95-b85a-4c2706508365 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:18:57.619683 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1352/2722] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 14 10:18:57 2022] POST /identity/v3/projects => generated 379 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:18:57.623829 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1891c071-a304-4a23-8879-7a891407e23e None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:18:57.634476 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1891c071-a304-4a23-8879-7a891407e23e None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:18:57.646247 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:18:57.691251 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7db0d6-faf6-4fd0-8ed6-0b6929b08274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:18:57.691940 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7db0d6-faf6-4fd0-8ed6-0b6929b08274 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:18:57.692228 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7db0d6-faf6-4fd0-8ed6-0b6929b08274 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:18:57.692509 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7db0d6-faf6-4fd0-8ed6-0b6929b08274 admin admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:18:57.693214 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7db0d6-faf6-4fd0-8ed6-0b6929b08274 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:18:57.695160 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7db0d6-faf6-4fd0-8ed6-0b6929b08274 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:18:57.715355 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1371/2723] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 14 10:18:57 2022] POST /identity/v3/users => generated 296 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 10:18:57.719285 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830161c6-57a4-4d95-b85a-4c2706508365 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:18:57.730067 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830161c6-57a4-4d95-b85a-4c2706508365 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:18:57.734621 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210d7b31-23d5-4190-abe4-bb0ec219442a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:18:57.735270 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210d7b31-23d5-4190-abe4-bb0ec219442a admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:18:57.735550 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210d7b31-23d5-4190-abe4-bb0ec219442a admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:18:57.735829 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210d7b31-23d5-4190-abe4-bb0ec219442a admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:18:57.736552 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210d7b31-23d5-4190-abe4-bb0ec219442a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:18:57.738131 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210d7b31-23d5-4190-abe4-bb0ec219442a admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:18:57.749493 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1353/2724] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 10:18:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:18:57.753448 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7db0d6-faf6-4fd0-8ed6-0b6929b08274 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:18:57.763403 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7db0d6-faf6-4fd0-8ed6-0b6929b08274 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:18:57.768044 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f152e7b-7e14-4688-89bc-6bc700fdbea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:18:57.768918 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f152e7b-7e14-4688-89bc-6bc700fdbea0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:18:57.769205 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f152e7b-7e14-4688-89bc-6bc700fdbea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:18:57.769488 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f152e7b-7e14-4688-89bc-6bc700fdbea0 admin admin] PATH_INFO: `/v3/projects/401eeec1e54f4f8f9954342067e7292c/users/20f213bffeb740b7867f5ba66489c7f5/roles/e3965bd0d5f1427a86a313c0c90bfef3` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:18:57.784340 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f152e7b-7e14-4688-89bc-6bc700fdbea0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=401eeec1e54f4f8f9954342067e7292c, user_id=20f213bffeb740b7867f5ba66489c7f5, role_id=e3965bd0d5f1427a86a313c0c90bfef3)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:18:57.787695 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f152e7b-7e14-4688-89bc-6bc700fdbea0 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:18:57.800635 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1372/2725] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 14 10:18:57 2022] PUT /identity/v3/projects/401eeec1e54f4f8f9954342067e7292c/users/20f213bffeb740b7867f5ba66489c7f5/roles/e3965bd0d5f1427a86a313c0c90bfef3 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:18:57.804561 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210d7b31-23d5-4190-abe4-bb0ec219442a admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:18:57.815014 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210d7b31-23d5-4190-abe4-bb0ec219442a admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:18:57.869428 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bbf977-52b0-436f-b9d2-88ef7fdd78a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:18:57.870146 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bbf977-52b0-436f-b9d2-88ef7fdd78a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:18:57.870425 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bbf977-52b0-436f-b9d2-88ef7fdd78a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:18:57.870702 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bbf977-52b0-436f-b9d2-88ef7fdd78a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:18:57.871424 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bbf977-52b0-436f-b9d2-88ef7fdd78a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:18:57.872997 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bbf977-52b0-436f-b9d2-88ef7fdd78a0 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:18:57.882946 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1354/2726] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 10:18:57 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:18:57.887184 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f152e7b-7e14-4688-89bc-6bc700fdbea0 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:18:57.897923 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f152e7b-7e14-4688-89bc-6bc700fdbea0 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:18:57.902641 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c7b77c-f491-4ec0-a998-620d73cd0283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:18:57.903519 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c7b77c-f491-4ec0-a998-620d73cd0283 admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:18:57.903805 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c7b77c-f491-4ec0-a998-620d73cd0283 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:18:57.904082 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c7b77c-f491-4ec0-a998-620d73cd0283 admin admin] PATH_INFO: `/v3/projects/401eeec1e54f4f8f9954342067e7292c/users/20f213bffeb740b7867f5ba66489c7f5/roles/e3965bd0d5f1427a86a313c0c90bfef3` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:18:57.906074 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c7b77c-f491-4ec0-a998-620d73cd0283 admin admin] RBAC: Authorizing `identity:create_grant(project_id=401eeec1e54f4f8f9954342067e7292c, user_id=20f213bffeb740b7867f5ba66489c7f5, role_id=e3965bd0d5f1427a86a313c0c90bfef3)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:18:57.908726 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c7b77c-f491-4ec0-a998-620d73cd0283 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:18:57.918870 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1373/2727] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 14 10:18:57 2022] PUT /identity/v3/projects/401eeec1e54f4f8f9954342067e7292c/users/20f213bffeb740b7867f5ba66489c7f5/roles/e3965bd0d5f1427a86a313c0c90bfef3 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:18:57.928894 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60080faf-4e4a-40cd-bb71-c68a97fbc82d None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:18:57.929372 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60080faf-4e4a-40cd-bb71-c68a97fbc82d None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:18:57.929480 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60080faf-4e4a-40cd-bb71-c68a97fbc82d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:18:57.936152 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:18:57.957247 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-60080faf-4e4a-40cd-bb71-c68a97fbc82d None None] MFA Rules not processed for user `20f213bffeb740b7867f5ba66489c7f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:18:57.959119 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-60080faf-4e4a-40cd-bb71-c68a97fbc82d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:18:58.025877 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1355/2728] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 10:18:57 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:18:58.036599 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c7b77c-f491-4ec0-a998-620d73cd0283 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:18:58.038337 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-21c7b77c-f491-4ec0-a998-620d73cd0283 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:18:58.096433 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c7b77c-f491-4ec0-a998-620d73cd0283 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:18:58.100135 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f801ae6-963d-4f94-a8bd-b43e58339aa2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25048b29787d482783ebc944f1a7df65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:18:58.100776 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f801ae6-963d-4f94-a8bd-b43e58339aa2 service cinder] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:18:58.101060 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f801ae6-963d-4f94-a8bd-b43e58339aa2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:18:58.101337 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f801ae6-963d-4f94-a8bd-b43e58339aa2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:18:58.110419 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f801ae6-963d-4f94-a8bd-b43e58339aa2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:18:58.111850 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f801ae6-963d-4f94-a8bd-b43e58339aa2 service cinder] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:18:58.121368 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1374/2729] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 10:18:58 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:18:58.466844 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60080faf-4e4a-40cd-bb71-c68a97fbc82d None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:18:58.531693 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60080faf-4e4a-40cd-bb71-c68a97fbc82d None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:18:58.536138 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dc4810-94cb-4920-897e-d6d400c90045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:18:58.537008 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dc4810-94cb-4920-897e-d6d400c90045 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:18:58.537290 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dc4810-94cb-4920-897e-d6d400c90045 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:18:58.537564 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dc4810-94cb-4920-897e-d6d400c90045 admin admin] PATH_INFO: `/v3/users/ae2acbaa217940008ca2f61f39b2aaf4` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:18:58.538868 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dc4810-94cb-4920-897e-d6d400c90045 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae2acbaa217940008ca2f61f39b2aaf4)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:18:58.540741 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dc4810-94cb-4920-897e-d6d400c90045 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:18:58.585810 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-e4dc4810-94cb-4920-897e-d6d400c90045 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae2acbaa217940008ca2f61f39b2aaf4'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:18:58.592507 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-e4dc4810-94cb-4920-897e-d6d400c90045 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae2acbaa217940008ca2f61f39b2aaf4'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:18:58.593159 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-e4dc4810-94cb-4920-897e-d6d400c90045 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae2acbaa217940008ca2f61f39b2aaf4'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:18:58.599699 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-e4dc4810-94cb-4920-897e-d6d400c90045 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae2acbaa217940008ca2f61f39b2aaf4'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:18:58.600307 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-e4dc4810-94cb-4920-897e-d6d400c90045 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae2acbaa217940008ca2f61f39b2aaf4'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:18:58.618054 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1356/2730] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 14 10:18:58 2022] DELETE /identity/v3/users/ae2acbaa217940008ca2f61f39b2aaf4 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:18:58.622816 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af267eae-df80-4cbc-bc0e-9830859a5e69 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:18:58.623061 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af267eae-df80-4cbc-bc0e-9830859a5e69 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:18:58.623346 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af267eae-df80-4cbc-bc0e-9830859a5e69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:18:58.641252 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-af267eae-df80-4cbc-bc0e-9830859a5e69 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:18:58.642493 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-af267eae-df80-4cbc-bc0e-9830859a5e69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:18:58.701621 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1375/2731] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 10:18:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:18:58.711313 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dc4810-94cb-4920-897e-d6d400c90045 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:18:58.712717 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-e4dc4810-94cb-4920-897e-d6d400c90045 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:18:58.724248 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:18:58.770957 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dc4810-94cb-4920-897e-d6d400c90045 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:18:58.774682 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fb760e-5829-4e2a-bccf-3d35fc16d55c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e4a5a8965e4802a9055d332179b7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:18:58.775335 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fb760e-5829-4e2a-bccf-3d35fc16d55c service neutron] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:18:58.775614 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fb760e-5829-4e2a-bccf-3d35fc16d55c service neutron] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:18:58.775886 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fb760e-5829-4e2a-bccf-3d35fc16d55c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:18:58.785269 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fb760e-5829-4e2a-bccf-3d35fc16d55c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:18:58.787229 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fb760e-5829-4e2a-bccf-3d35fc16d55c service neutron] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:18:58.796738 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1357/2732] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 10:18:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:18:59.073611 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af267eae-df80-4cbc-bc0e-9830859a5e69 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:18:59.075104 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-af267eae-df80-4cbc-bc0e-9830859a5e69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:18:59.087473 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af267eae-df80-4cbc-bc0e-9830859a5e69 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:18:59.092089 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82470013-22cc-4b41-8158-97d7b37942a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:18:59.092958 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82470013-22cc-4b41-8158-97d7b37942a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:18:59.093247 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82470013-22cc-4b41-8158-97d7b37942a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:18:59.093529 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82470013-22cc-4b41-8158-97d7b37942a7 admin admin] PATH_INFO: `/v3/projects/eb68648dba8b49f3981552b09a2392cd` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:18:59.094749 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82470013-22cc-4b41-8158-97d7b37942a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb68648dba8b49f3981552b09a2392cd)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:18:59.096671 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82470013-22cc-4b41-8158-97d7b37942a7 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:18:59.104008 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:18:59.151858 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-82470013-22cc-4b41-8158-97d7b37942a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb68648dba8b49f3981552b09a2392cd', 'request_id': 'req-82470013-22cc-4b41-8158-97d7b37942a7'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:18:59.158647 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-82470013-22cc-4b41-8158-97d7b37942a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb68648dba8b49f3981552b09a2392cd', 'request_id': 'req-82470013-22cc-4b41-8158-97d7b37942a7'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:18:59.164846 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-82470013-22cc-4b41-8158-97d7b37942a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb68648dba8b49f3981552b09a2392cd', 'request_id': 'req-82470013-22cc-4b41-8158-97d7b37942a7'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:18:59.176535 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-82470013-22cc-4b41-8158-97d7b37942a7 admin admin] The token cache is being invalidate because project eb68648dba8b49f3981552b09a2392cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:18:59.176851 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-82470013-22cc-4b41-8158-97d7b37942a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:18:59.177462 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-82470013-22cc-4b41-8158-97d7b37942a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:18:59.179037 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1376/2733] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 14 10:18:59 2022] DELETE /identity/v3/projects/eb68648dba8b49f3981552b09a2392cd => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:18:59.183171 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fb760e-5829-4e2a-bccf-3d35fc16d55c service neutron] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:18:59.192981 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fb760e-5829-4e2a-bccf-3d35fc16d55c service neutron] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:18:59.247634 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd0a9bc-15fe-4c15-9550-de3ed1866923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:18:59.248497 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd0a9bc-15fe-4c15-9550-de3ed1866923 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:18:59.248784 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd0a9bc-15fe-4c15-9550-de3ed1866923 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:18:59.249061 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd0a9bc-15fe-4c15-9550-de3ed1866923 admin admin] PATH_INFO: `/v3/users/20f213bffeb740b7867f5ba66489c7f5` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:18:59.250285 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd0a9bc-15fe-4c15-9550-de3ed1866923 admin admin] RBAC: Authorizing `identity:delete_user(user_id=20f213bffeb740b7867f5ba66489c7f5)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:18:59.252250 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd0a9bc-15fe-4c15-9550-de3ed1866923 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:18:59.296053 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-fcd0a9bc-15fe-4c15-9550-de3ed1866923 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20f213bffeb740b7867f5ba66489c7f5'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:18:59.302810 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-fcd0a9bc-15fe-4c15-9550-de3ed1866923 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20f213bffeb740b7867f5ba66489c7f5'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:18:59.303448 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-fcd0a9bc-15fe-4c15-9550-de3ed1866923 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20f213bffeb740b7867f5ba66489c7f5'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:18:59.310264 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-fcd0a9bc-15fe-4c15-9550-de3ed1866923 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20f213bffeb740b7867f5ba66489c7f5'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:18:59.310901 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-fcd0a9bc-15fe-4c15-9550-de3ed1866923 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20f213bffeb740b7867f5ba66489c7f5'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:18:59.327972 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1358/2734] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 14 10:18:59 2022] DELETE /identity/v3/users/20f213bffeb740b7867f5ba66489c7f5 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:18:59.593884 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82470013-22cc-4b41-8158-97d7b37942a7 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:18:59.595403 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-82470013-22cc-4b41-8158-97d7b37942a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:18:59.610102 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82470013-22cc-4b41-8158-97d7b37942a7 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:18:59.667883 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067b878a-10b0-4dc3-84ba-4dcb1517fe02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:18:59.668746 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067b878a-10b0-4dc3-84ba-4dcb1517fe02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:18:59.669028 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067b878a-10b0-4dc3-84ba-4dcb1517fe02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:18:59.669304 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067b878a-10b0-4dc3-84ba-4dcb1517fe02 admin admin] PATH_INFO: `/v3/projects/401eeec1e54f4f8f9954342067e7292c` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:18:59.670557 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067b878a-10b0-4dc3-84ba-4dcb1517fe02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=401eeec1e54f4f8f9954342067e7292c)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:18:59.672391 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067b878a-10b0-4dc3-84ba-4dcb1517fe02 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:18:59.717950 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-067b878a-10b0-4dc3-84ba-4dcb1517fe02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '401eeec1e54f4f8f9954342067e7292c', 'request_id': 'req-067b878a-10b0-4dc3-84ba-4dcb1517fe02'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:18:59.724216 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-067b878a-10b0-4dc3-84ba-4dcb1517fe02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '401eeec1e54f4f8f9954342067e7292c', 'request_id': 'req-067b878a-10b0-4dc3-84ba-4dcb1517fe02'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:18:59.729723 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-067b878a-10b0-4dc3-84ba-4dcb1517fe02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '401eeec1e54f4f8f9954342067e7292c', 'request_id': 'req-067b878a-10b0-4dc3-84ba-4dcb1517fe02'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:18:59.742215 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-067b878a-10b0-4dc3-84ba-4dcb1517fe02 admin admin] The token cache is being invalidate because project 401eeec1e54f4f8f9954342067e7292c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:18:59.742511 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-067b878a-10b0-4dc3-84ba-4dcb1517fe02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:18:59.743127 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-067b878a-10b0-4dc3-84ba-4dcb1517fe02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:18:59.744657 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1377/2735] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 14 10:18:59 2022] DELETE /identity/v3/projects/401eeec1e54f4f8f9954342067e7292c => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:18:59.749603 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeadb5b-12e6-4403-8499-f889ab121aea None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:18:59.749896 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeadb5b-12e6-4403-8499-f889ab121aea None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:18:59.750173 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeadb5b-12e6-4403-8499-f889ab121aea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:18:59.767766 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-7aeadb5b-12e6-4403-8499-f889ab121aea None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:18:59.768955 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-7aeadb5b-12e6-4403-8499-f889ab121aea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:18:59.794140 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:18:59.829737 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1359/2736] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 10:18:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:18:59.837658 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac31966f-0fd5-4bb1-8052-37d8ff529c16 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:18:59.838070 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac31966f-0fd5-4bb1-8052-37d8ff529c16 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:18:59.838394 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac31966f-0fd5-4bb1-8052-37d8ff529c16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:18:59.856387 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-ac31966f-0fd5-4bb1-8052-37d8ff529c16 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:18:59.857594 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-ac31966f-0fd5-4bb1-8052-37d8ff529c16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:18:59.866042 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1378/2737] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 10:18:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:18:59.870298 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aeadb5b-12e6-4403-8499-f889ab121aea None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:18:59.880382 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aeadb5b-12e6-4403-8499-f889ab121aea None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:18:59.884886 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11883b4a-d4a8-4238-a790-163868a458dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:18:59.885531 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11883b4a-d4a8-4238-a790-163868a458dc admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:18:59.885813 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11883b4a-d4a8-4238-a790-163868a458dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:18:59.886090 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11883b4a-d4a8-4238-a790-163868a458dc admin admin] PATH_INFO: `/v3/domains` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:18:59.886846 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11883b4a-d4a8-4238-a790-163868a458dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:18:59.887154 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11883b4a-d4a8-4238-a790-163868a458dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:18:59.888734 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11883b4a-d4a8-4238-a790-163868a458dc admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:18:59.900015 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1360/2738] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jul 14 10:18:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:18:59.904063 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac31966f-0fd5-4bb1-8052-37d8ff529c16 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:18:59.913753 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac31966f-0fd5-4bb1-8052-37d8ff529c16 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:18:59.918474 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa9a547-b668-483c-9d13-c768c779ed2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:18:59.919122 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa9a547-b668-483c-9d13-c768c779ed2c admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:18:59.919411 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa9a547-b668-483c-9d13-c768c779ed2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:18:59.919692 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa9a547-b668-483c-9d13-c768c779ed2c admin admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:18:59.920382 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa9a547-b668-483c-9d13-c768c779ed2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:18:59.922366 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa9a547-b668-483c-9d13-c768c779ed2c admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:18:59.936417 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:18:59.950488 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1379/2739] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 14 10:18:59 2022] POST /identity/v3/projects => generated 363 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:18:59.954502 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11883b4a-d4a8-4238-a790-163868a458dc admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:18:59.964402 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11883b4a-d4a8-4238-a790-163868a458dc admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:19:00.019788 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519ef21c-b9a8-404a-b380-f11c3cbab9b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:19:00.020606 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519ef21c-b9a8-404a-b380-f11c3cbab9b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:19:00.020893 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519ef21c-b9a8-404a-b380-f11c3cbab9b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:19:00.021172 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519ef21c-b9a8-404a-b380-f11c3cbab9b1 admin admin] PATH_INFO: `/v3/users` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:19:00.021863 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519ef21c-b9a8-404a-b380-f11c3cbab9b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:19:00.023842 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519ef21c-b9a8-404a-b380-f11c3cbab9b1 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:19:00.043740 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1361/2740] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 14 10:18:59 2022] POST /identity/v3/users => generated 282 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:19:00.047827 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa9a547-b668-483c-9d13-c768c779ed2c admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:19:00.058634 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa9a547-b668-483c-9d13-c768c779ed2c admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:19:00.063242 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7d66f5-f9bc-47f6-b96f-968a3df97b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:19:00.064161 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7d66f5-f9bc-47f6-b96f-968a3df97b14 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:19:00.064448 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7d66f5-f9bc-47f6-b96f-968a3df97b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:19:00.064738 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7d66f5-f9bc-47f6-b96f-968a3df97b14 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:19:00.065467 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7d66f5-f9bc-47f6-b96f-968a3df97b14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:19:00.067719 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7d66f5-f9bc-47f6-b96f-968a3df97b14 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:19:00.078229 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1380/2741] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 10:19:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:19:00.082007 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519ef21c-b9a8-404a-b380-f11c3cbab9b1 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:19:00.091806 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519ef21c-b9a8-404a-b380-f11c3cbab9b1 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:19:00.096434 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ffcd33-286e-4191-9517-e280c1161aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:19:00.097085 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ffcd33-286e-4191-9517-e280c1161aa9 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:19:00.097373 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ffcd33-286e-4191-9517-e280c1161aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:19:00.097656 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ffcd33-286e-4191-9517-e280c1161aa9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:19:00.098419 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ffcd33-286e-4191-9517-e280c1161aa9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:19:00.100005 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ffcd33-286e-4191-9517-e280c1161aa9 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:19:00.110488 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1362/2742] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 10:19:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:19:00.115026 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7d66f5-f9bc-47f6-b96f-968a3df97b14 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:19:00.124876 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7d66f5-f9bc-47f6-b96f-968a3df97b14 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:19:00.130115 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1123228-b95b-45f2-9f96-2c2ab4a33e09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:19:00.131127 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1123228-b95b-45f2-9f96-2c2ab4a33e09 admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:19:00.131414 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1123228-b95b-45f2-9f96-2c2ab4a33e09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:19:00.131709 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1123228-b95b-45f2-9f96-2c2ab4a33e09 admin admin] PATH_INFO: `/v3/projects/3d32905f8a974d6d82eae4c81575af24/users/2ea6d138fc9a4badb260c70b866c3cc3/roles/17dfac38a2e540fea229af7de99911bb` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:19:00.146098 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1123228-b95b-45f2-9f96-2c2ab4a33e09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d32905f8a974d6d82eae4c81575af24, user_id=2ea6d138fc9a4badb260c70b866c3cc3, role_id=17dfac38a2e540fea229af7de99911bb)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:19:00.148754 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1123228-b95b-45f2-9f96-2c2ab4a33e09 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:19:00.161721 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1381/2743] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 14 10:19:00 2022] PUT /identity/v3/projects/3d32905f8a974d6d82eae4c81575af24/users/2ea6d138fc9a4badb260c70b866c3cc3/roles/17dfac38a2e540fea229af7de99911bb => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:19:00.223041 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041c5b22-f0df-4198-9029-7cac37bb8af0 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:19:00.224096 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041c5b22-f0df-4198-9029-7cac37bb8af0 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:19:00.224271 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041c5b22-f0df-4198-9029-7cac37bb8af0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:19:00.251699 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-041c5b22-f0df-4198-9029-7cac37bb8af0 None None] MFA Rules not processed for user `2ea6d138fc9a4badb260c70b866c3cc3`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:19:00.252962 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-041c5b22-f0df-4198-9029-7cac37bb8af0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:19:00.315471 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1363/2744] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 10:19:00 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:19:00.326473 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1123228-b95b-45f2-9f96-2c2ab4a33e09 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:19:00.328153 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-d1123228-b95b-45f2-9f96-2c2ab4a33e09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:19:00.386204 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1123228-b95b-45f2-9f96-2c2ab4a33e09 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:19:00.389941 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf81e25-37b7-46fd-a8de-8e70986662b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25048b29787d482783ebc944f1a7df65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:19:00.390619 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf81e25-37b7-46fd-a8de-8e70986662b3 service cinder] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:19:00.390906 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf81e25-37b7-46fd-a8de-8e70986662b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:19:00.391186 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf81e25-37b7-46fd-a8de-8e70986662b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:19:00.399600 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf81e25-37b7-46fd-a8de-8e70986662b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:19:00.401022 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf81e25-37b7-46fd-a8de-8e70986662b3 service cinder] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:19:00.409774 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1382/2745] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 10:19:00 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:19:10.312311 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=85,keystone:INSERT=3 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:19:10.405745 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=43,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:19:24.500284 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041c5b22-f0df-4198-9029-7cac37bb8af0 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:19:24.501745 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-041c5b22-f0df-4198-9029-7cac37bb8af0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:19:24.571939 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041c5b22-f0df-4198-9029-7cac37bb8af0 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:19:24.575576 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc7c260-a98d-4d4c-ab6c-276a36e9596b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e4a5a8965e4802a9055d332179b7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:19:24.576234 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc7c260-a98d-4d4c-ab6c-276a36e9596b service neutron] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:19:24.576519 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc7c260-a98d-4d4c-ab6c-276a36e9596b service neutron] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:19:24.576798 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc7c260-a98d-4d4c-ab6c-276a36e9596b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:19:24.578624 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-cfc7c260-a98d-4d4c-ab6c-276a36e9596b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:19:24.588087 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc7c260-a98d-4d4c-ab6c-276a36e9596b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:19:24.589514 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc7c260-a98d-4d4c-ab6c-276a36e9596b service neutron] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:19:24.597933 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1364/2746] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 10:19:24 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:19:34.594132 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=30 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:19:51.824644 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf81e25-37b7-46fd-a8de-8e70986662b3 service cinder] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:19:51.889357 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf81e25-37b7-46fd-a8de-8e70986662b3 service cinder] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:19:51.893794 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf991d61-f5a5-4191-bfec-b2522dff44c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:19:51.894697 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf991d61-f5a5-4191-bfec-b2522dff44c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:19:51.894977 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf991d61-f5a5-4191-bfec-b2522dff44c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:19:51.895257 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf991d61-f5a5-4191-bfec-b2522dff44c8 admin admin] PATH_INFO: `/v3/users/2ea6d138fc9a4badb260c70b866c3cc3` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:19:51.896441 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf991d61-f5a5-4191-bfec-b2522dff44c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ea6d138fc9a4badb260c70b866c3cc3)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:19:51.898391 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf991d61-f5a5-4191-bfec-b2522dff44c8 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:19:51.943481 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-cf991d61-f5a5-4191-bfec-b2522dff44c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ea6d138fc9a4badb260c70b866c3cc3'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:19:51.955674 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-cf991d61-f5a5-4191-bfec-b2522dff44c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ea6d138fc9a4badb260c70b866c3cc3'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:19:51.956328 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-cf991d61-f5a5-4191-bfec-b2522dff44c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ea6d138fc9a4badb260c70b866c3cc3'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:19:51.963542 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-cf991d61-f5a5-4191-bfec-b2522dff44c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ea6d138fc9a4badb260c70b866c3cc3'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:19:51.970733 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-cf991d61-f5a5-4191-bfec-b2522dff44c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ea6d138fc9a4badb260c70b866c3cc3'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:19:51.976689 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1383/2747] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 14 10:19:51 2022] DELETE /identity/v3/users/2ea6d138fc9a4badb260c70b866c3cc3 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:19:51.981710 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74632499-b93e-411e-98f6-dd973e445230 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:19:51.982247 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74632499-b93e-411e-98f6-dd973e445230 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:19:51.982361 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74632499-b93e-411e-98f6-dd973e445230 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:19:51.999764 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-74632499-b93e-411e-98f6-dd973e445230 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:19:52.001186 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-74632499-b93e-411e-98f6-dd973e445230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:19:52.058898 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1365/2748] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 10:19:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:19:52.069669 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf991d61-f5a5-4191-bfec-b2522dff44c8 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:19:52.071130 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-cf991d61-f5a5-4191-bfec-b2522dff44c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:19:52.134093 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf991d61-f5a5-4191-bfec-b2522dff44c8 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:19:52.138469 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d774268-c425-4ca6-b096-6e144780dcbb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e4a5a8965e4802a9055d332179b7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:19:52.139114 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d774268-c425-4ca6-b096-6e144780dcbb service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:19:52.139395 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d774268-c425-4ca6-b096-6e144780dcbb service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:19:52.139669 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d774268-c425-4ca6-b096-6e144780dcbb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:19:52.148556 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d774268-c425-4ca6-b096-6e144780dcbb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:19:52.149975 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d774268-c425-4ca6-b096-6e144780dcbb service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:19:52.159283 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1384/2749] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 10:19:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:19:52.417755 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74632499-b93e-411e-98f6-dd973e445230 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:19:52.419250 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-74632499-b93e-411e-98f6-dd973e445230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:19:52.431074 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74632499-b93e-411e-98f6-dd973e445230 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:19:52.436487 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af795eb9-e4f1-4749-b3a2-a6e1da2f3f23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:19:52.437355 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af795eb9-e4f1-4749-b3a2-a6e1da2f3f23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:19:52.437635 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af795eb9-e4f1-4749-b3a2-a6e1da2f3f23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:19:52.437908 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af795eb9-e4f1-4749-b3a2-a6e1da2f3f23 admin admin] PATH_INFO: `/v3/projects/3d32905f8a974d6d82eae4c81575af24` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:19:52.439184 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af795eb9-e4f1-4749-b3a2-a6e1da2f3f23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d32905f8a974d6d82eae4c81575af24)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:19:52.441351 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af795eb9-e4f1-4749-b3a2-a6e1da2f3f23 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:19:52.489566 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-af795eb9-e4f1-4749-b3a2-a6e1da2f3f23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d32905f8a974d6d82eae4c81575af24', 'request_id': 'req-af795eb9-e4f1-4749-b3a2-a6e1da2f3f23'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:19:52.496627 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-af795eb9-e4f1-4749-b3a2-a6e1da2f3f23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d32905f8a974d6d82eae4c81575af24', 'request_id': 'req-af795eb9-e4f1-4749-b3a2-a6e1da2f3f23'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:19:52.502149 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-af795eb9-e4f1-4749-b3a2-a6e1da2f3f23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d32905f8a974d6d82eae4c81575af24', 'request_id': 'req-af795eb9-e4f1-4749-b3a2-a6e1da2f3f23'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:19:52.513010 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-af795eb9-e4f1-4749-b3a2-a6e1da2f3f23 admin admin] The token cache is being invalidate because project 3d32905f8a974d6d82eae4c81575af24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:19:52.513301 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-af795eb9-e4f1-4749-b3a2-a6e1da2f3f23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:19:52.513936 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-af795eb9-e4f1-4749-b3a2-a6e1da2f3f23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:19:52.515493 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1366/2750] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 14 10:19:52 2022] DELETE /identity/v3/projects/3d32905f8a974d6d82eae4c81575af24 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:19:52.521666 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8972ebac-f8a2-477f-9d82-64ac912dc524 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:19:52.522019 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8972ebac-f8a2-477f-9d82-64ac912dc524 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:19:52.522328 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8972ebac-f8a2-477f-9d82-64ac912dc524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:19:52.541829 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-8972ebac-f8a2-477f-9d82-64ac912dc524 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:19:52.543078 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-8972ebac-f8a2-477f-9d82-64ac912dc524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:19:52.548257 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:19:52.602322 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1385/2751] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 10:19:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:19:52.610505 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fe3646-66dd-432a-8c94-40b828076492 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:19:52.610798 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fe3646-66dd-432a-8c94-40b828076492 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:19:52.611081 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fe3646-66dd-432a-8c94-40b828076492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:19:52.628870 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-f2fe3646-66dd-432a-8c94-40b828076492 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:19:52.630066 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-f2fe3646-66dd-432a-8c94-40b828076492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:19:52.638093 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1367/2752] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 10:19:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:19:52.642375 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8972ebac-f8a2-477f-9d82-64ac912dc524 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:19:52.652524 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8972ebac-f8a2-477f-9d82-64ac912dc524 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:19:52.657121 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291ecdb0-828d-48f0-9872-91bac87c04e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:19:52.657779 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291ecdb0-828d-48f0-9872-91bac87c04e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:19:52.658069 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291ecdb0-828d-48f0-9872-91bac87c04e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:19:52.658383 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291ecdb0-828d-48f0-9872-91bac87c04e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:19:52.659118 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291ecdb0-828d-48f0-9872-91bac87c04e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:19:52.659434 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291ecdb0-828d-48f0-9872-91bac87c04e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:19:52.661038 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291ecdb0-828d-48f0-9872-91bac87c04e8 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:19:52.672901 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1386/2753] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jul 14 10:19:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:19:52.676895 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fe3646-66dd-432a-8c94-40b828076492 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:19:52.685988 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fe3646-66dd-432a-8c94-40b828076492 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:19:52.690634 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc119f1e-4046-4f31-8940-3ffa8391ea08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:19:52.691530 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc119f1e-4046-4f31-8940-3ffa8391ea08 admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:19:52.691815 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc119f1e-4046-4f31-8940-3ffa8391ea08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:19:52.692095 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc119f1e-4046-4f31-8940-3ffa8391ea08 admin admin] PATH_INFO: `/v3/projects` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:19:52.692787 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc119f1e-4046-4f31-8940-3ffa8391ea08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:19:52.694687 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc119f1e-4046-4f31-8940-3ffa8391ea08 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:19:52.719797 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1368/2754] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 14 10:19:52 2022] POST /identity/v3/projects => generated 379 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:19:52.723940 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291ecdb0-828d-48f0-9872-91bac87c04e8 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:19:52.734522 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291ecdb0-828d-48f0-9872-91bac87c04e8 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:19:52.799063 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296506c6-9c51-478d-8e51-11be1a2b073b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:19:52.799739 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296506c6-9c51-478d-8e51-11be1a2b073b admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:19:52.800020 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296506c6-9c51-478d-8e51-11be1a2b073b admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:19:52.800295 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296506c6-9c51-478d-8e51-11be1a2b073b admin admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:19:52.801003 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296506c6-9c51-478d-8e51-11be1a2b073b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:19:52.802940 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296506c6-9c51-478d-8e51-11be1a2b073b admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:19:52.822240 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1387/2755] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 14 10:19:52 2022] POST /identity/v3/users => generated 290 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 10:19:52.826493 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc119f1e-4046-4f31-8940-3ffa8391ea08 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:19:52.836542 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc119f1e-4046-4f31-8940-3ffa8391ea08 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:19:52.841601 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da5e248-70e2-45ae-9273-4acbbb69e2f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:19:52.842281 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da5e248-70e2-45ae-9273-4acbbb69e2f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:19:52.842567 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da5e248-70e2-45ae-9273-4acbbb69e2f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:19:52.842848 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da5e248-70e2-45ae-9273-4acbbb69e2f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:19:52.843573 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da5e248-70e2-45ae-9273-4acbbb69e2f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:19:52.845151 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da5e248-70e2-45ae-9273-4acbbb69e2f5 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:19:52.855873 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1369/2756] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 10:19:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:19:52.859585 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296506c6-9c51-478d-8e51-11be1a2b073b admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:19:52.869436 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296506c6-9c51-478d-8e51-11be1a2b073b admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:19:52.874036 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6770f4-4123-4e35-9866-6f3bda02c6e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:19:52.874944 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6770f4-4123-4e35-9866-6f3bda02c6e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:19:52.875237 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6770f4-4123-4e35-9866-6f3bda02c6e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:19:52.875625 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6770f4-4123-4e35-9866-6f3bda02c6e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:19:52.876360 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6770f4-4123-4e35-9866-6f3bda02c6e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:19:52.878058 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6770f4-4123-4e35-9866-6f3bda02c6e7 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:19:52.887870 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1388/2757] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 10:19:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:19:52.891827 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da5e248-70e2-45ae-9273-4acbbb69e2f5 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:19:52.902003 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da5e248-70e2-45ae-9273-4acbbb69e2f5 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:19:52.906559 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349d12c6-6cff-4197-b77f-7d0c650dd92a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:19:52.907429 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349d12c6-6cff-4197-b77f-7d0c650dd92a admin admin] REQUEST_METHOD: `PUT` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:19:52.907715 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349d12c6-6cff-4197-b77f-7d0c650dd92a admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:19:52.907991 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349d12c6-6cff-4197-b77f-7d0c650dd92a admin admin] PATH_INFO: `/v3/projects/c5f8922bb91240a2b1f63f306c6d09d1/users/5897368539ef4287bcba0c274c458491/roles/17dfac38a2e540fea229af7de99911bb` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:19:52.923709 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349d12c6-6cff-4197-b77f-7d0c650dd92a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5f8922bb91240a2b1f63f306c6d09d1, user_id=5897368539ef4287bcba0c274c458491, role_id=17dfac38a2e540fea229af7de99911bb)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:19:52.926504 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349d12c6-6cff-4197-b77f-7d0c650dd92a admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:19:52.939216 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1370/2758] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 14 10:19:52 2022] PUT /identity/v3/projects/c5f8922bb91240a2b1f63f306c6d09d1/users/5897368539ef4287bcba0c274c458491/roles/17dfac38a2e540fea229af7de99911bb => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:19:52.944558 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32f7809-d639-482e-a97e-8bd8fafc6a06 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:19:52.944851 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32f7809-d639-482e-a97e-8bd8fafc6a06 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:19:52.945133 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32f7809-d639-482e-a97e-8bd8fafc6a06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:19:52.962800 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-e32f7809-d639-482e-a97e-8bd8fafc6a06 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:19:52.964612 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-e32f7809-d639-482e-a97e-8bd8fafc6a06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:19:53.020864 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1389/2759] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 10:19:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:19:53.031091 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349d12c6-6cff-4197-b77f-7d0c650dd92a admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:19:53.032792 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-349d12c6-6cff-4197-b77f-7d0c650dd92a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:19:53.053946 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:19:53.091467 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349d12c6-6cff-4197-b77f-7d0c650dd92a admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:19:53.095074 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2d737f-c835-47de-87e3-fedd19e9eabb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e4a5a8965e4802a9055d332179b7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:19:53.095714 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2d737f-c835-47de-87e3-fedd19e9eabb service neutron] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:19:53.095997 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2d737f-c835-47de-87e3-fedd19e9eabb service neutron] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:19:53.096272 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2d737f-c835-47de-87e3-fedd19e9eabb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:19:53.105282 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2d737f-c835-47de-87e3-fedd19e9eabb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:19:53.106796 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2d737f-c835-47de-87e3-fedd19e9eabb service neutron] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:19:53.116047 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1371/2760] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 10:19:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:19:56.964439 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca6689c-d328-46f2-a290-10b1f974de39 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:19:56.964924 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca6689c-d328-46f2-a290-10b1f974de39 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:19:56.965040 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca6689c-d328-46f2-a290-10b1f974de39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:19:56.992543 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-6ca6689c-d328-46f2-a290-10b1f974de39 None None] MFA Rules not processed for user `5897368539ef4287bcba0c274c458491`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:19:56.994041 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-6ca6689c-d328-46f2-a290-10b1f974de39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:19:56.999602 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:19:57.069520 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1390/2761] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 10:19:56 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:19:57.074707 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2d737f-c835-47de-87e3-fedd19e9eabb service neutron] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:19:57.084679 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2d737f-c835-47de-87e3-fedd19e9eabb service neutron] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:19:57.089319 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0f4430-983a-499f-801f-9755b79c8efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:19:57.090012 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0f4430-983a-499f-801f-9755b79c8efc admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:19:57.090531 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0f4430-983a-499f-801f-9755b79c8efc admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:19:57.090814 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0f4430-983a-499f-801f-9755b79c8efc admin admin] PATH_INFO: `/v3/projects` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:19:57.091522 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0f4430-983a-499f-801f-9755b79c8efc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:19:57.093436 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0f4430-983a-499f-801f-9755b79c8efc admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:19:57.121339 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1372/2762] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 14 10:19:57 2022] POST /identity/v3/projects => generated 379 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:19:57.125381 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca6689c-d328-46f2-a290-10b1f974de39 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:19:57.136965 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca6689c-d328-46f2-a290-10b1f974de39 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:19:57.199609 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b64680a-660d-42b3-9bfb-56ea2bd5ff9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:19:57.200408 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b64680a-660d-42b3-9bfb-56ea2bd5ff9c admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:19:57.200810 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b64680a-660d-42b3-9bfb-56ea2bd5ff9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:19:57.201327 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b64680a-660d-42b3-9bfb-56ea2bd5ff9c admin admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:19:57.202241 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b64680a-660d-42b3-9bfb-56ea2bd5ff9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:19:57.204289 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b64680a-660d-42b3-9bfb-56ea2bd5ff9c admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:19:57.227519 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1391/2763] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 14 10:19:57 2022] POST /identity/v3/users => generated 296 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:19:57.231651 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0f4430-983a-499f-801f-9755b79c8efc admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:19:57.242324 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0f4430-983a-499f-801f-9755b79c8efc admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:19:57.247504 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf629958-2292-4a42-a1a3-61d5c1f5e28c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:19:57.248171 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf629958-2292-4a42-a1a3-61d5c1f5e28c admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:19:57.248458 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf629958-2292-4a42-a1a3-61d5c1f5e28c admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:19:57.248741 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf629958-2292-4a42-a1a3-61d5c1f5e28c admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:19:57.249477 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf629958-2292-4a42-a1a3-61d5c1f5e28c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:19:57.251130 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf629958-2292-4a42-a1a3-61d5c1f5e28c admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:19:57.262860 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1373/2764] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 10:19:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:19:57.267074 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b64680a-660d-42b3-9bfb-56ea2bd5ff9c admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:19:57.277400 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b64680a-660d-42b3-9bfb-56ea2bd5ff9c admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:19:57.282017 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00b3d22-0e11-42ad-95a4-1c8cb2571cdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:19:57.282942 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00b3d22-0e11-42ad-95a4-1c8cb2571cdf admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:19:57.283230 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00b3d22-0e11-42ad-95a4-1c8cb2571cdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:19:57.283510 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00b3d22-0e11-42ad-95a4-1c8cb2571cdf admin admin] PATH_INFO: `/v3/projects/4ef18c44281e49c9b209c26613da24c7/users/929deac4154e45dea929ffb9d4ddbee5/roles/e3965bd0d5f1427a86a313c0c90bfef3` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:19:57.299540 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00b3d22-0e11-42ad-95a4-1c8cb2571cdf admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ef18c44281e49c9b209c26613da24c7, user_id=929deac4154e45dea929ffb9d4ddbee5, role_id=e3965bd0d5f1427a86a313c0c90bfef3)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:19:57.302251 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00b3d22-0e11-42ad-95a4-1c8cb2571cdf admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:19:57.317245 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1392/2765] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 14 10:19:57 2022] PUT /identity/v3/projects/4ef18c44281e49c9b209c26613da24c7/users/929deac4154e45dea929ffb9d4ddbee5/roles/e3965bd0d5f1427a86a313c0c90bfef3 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:19:57.320915 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf629958-2292-4a42-a1a3-61d5c1f5e28c admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:19:57.331844 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf629958-2292-4a42-a1a3-61d5c1f5e28c admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:19:57.388043 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d3e50c-b5f8-4c8e-878c-b00e8785ea5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:19:57.388640 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d3e50c-b5f8-4c8e-878c-b00e8785ea5b admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:19:57.388928 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d3e50c-b5f8-4c8e-878c-b00e8785ea5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:19:57.389208 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d3e50c-b5f8-4c8e-878c-b00e8785ea5b admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:19:57.389937 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d3e50c-b5f8-4c8e-878c-b00e8785ea5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:19:57.391565 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d3e50c-b5f8-4c8e-878c-b00e8785ea5b admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:19:57.401128 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1374/2766] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 10:19:57 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:19:57.405792 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00b3d22-0e11-42ad-95a4-1c8cb2571cdf admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:19:57.416277 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00b3d22-0e11-42ad-95a4-1c8cb2571cdf admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:19:57.421310 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36859a1d-e41b-4636-8b74-50144cf51a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:19:57.422209 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36859a1d-e41b-4636-8b74-50144cf51a71 admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:19:57.422511 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36859a1d-e41b-4636-8b74-50144cf51a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:19:57.422786 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36859a1d-e41b-4636-8b74-50144cf51a71 admin admin] PATH_INFO: `/v3/projects/4ef18c44281e49c9b209c26613da24c7/users/929deac4154e45dea929ffb9d4ddbee5/roles/e3965bd0d5f1427a86a313c0c90bfef3` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:19:57.424749 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36859a1d-e41b-4636-8b74-50144cf51a71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ef18c44281e49c9b209c26613da24c7, user_id=929deac4154e45dea929ffb9d4ddbee5, role_id=e3965bd0d5f1427a86a313c0c90bfef3)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:19:57.427421 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36859a1d-e41b-4636-8b74-50144cf51a71 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:19:57.438279 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1393/2767] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 14 10:19:57 2022] PUT /identity/v3/projects/4ef18c44281e49c9b209c26613da24c7/users/929deac4154e45dea929ffb9d4ddbee5/roles/e3965bd0d5f1427a86a313c0c90bfef3 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:20:01.974895 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832fc8c9-a77e-4233-ace9-519b727e6aeb None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:20:01.975367 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832fc8c9-a77e-4233-ace9-519b727e6aeb None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:20:01.976702 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832fc8c9-a77e-4233-ace9-519b727e6aeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:20:02.023658 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-832fc8c9-a77e-4233-ace9-519b727e6aeb None None] MFA Rules not processed for user `929deac4154e45dea929ffb9d4ddbee5`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:20:02.024915 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-832fc8c9-a77e-4233-ace9-519b727e6aeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:20:02.201527 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1375/2768] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 10:20:01 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:20:02.223430 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36859a1d-e41b-4636-8b74-50144cf51a71 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:20:02.225176 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-36859a1d-e41b-4636-8b74-50144cf51a71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:20:02.297706 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:20:02.317869 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36859a1d-e41b-4636-8b74-50144cf51a71 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:20:02.323847 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698a4d41-96cd-40d9-9e97-4c4084224bf4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f6962106dfa4c4c9af551053f8095e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:20:02.324524 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698a4d41-96cd-40d9-9e97-4c4084224bf4 service nova] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:20:02.324814 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698a4d41-96cd-40d9-9e97-4c4084224bf4 service nova] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:20:02.325095 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698a4d41-96cd-40d9-9e97-4c4084224bf4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:20:02.395495 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698a4d41-96cd-40d9-9e97-4c4084224bf4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:20:02.397092 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698a4d41-96cd-40d9-9e97-4c4084224bf4 service nova] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:20:02.408408 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1394/2769] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 10:20:02 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:20:05.329912 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832fc8c9-a77e-4233-ace9-519b727e6aeb None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:20:05.331898 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-832fc8c9-a77e-4233-ace9-519b727e6aeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:20:05.345027 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:20:05.393096 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832fc8c9-a77e-4233-ace9-519b727e6aeb None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:20:05.397342 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d5e801-eada-411c-80ab-bda2444b9a8b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25048b29787d482783ebc944f1a7df65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:20:05.398001 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d5e801-eada-411c-80ab-bda2444b9a8b service cinder] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:20:05.398346 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d5e801-eada-411c-80ab-bda2444b9a8b service cinder] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:20:05.398630 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d5e801-eada-411c-80ab-bda2444b9a8b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:20:05.400423 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-c5d5e801-eada-411c-80ab-bda2444b9a8b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:20:05.414603 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d5e801-eada-411c-80ab-bda2444b9a8b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:20:05.416329 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d5e801-eada-411c-80ab-bda2444b9a8b service cinder] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:20:05.428684 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1376/2770] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 10:20:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 10:20:12.403635 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=29 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:20:15.423372 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=21 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:20:19.423314 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698a4d41-96cd-40d9-9e97-4c4084224bf4 service nova] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:20:19.447779 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698a4d41-96cd-40d9-9e97-4c4084224bf4 service nova] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:20:19.454035 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9906f319-bdfd-4665-bc45-910db2fab536 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f6962106dfa4c4c9af551053f8095e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:20:19.454890 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9906f319-bdfd-4665-bc45-910db2fab536 service nova] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:20:19.455930 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9906f319-bdfd-4665-bc45-910db2fab536 service nova] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:20:19.455930 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9906f319-bdfd-4665-bc45-910db2fab536 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:20:19.457673 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-9906f319-bdfd-4665-bc45-910db2fab536 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:20:19.474906 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9906f319-bdfd-4665-bc45-910db2fab536 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:20:19.476862 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9906f319-bdfd-4665-bc45-910db2fab536 service nova] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:20:19.492685 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1395/2771] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 10:20:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:20:24.750377 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d5e801-eada-411c-80ab-bda2444b9a8b service cinder] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:20:24.751857 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-c5d5e801-eada-411c-80ab-bda2444b9a8b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:20:24.807575 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d5e801-eada-411c-80ab-bda2444b9a8b service cinder] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:20:24.811257 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e763784f-db40-4354-8ad9-5deb4d8b563c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e4a5a8965e4802a9055d332179b7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:20:24.811845 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e763784f-db40-4354-8ad9-5deb4d8b563c service neutron] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:20:24.812130 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e763784f-db40-4354-8ad9-5deb4d8b563c service neutron] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:20:24.812405 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e763784f-db40-4354-8ad9-5deb4d8b563c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:20:24.814164 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-e763784f-db40-4354-8ad9-5deb4d8b563c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:20:24.878625 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e763784f-db40-4354-8ad9-5deb4d8b563c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:20:24.880069 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e763784f-db40-4354-8ad9-5deb4d8b563c service neutron] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:20:24.889569 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1377/2772] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 10:20:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:20:27.962977 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9906f319-bdfd-4665-bc45-910db2fab536 service nova] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:20:27.965674 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-9906f319-bdfd-4665-bc45-910db2fab536 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:20:27.981522 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9906f319-bdfd-4665-bc45-910db2fab536 service nova] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:20:27.986148 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57c8486-c68f-4411-8136-4d40ef321b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:20:27.987122 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57c8486-c68f-4411-8136-4d40ef321b4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:20:27.987399 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57c8486-c68f-4411-8136-4d40ef321b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:20:27.987678 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57c8486-c68f-4411-8136-4d40ef321b4b admin admin] PATH_INFO: `/v3/users/1d7ae3d2f56a491baf26a83a34d86ccf` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:20:28.004302 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57c8486-c68f-4411-8136-4d40ef321b4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d7ae3d2f56a491baf26a83a34d86ccf)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:20:28.006263 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57c8486-c68f-4411-8136-4d40ef321b4b admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:20:28.060481 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-c57c8486-c68f-4411-8136-4d40ef321b4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d7ae3d2f56a491baf26a83a34d86ccf'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:20:28.070894 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e616ffd0-bea8-429a-be16-3aed74f988ff None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:20:28.071399 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e616ffd0-bea8-429a-be16-3aed74f988ff None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:20:28.071589 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e616ffd0-bea8-429a-be16-3aed74f988ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:20:28.082531 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-c57c8486-c68f-4411-8136-4d40ef321b4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d7ae3d2f56a491baf26a83a34d86ccf'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:20:28.083273 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-c57c8486-c68f-4411-8136-4d40ef321b4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d7ae3d2f56a491baf26a83a34d86ccf'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:20:28.091950 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-e616ffd0-bea8-429a-be16-3aed74f988ff None None] MFA Rules not processed for user `5897368539ef4287bcba0c274c458491`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:20:28.092988 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-c57c8486-c68f-4411-8136-4d40ef321b4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d7ae3d2f56a491baf26a83a34d86ccf'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:20:28.093187 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-e616ffd0-bea8-429a-be16-3aed74f988ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:20:28.101327 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-c57c8486-c68f-4411-8136-4d40ef321b4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d7ae3d2f56a491baf26a83a34d86ccf'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:20:28.101480 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1378/2773] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 10:20:28 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:20:28.108716 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1396/2774] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 14 10:20:27 2022] DELETE /identity/v3/users/1d7ae3d2f56a491baf26a83a34d86ccf => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:20:28.403194 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e616ffd0-bea8-429a-be16-3aed74f988ff None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:20:28.414716 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e616ffd0-bea8-429a-be16-3aed74f988ff None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:20:28.487982 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa13f8af-57f5-422d-8fa0-00c646bfe597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:20:28.488848 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa13f8af-57f5-422d-8fa0-00c646bfe597 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:20:28.489130 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa13f8af-57f5-422d-8fa0-00c646bfe597 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:20:28.489405 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa13f8af-57f5-422d-8fa0-00c646bfe597 admin admin] PATH_INFO: `/v3/projects/52acfca03c3e45cfb2e8d3d4f391b281` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:20:28.490636 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa13f8af-57f5-422d-8fa0-00c646bfe597 admin admin] RBAC: Authorizing `identity:delete_project(project_id=52acfca03c3e45cfb2e8d3d4f391b281)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:20:28.492534 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa13f8af-57f5-422d-8fa0-00c646bfe597 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:20:28.540375 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:20:28.542942 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-fa13f8af-57f5-422d-8fa0-00c646bfe597 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52acfca03c3e45cfb2e8d3d4f391b281', 'request_id': 'req-fa13f8af-57f5-422d-8fa0-00c646bfe597'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:20:28.552661 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-fa13f8af-57f5-422d-8fa0-00c646bfe597 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52acfca03c3e45cfb2e8d3d4f391b281', 'request_id': 'req-fa13f8af-57f5-422d-8fa0-00c646bfe597'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:20:28.562819 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-fa13f8af-57f5-422d-8fa0-00c646bfe597 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52acfca03c3e45cfb2e8d3d4f391b281', 'request_id': 'req-fa13f8af-57f5-422d-8fa0-00c646bfe597'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:20:28.575025 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-fa13f8af-57f5-422d-8fa0-00c646bfe597 admin admin] The token cache is being invalidate because project 52acfca03c3e45cfb2e8d3d4f391b281 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:20:28.575321 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-fa13f8af-57f5-422d-8fa0-00c646bfe597 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:20:28.575972 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-fa13f8af-57f5-422d-8fa0-00c646bfe597 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:20:28.577498 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1379/2775] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 14 10:20:28 2022] DELETE /identity/v3/projects/52acfca03c3e45cfb2e8d3d4f391b281 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:20:28.582477 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5033f4-f121-4a49-a5e9-24c665628956 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:20:28.582974 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5033f4-f121-4a49-a5e9-24c665628956 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:20:28.583259 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5033f4-f121-4a49-a5e9-24c665628956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:20:28.602170 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-db5033f4-f121-4a49-a5e9-24c665628956 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:20:28.603797 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-db5033f4-f121-4a49-a5e9-24c665628956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:20:28.670341 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1397/2776] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 10:20:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:20:28.672170 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebabaa9b-8a4c-47dc-89e1-2fab502068da None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:20:28.672523 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebabaa9b-8a4c-47dc-89e1-2fab502068da None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:20:28.673457 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebabaa9b-8a4c-47dc-89e1-2fab502068da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:20:28.691773 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-ebabaa9b-8a4c-47dc-89e1-2fab502068da None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:20:28.693620 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-ebabaa9b-8a4c-47dc-89e1-2fab502068da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:20:28.702941 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1380/2777] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 10:20:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 10:20:28.707819 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5033f4-f121-4a49-a5e9-24c665628956 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:20:28.717589 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5033f4-f121-4a49-a5e9-24c665628956 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:20:28.723000 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17a51b9-799f-48d5-9f03-fa31402acb78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:20:28.723762 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17a51b9-799f-48d5-9f03-fa31402acb78 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:20:28.724120 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17a51b9-799f-48d5-9f03-fa31402acb78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:20:28.724465 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17a51b9-799f-48d5-9f03-fa31402acb78 admin admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:20:28.725308 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17a51b9-799f-48d5-9f03-fa31402acb78 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:20:28.725884 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17a51b9-799f-48d5-9f03-fa31402acb78 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:20:28.727644 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17a51b9-799f-48d5-9f03-fa31402acb78 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:20:28.739559 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1398/2778] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jul 14 10:20:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:20:28.744258 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebabaa9b-8a4c-47dc-89e1-2fab502068da None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:20:28.754542 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebabaa9b-8a4c-47dc-89e1-2fab502068da None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:20:28.761735 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3221c32-fb11-4f4e-be7a-511cc470b262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:20:28.762468 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3221c32-fb11-4f4e-be7a-511cc470b262 admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:20:28.762761 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3221c32-fb11-4f4e-be7a-511cc470b262 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:20:28.763076 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3221c32-fb11-4f4e-be7a-511cc470b262 admin admin] PATH_INFO: `/v3/projects` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:20:28.763924 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3221c32-fb11-4f4e-be7a-511cc470b262 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:20:28.765892 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3221c32-fb11-4f4e-be7a-511cc470b262 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:20:28.797479 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1381/2779] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 14 10:20:28 2022] POST /identity/v3/projects => generated 367 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 10:20:28.799364 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17a51b9-799f-48d5-9f03-fa31402acb78 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:20:28.809879 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17a51b9-799f-48d5-9f03-fa31402acb78 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:20:28.847790 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:20:28.875678 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6a0fc9-c1e6-4bb8-be40-bf3e1e4947ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:20:28.877065 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6a0fc9-c1e6-4bb8-be40-bf3e1e4947ea admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:20:28.877376 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6a0fc9-c1e6-4bb8-be40-bf3e1e4947ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:20:28.877652 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6a0fc9-c1e6-4bb8-be40-bf3e1e4947ea admin admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:20:28.878507 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6a0fc9-c1e6-4bb8-be40-bf3e1e4947ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:20:28.880425 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6a0fc9-c1e6-4bb8-be40-bf3e1e4947ea admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:20:28.906231 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1399/2780] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 14 10:20:28 2022] POST /identity/v3/users => generated 284 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:20:28.911759 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3221c32-fb11-4f4e-be7a-511cc470b262 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:20:28.923750 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3221c32-fb11-4f4e-be7a-511cc470b262 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:20:28.928942 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e61372-8490-4277-94d8-b8a019f12ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:20:28.929643 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e61372-8490-4277-94d8-b8a019f12ceb admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:20:28.929922 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e61372-8490-4277-94d8-b8a019f12ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:20:28.930218 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e61372-8490-4277-94d8-b8a019f12ceb admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:20:28.930973 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e61372-8490-4277-94d8-b8a019f12ceb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:20:28.932562 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e61372-8490-4277-94d8-b8a019f12ceb admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:20:28.947609 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1382/2781] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 10:20:28 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:20:28.949181 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6a0fc9-c1e6-4bb8-be40-bf3e1e4947ea admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:20:28.961474 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6a0fc9-c1e6-4bb8-be40-bf3e1e4947ea admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:20:28.966477 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89342c57-8e5e-43f8-a381-25319a845582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:20:28.967602 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89342c57-8e5e-43f8-a381-25319a845582 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:20:28.967882 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89342c57-8e5e-43f8-a381-25319a845582 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:20:28.968153 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89342c57-8e5e-43f8-a381-25319a845582 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:20:28.968896 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89342c57-8e5e-43f8-a381-25319a845582 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:20:28.971202 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89342c57-8e5e-43f8-a381-25319a845582 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:20:28.982875 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1400/2782] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 10:20:28 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:20:28.987006 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e61372-8490-4277-94d8-b8a019f12ceb admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:20:28.997691 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e61372-8490-4277-94d8-b8a019f12ceb admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:20:29.003776 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477d1e94-047f-4764-923f-5736a23d6c24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:20:29.004880 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477d1e94-047f-4764-923f-5736a23d6c24 admin admin] REQUEST_METHOD: `PUT` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:20:29.005174 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477d1e94-047f-4764-923f-5736a23d6c24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:20:29.005463 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477d1e94-047f-4764-923f-5736a23d6c24 admin admin] PATH_INFO: `/v3/projects/f0fe3e3d2f3a415688e808ab87faa5ae/users/6ba2241898bd4212ba17ac4637894a5e/roles/17dfac38a2e540fea229af7de99911bb` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:20:29.021509 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477d1e94-047f-4764-923f-5736a23d6c24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0fe3e3d2f3a415688e808ab87faa5ae, user_id=6ba2241898bd4212ba17ac4637894a5e, role_id=17dfac38a2e540fea229af7de99911bb)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:20:29.024263 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477d1e94-047f-4764-923f-5736a23d6c24 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:20:29.037749 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1383/2783] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 14 10:20:28 2022] PUT /identity/v3/projects/f0fe3e3d2f3a415688e808ab87faa5ae/users/6ba2241898bd4212ba17ac4637894a5e/roles/17dfac38a2e540fea229af7de99911bb => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:20:29.047727 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755b888d-6ee4-43bb-8651-6040fcca1dc4 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:20:29.048026 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755b888d-6ee4-43bb-8651-6040fcca1dc4 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:20:29.048309 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755b888d-6ee4-43bb-8651-6040fcca1dc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:20:29.076478 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-755b888d-6ee4-43bb-8651-6040fcca1dc4 None None] MFA Rules not processed for user `6ba2241898bd4212ba17ac4637894a5e`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:20:29.077703 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-755b888d-6ee4-43bb-8651-6040fcca1dc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:20:29.147825 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1401/2784] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 10:20:29 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:20:29.152098 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477d1e94-047f-4764-923f-5736a23d6c24 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:20:29.217797 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477d1e94-047f-4764-923f-5736a23d6c24 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:20:29.222499 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b51f06-63b5-4f3f-9f2f-ebc2d55ecca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:20:29.223165 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b51f06-63b5-4f3f-9f2f-ebc2d55ecca1 admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:20:29.223448 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b51f06-63b5-4f3f-9f2f-ebc2d55ecca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:20:29.223724 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b51f06-63b5-4f3f-9f2f-ebc2d55ecca1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:20:29.224422 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b51f06-63b5-4f3f-9f2f-ebc2d55ecca1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:20:29.226438 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b51f06-63b5-4f3f-9f2f-ebc2d55ecca1 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:20:29.252963 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1384/2785] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 14 10:20:29 2022] POST /identity/v3/projects => generated 369 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:20:29.256766 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755b888d-6ee4-43bb-8651-6040fcca1dc4 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:20:29.268088 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755b888d-6ee4-43bb-8651-6040fcca1dc4 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:20:29.326696 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245844a7-673b-4023-845e-07f0b7c065a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:20:29.327374 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245844a7-673b-4023-845e-07f0b7c065a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:20:29.327662 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245844a7-673b-4023-845e-07f0b7c065a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:20:29.327941 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245844a7-673b-4023-845e-07f0b7c065a3 admin admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:20:29.328676 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245844a7-673b-4023-845e-07f0b7c065a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:20:29.331427 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245844a7-673b-4023-845e-07f0b7c065a3 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:20:29.351752 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1402/2786] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 14 10:20:29 2022] POST /identity/v3/users => generated 291 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:20:29.355881 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b51f06-63b5-4f3f-9f2f-ebc2d55ecca1 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:20:29.366314 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b51f06-63b5-4f3f-9f2f-ebc2d55ecca1 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:20:29.371099 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd0b5c1-f4f4-4c3c-b07d-5ece03660267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:20:29.371861 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd0b5c1-f4f4-4c3c-b07d-5ece03660267 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:20:29.372223 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd0b5c1-f4f4-4c3c-b07d-5ece03660267 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:20:29.372582 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd0b5c1-f4f4-4c3c-b07d-5ece03660267 admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:20:29.373395 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd0b5c1-f4f4-4c3c-b07d-5ece03660267 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:20:29.375126 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd0b5c1-f4f4-4c3c-b07d-5ece03660267 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:20:29.386742 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1385/2787] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 10:20:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 10:20:29.390924 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245844a7-673b-4023-845e-07f0b7c065a3 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:20:29.402148 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245844a7-673b-4023-845e-07f0b7c065a3 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:20:29.407118 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70592812-ee66-408c-af6a-c9fa3a146c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:20:29.408067 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70592812-ee66-408c-af6a-c9fa3a146c88 admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:20:29.408353 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70592812-ee66-408c-af6a-c9fa3a146c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:20:29.408634 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70592812-ee66-408c-af6a-c9fa3a146c88 admin admin] PATH_INFO: `/v3/projects/ad6161968bf24626856688678e0d6710/users/c6537850cc9b406badd6005339b26dce/roles/e3965bd0d5f1427a86a313c0c90bfef3` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:20:29.424058 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70592812-ee66-408c-af6a-c9fa3a146c88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad6161968bf24626856688678e0d6710, user_id=c6537850cc9b406badd6005339b26dce, role_id=e3965bd0d5f1427a86a313c0c90bfef3)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:20:29.426752 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70592812-ee66-408c-af6a-c9fa3a146c88 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:20:29.439441 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1403/2788] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 14 10:20:29 2022] PUT /identity/v3/projects/ad6161968bf24626856688678e0d6710/users/c6537850cc9b406badd6005339b26dce/roles/e3965bd0d5f1427a86a313c0c90bfef3 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:20:29.443852 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd0b5c1-f4f4-4c3c-b07d-5ece03660267 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:20:29.454738 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd0b5c1-f4f4-4c3c-b07d-5ece03660267 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:20:29.497602 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:20:29.514874 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c98c31-8689-4b81-93c3-f87d373143c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:20:29.515556 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c98c31-8689-4b81-93c3-f87d373143c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:20:29.515847 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c98c31-8689-4b81-93c3-f87d373143c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:20:29.516129 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c98c31-8689-4b81-93c3-f87d373143c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:20:29.517460 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c98c31-8689-4b81-93c3-f87d373143c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:20:29.519101 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c98c31-8689-4b81-93c3-f87d373143c7 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:20:29.530626 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1386/2789] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 10:20:29 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:20:29.534761 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70592812-ee66-408c-af6a-c9fa3a146c88 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:20:29.546671 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70592812-ee66-408c-af6a-c9fa3a146c88 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:20:29.551921 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26970f16-8c54-4183-b8fa-0f182aa5c09b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:20:29.552803 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26970f16-8c54-4183-b8fa-0f182aa5c09b admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:20:29.553089 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26970f16-8c54-4183-b8fa-0f182aa5c09b admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:20:29.553367 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26970f16-8c54-4183-b8fa-0f182aa5c09b admin admin] PATH_INFO: `/v3/projects/ad6161968bf24626856688678e0d6710/users/c6537850cc9b406badd6005339b26dce/roles/e3965bd0d5f1427a86a313c0c90bfef3` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:20:29.555378 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26970f16-8c54-4183-b8fa-0f182aa5c09b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad6161968bf24626856688678e0d6710, user_id=c6537850cc9b406badd6005339b26dce, role_id=e3965bd0d5f1427a86a313c0c90bfef3)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:20:29.558010 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26970f16-8c54-4183-b8fa-0f182aa5c09b admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:20:29.561343 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:20:29.570850 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1404/2790] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 14 10:20:29 2022] PUT /identity/v3/projects/ad6161968bf24626856688678e0d6710/users/c6537850cc9b406badd6005339b26dce/roles/e3965bd0d5f1427a86a313c0c90bfef3 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:20:29.580920 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9eeda6-0959-40d4-bb07-fadeaccae4e1 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:20:29.581223 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9eeda6-0959-40d4-bb07-fadeaccae4e1 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:20:29.581509 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9eeda6-0959-40d4-bb07-fadeaccae4e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:20:29.607287 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-2f9eeda6-0959-40d4-bb07-fadeaccae4e1 None None] MFA Rules not processed for user `c6537850cc9b406badd6005339b26dce`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:20:29.608506 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-2f9eeda6-0959-40d4-bb07-fadeaccae4e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:20:29.675495 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1387/2791] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 10:20:29 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:20:29.686801 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26970f16-8c54-4183-b8fa-0f182aa5c09b admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:20:29.689195 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-26970f16-8c54-4183-b8fa-0f182aa5c09b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:20:29.746921 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26970f16-8c54-4183-b8fa-0f182aa5c09b admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:20:29.750627 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8823f3af-9802-4219-9ef0-00a8b496c319 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25048b29787d482783ebc944f1a7df65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:20:29.751828 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8823f3af-9802-4219-9ef0-00a8b496c319 service cinder] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:20:29.752712 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8823f3af-9802-4219-9ef0-00a8b496c319 service cinder] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:20:29.752999 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8823f3af-9802-4219-9ef0-00a8b496c319 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:20:29.763560 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8823f3af-9802-4219-9ef0-00a8b496c319 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:20:29.765010 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8823f3af-9802-4219-9ef0-00a8b496c319 service cinder] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:20:29.775334 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1405/2792] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 10:20:29 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:20:29.819724 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9eeda6-0959-40d4-bb07-fadeaccae4e1 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:20:29.821233 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-2f9eeda6-0959-40d4-bb07-fadeaccae4e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:20:29.833929 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9eeda6-0959-40d4-bb07-fadeaccae4e1 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:20:29.838838 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27473850-3774-456a-a361-bd524f6a48bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25048b29787d482783ebc944f1a7df65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:20:29.839655 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27473850-3774-456a-a361-bd524f6a48bb service cinder] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:20:29.840046 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27473850-3774-456a-a361-bd524f6a48bb service cinder] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:20:29.840401 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27473850-3774-456a-a361-bd524f6a48bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:20:29.901128 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27473850-3774-456a-a361-bd524f6a48bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:20:29.902712 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27473850-3774-456a-a361-bd524f6a48bb service cinder] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:20:29.914138 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1388/2793] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 10:20:29 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:20:33.321311 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8823f3af-9802-4219-9ef0-00a8b496c319 service cinder] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:20:33.383483 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8823f3af-9802-4219-9ef0-00a8b496c319 service cinder] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:20:33.388140 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d1c62d-b1a3-4ed3-8738-1b2e3b01cc9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:20:33.389076 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d1c62d-b1a3-4ed3-8738-1b2e3b01cc9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:20:33.389362 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d1c62d-b1a3-4ed3-8738-1b2e3b01cc9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:20:33.389640 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d1c62d-b1a3-4ed3-8738-1b2e3b01cc9d admin admin] PATH_INFO: `/v3/users/6ba2241898bd4212ba17ac4637894a5e` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:20:33.390895 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d1c62d-b1a3-4ed3-8738-1b2e3b01cc9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ba2241898bd4212ba17ac4637894a5e)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:20:33.392826 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d1c62d-b1a3-4ed3-8738-1b2e3b01cc9d admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:20:33.441944 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-43d1c62d-b1a3-4ed3-8738-1b2e3b01cc9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ba2241898bd4212ba17ac4637894a5e'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:20:33.454544 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-43d1c62d-b1a3-4ed3-8738-1b2e3b01cc9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ba2241898bd4212ba17ac4637894a5e'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:20:33.455331 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-43d1c62d-b1a3-4ed3-8738-1b2e3b01cc9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ba2241898bd4212ba17ac4637894a5e'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:20:33.463476 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-43d1c62d-b1a3-4ed3-8738-1b2e3b01cc9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ba2241898bd4212ba17ac4637894a5e'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:20:33.470512 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-43d1c62d-b1a3-4ed3-8738-1b2e3b01cc9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ba2241898bd4212ba17ac4637894a5e'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:20:33.476914 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1406/2794] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 14 10:20:33 2022] DELETE /identity/v3/users/6ba2241898bd4212ba17ac4637894a5e => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:20:33.481575 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73132414-5a06-412c-bffb-9ab09e89591e None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:20:33.482042 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73132414-5a06-412c-bffb-9ab09e89591e None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:20:33.482143 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73132414-5a06-412c-bffb-9ab09e89591e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:20:33.499489 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-73132414-5a06-412c-bffb-9ab09e89591e None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:20:33.500689 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-73132414-5a06-412c-bffb-9ab09e89591e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:20:33.574775 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1389/2795] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 10:20:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:20:33.584424 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d1c62d-b1a3-4ed3-8738-1b2e3b01cc9d admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:20:33.585946 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-43d1c62d-b1a3-4ed3-8738-1b2e3b01cc9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:20:33.607262 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:20:33.648574 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d1c62d-b1a3-4ed3-8738-1b2e3b01cc9d admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:20:33.652436 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5585a60b-1fbd-42cb-82f5-4957328cf361 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e4a5a8965e4802a9055d332179b7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:20:33.653099 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5585a60b-1fbd-42cb-82f5-4957328cf361 service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:20:33.653512 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5585a60b-1fbd-42cb-82f5-4957328cf361 service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:20:33.653795 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5585a60b-1fbd-42cb-82f5-4957328cf361 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:20:33.663917 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5585a60b-1fbd-42cb-82f5-4957328cf361 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:20:33.665397 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5585a60b-1fbd-42cb-82f5-4957328cf361 service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:20:33.676361 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1407/2796] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 10:20:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 10:20:33.947500 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73132414-5a06-412c-bffb-9ab09e89591e None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:20:33.949018 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-73132414-5a06-412c-bffb-9ab09e89591e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:20:33.957375 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:20:33.961308 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73132414-5a06-412c-bffb-9ab09e89591e None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:20:33.966874 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be3d4f5-f7ab-4472-a6ba-f9744e14fa66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:20:33.967781 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be3d4f5-f7ab-4472-a6ba-f9744e14fa66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:20:33.968069 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be3d4f5-f7ab-4472-a6ba-f9744e14fa66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:20:33.968354 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be3d4f5-f7ab-4472-a6ba-f9744e14fa66 admin admin] PATH_INFO: `/v3/projects/f0fe3e3d2f3a415688e808ab87faa5ae` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:20:33.971385 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be3d4f5-f7ab-4472-a6ba-f9744e14fa66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0fe3e3d2f3a415688e808ab87faa5ae)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:20:33.973270 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be3d4f5-f7ab-4472-a6ba-f9744e14fa66 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:20:34.023687 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-7be3d4f5-f7ab-4472-a6ba-f9744e14fa66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0fe3e3d2f3a415688e808ab87faa5ae', 'request_id': 'req-7be3d4f5-f7ab-4472-a6ba-f9744e14fa66'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:20:34.031227 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-7be3d4f5-f7ab-4472-a6ba-f9744e14fa66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0fe3e3d2f3a415688e808ab87faa5ae', 'request_id': 'req-7be3d4f5-f7ab-4472-a6ba-f9744e14fa66'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:20:34.037551 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-7be3d4f5-f7ab-4472-a6ba-f9744e14fa66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0fe3e3d2f3a415688e808ab87faa5ae', 'request_id': 'req-7be3d4f5-f7ab-4472-a6ba-f9744e14fa66'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:20:34.048557 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-7be3d4f5-f7ab-4472-a6ba-f9744e14fa66 admin admin] The token cache is being invalidate because project f0fe3e3d2f3a415688e808ab87faa5ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:20:34.048846 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-7be3d4f5-f7ab-4472-a6ba-f9744e14fa66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:20:34.049472 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-7be3d4f5-f7ab-4472-a6ba-f9744e14fa66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:20:34.051052 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1390/2797] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 14 10:20:33 2022] DELETE /identity/v3/projects/f0fe3e3d2f3a415688e808ab87faa5ae => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:20:34.055184 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5585a60b-1fbd-42cb-82f5-4957328cf361 service neutron] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:20:34.064826 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5585a60b-1fbd-42cb-82f5-4957328cf361 service neutron] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:20:34.120131 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2480743f-394c-44d4-8e09-092d0a0a1b21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:20:34.120936 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2480743f-394c-44d4-8e09-092d0a0a1b21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:20:34.121227 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2480743f-394c-44d4-8e09-092d0a0a1b21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:20:34.121507 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2480743f-394c-44d4-8e09-092d0a0a1b21 admin admin] PATH_INFO: `/v3/users/c6537850cc9b406badd6005339b26dce` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:20:34.122769 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2480743f-394c-44d4-8e09-092d0a0a1b21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6537850cc9b406badd6005339b26dce)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:20:34.124677 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2480743f-394c-44d4-8e09-092d0a0a1b21 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:20:34.168908 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-2480743f-394c-44d4-8e09-092d0a0a1b21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6537850cc9b406badd6005339b26dce'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:20:34.180644 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-2480743f-394c-44d4-8e09-092d0a0a1b21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6537850cc9b406badd6005339b26dce'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:20:34.181309 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-2480743f-394c-44d4-8e09-092d0a0a1b21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6537850cc9b406badd6005339b26dce'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:20:34.188556 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-2480743f-394c-44d4-8e09-092d0a0a1b21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6537850cc9b406badd6005339b26dce'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:20:34.195825 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-2480743f-394c-44d4-8e09-092d0a0a1b21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6537850cc9b406badd6005339b26dce'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:20:34.201771 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1408/2798] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 14 10:20:34 2022] DELETE /identity/v3/users/c6537850cc9b406badd6005339b26dce => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:20:34.473317 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be3d4f5-f7ab-4472-a6ba-f9744e14fa66 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:20:34.474961 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-7be3d4f5-f7ab-4472-a6ba-f9744e14fa66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:20:34.487833 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be3d4f5-f7ab-4472-a6ba-f9744e14fa66 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:20:34.544868 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322c0d1d-9a9d-4343-8dc8-7cc75e067b0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:20:34.545737 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322c0d1d-9a9d-4343-8dc8-7cc75e067b0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:20:34.546027 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322c0d1d-9a9d-4343-8dc8-7cc75e067b0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:20:34.546357 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322c0d1d-9a9d-4343-8dc8-7cc75e067b0d admin admin] PATH_INFO: `/v3/projects/ad6161968bf24626856688678e0d6710` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:20:34.547570 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322c0d1d-9a9d-4343-8dc8-7cc75e067b0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad6161968bf24626856688678e0d6710)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:20:34.549508 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322c0d1d-9a9d-4343-8dc8-7cc75e067b0d admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:20:34.595719 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-322c0d1d-9a9d-4343-8dc8-7cc75e067b0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad6161968bf24626856688678e0d6710', 'request_id': 'req-322c0d1d-9a9d-4343-8dc8-7cc75e067b0d'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:20:34.602746 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-322c0d1d-9a9d-4343-8dc8-7cc75e067b0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad6161968bf24626856688678e0d6710', 'request_id': 'req-322c0d1d-9a9d-4343-8dc8-7cc75e067b0d'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:20:34.608302 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-322c0d1d-9a9d-4343-8dc8-7cc75e067b0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad6161968bf24626856688678e0d6710', 'request_id': 'req-322c0d1d-9a9d-4343-8dc8-7cc75e067b0d'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:20:34.619191 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-322c0d1d-9a9d-4343-8dc8-7cc75e067b0d admin admin] The token cache is being invalidate because project ad6161968bf24626856688678e0d6710 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:20:34.619482 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-322c0d1d-9a9d-4343-8dc8-7cc75e067b0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:20:34.620134 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-322c0d1d-9a9d-4343-8dc8-7cc75e067b0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:20:34.621663 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1391/2799] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 14 10:20:34 2022] DELETE /identity/v3/projects/ad6161968bf24626856688678e0d6710 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:20:34.627253 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e27385-641a-4753-9d87-c5e74468c722 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:20:34.627712 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e27385-641a-4753-9d87-c5e74468c722 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:20:34.627796 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e27385-641a-4753-9d87-c5e74468c722 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:20:34.646423 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-04e27385-641a-4753-9d87-c5e74468c722 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:20:34.647599 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-04e27385-641a-4753-9d87-c5e74468c722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:20:34.679650 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:20:34.707270 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1409/2800] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 10:20:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:20:34.716530 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3b447c-4d8a-4330-bac8-b927c18b4297 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:20:34.716820 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3b447c-4d8a-4330-bac8-b927c18b4297 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:20:34.717100 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3b447c-4d8a-4330-bac8-b927c18b4297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:20:34.735051 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-4a3b447c-4d8a-4330-bac8-b927c18b4297 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:20:34.736286 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-4a3b447c-4d8a-4330-bac8-b927c18b4297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:20:34.744182 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1392/2801] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 10:20:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:20:34.748302 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e27385-641a-4753-9d87-c5e74468c722 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:20:34.758544 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e27385-641a-4753-9d87-c5e74468c722 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:20:34.763190 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44efa979-b4d4-4d5d-9dd7-ac40cc8887ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:20:34.763866 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44efa979-b4d4-4d5d-9dd7-ac40cc8887ac admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:20:34.764149 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44efa979-b4d4-4d5d-9dd7-ac40cc8887ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:20:34.764423 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44efa979-b4d4-4d5d-9dd7-ac40cc8887ac admin admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:20:34.765151 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44efa979-b4d4-4d5d-9dd7-ac40cc8887ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:20:34.765458 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44efa979-b4d4-4d5d-9dd7-ac40cc8887ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:20:34.767727 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44efa979-b4d4-4d5d-9dd7-ac40cc8887ac admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:20:34.778962 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1410/2802] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jul 14 10:20:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:20:34.783157 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3b447c-4d8a-4330-bac8-b927c18b4297 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:20:34.792193 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3b447c-4d8a-4330-bac8-b927c18b4297 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:20:34.797131 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a430dd-b34a-4780-a26c-fb41106aa4d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:20:34.798368 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a430dd-b34a-4780-a26c-fb41106aa4d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:20:34.798662 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a430dd-b34a-4780-a26c-fb41106aa4d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:20:34.798941 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a430dd-b34a-4780-a26c-fb41106aa4d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:20:34.799642 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a430dd-b34a-4780-a26c-fb41106aa4d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:20:34.801570 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a430dd-b34a-4780-a26c-fb41106aa4d4 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:20:34.809839 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:20:34.830288 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1393/2803] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 14 10:20:34 2022] POST /identity/v3/projects => generated 371 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:20:34.834418 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44efa979-b4d4-4d5d-9dd7-ac40cc8887ac admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:20:34.845110 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44efa979-b4d4-4d5d-9dd7-ac40cc8887ac admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:20:34.903683 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca2d376-3ed7-4e7c-9d41-8a1bbd331126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:20:34.904368 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca2d376-3ed7-4e7c-9d41-8a1bbd331126 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:20:34.904662 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca2d376-3ed7-4e7c-9d41-8a1bbd331126 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:20:34.904949 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca2d376-3ed7-4e7c-9d41-8a1bbd331126 admin admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:20:34.905661 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca2d376-3ed7-4e7c-9d41-8a1bbd331126 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:20:34.907657 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca2d376-3ed7-4e7c-9d41-8a1bbd331126 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:20:34.928806 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1411/2804] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 14 10:20:34 2022] POST /identity/v3/users => generated 286 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:20:34.933007 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a430dd-b34a-4780-a26c-fb41106aa4d4 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:20:34.946837 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a430dd-b34a-4780-a26c-fb41106aa4d4 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:20:34.951605 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba401455-ddc0-400f-bb09-5f69a3feaa70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:20:34.952289 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba401455-ddc0-400f-bb09-5f69a3feaa70 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:20:34.952570 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba401455-ddc0-400f-bb09-5f69a3feaa70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:20:34.952853 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba401455-ddc0-400f-bb09-5f69a3feaa70 admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:20:34.953592 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba401455-ddc0-400f-bb09-5f69a3feaa70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:20:34.955319 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba401455-ddc0-400f-bb09-5f69a3feaa70 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:20:34.965528 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1394/2805] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 10:20:34 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:20:34.969333 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca2d376-3ed7-4e7c-9d41-8a1bbd331126 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:20:34.982260 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca2d376-3ed7-4e7c-9d41-8a1bbd331126 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:20:34.987581 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db882da-8e39-4fbf-8ef7-fdf6b541cd8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:20:34.988248 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db882da-8e39-4fbf-8ef7-fdf6b541cd8a admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:20:34.988538 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db882da-8e39-4fbf-8ef7-fdf6b541cd8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:20:34.988820 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db882da-8e39-4fbf-8ef7-fdf6b541cd8a admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:20:34.989556 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db882da-8e39-4fbf-8ef7-fdf6b541cd8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:20:34.991198 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db882da-8e39-4fbf-8ef7-fdf6b541cd8a admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:20:35.001698 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1412/2806] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 10:20:34 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:20:35.005831 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba401455-ddc0-400f-bb09-5f69a3feaa70 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:20:35.015886 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba401455-ddc0-400f-bb09-5f69a3feaa70 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:20:35.020571 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6a86a0-8763-412c-8ba8-6845338d97e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:20:35.021479 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6a86a0-8763-412c-8ba8-6845338d97e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:20:35.021773 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6a86a0-8763-412c-8ba8-6845338d97e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:20:35.022053 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6a86a0-8763-412c-8ba8-6845338d97e4 admin admin] PATH_INFO: `/v3/projects/1d6294a8c0004e598c48eeede1d20eec/users/b53d78d3a1cc41dc822c6bf6db2b4b86/roles/17dfac38a2e540fea229af7de99911bb` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:20:35.041148 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6a86a0-8763-412c-8ba8-6845338d97e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d6294a8c0004e598c48eeede1d20eec, user_id=b53d78d3a1cc41dc822c6bf6db2b4b86, role_id=17dfac38a2e540fea229af7de99911bb)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:20:35.043854 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6a86a0-8763-412c-8ba8-6845338d97e4 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:20:35.056968 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1395/2807] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 14 10:20:35 2022] PUT /identity/v3/projects/1d6294a8c0004e598c48eeede1d20eec/users/b53d78d3a1cc41dc822c6bf6db2b4b86/roles/17dfac38a2e540fea229af7de99911bb => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:20:35.062078 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45a2774-09dc-4133-8b92-4f1914fcaba1 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:20:35.062509 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45a2774-09dc-4133-8b92-4f1914fcaba1 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:20:35.062795 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45a2774-09dc-4133-8b92-4f1914fcaba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:20:35.080889 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-b45a2774-09dc-4133-8b92-4f1914fcaba1 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:20:35.082079 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-b45a2774-09dc-4133-8b92-4f1914fcaba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:20:35.139276 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1413/2808] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 10:20:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:20:35.148904 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6a86a0-8763-412c-8ba8-6845338d97e4 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:20:35.150614 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-aa6a86a0-8763-412c-8ba8-6845338d97e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:20:35.207605 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6a86a0-8763-412c-8ba8-6845338d97e4 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:20:35.211433 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588bd06c-4943-4d96-91f5-09d99d97945d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e4a5a8965e4802a9055d332179b7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:20:35.212075 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588bd06c-4943-4d96-91f5-09d99d97945d service neutron] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:20:35.212357 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588bd06c-4943-4d96-91f5-09d99d97945d service neutron] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:20:35.212632 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588bd06c-4943-4d96-91f5-09d99d97945d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:20:35.222105 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588bd06c-4943-4d96-91f5-09d99d97945d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:20:35.223556 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588bd06c-4943-4d96-91f5-09d99d97945d service neutron] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:20:35.232783 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1396/2809] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 10:20:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:20:35.810207 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338ede3f-c686-4687-a29f-d9edaa051a1a None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:20:35.810778 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338ede3f-c686-4687-a29f-d9edaa051a1a None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:20:35.810876 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338ede3f-c686-4687-a29f-d9edaa051a1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:20:35.837791 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-338ede3f-c686-4687-a29f-d9edaa051a1a None None] MFA Rules not processed for user `b53d78d3a1cc41dc822c6bf6db2b4b86`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:20:35.839049 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-338ede3f-c686-4687-a29f-d9edaa051a1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:20:35.874018 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:20:35.910575 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1414/2810] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 10:20:35 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:20:35.911829 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588bd06c-4943-4d96-91f5-09d99d97945d service neutron] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:20:35.923118 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588bd06c-4943-4d96-91f5-09d99d97945d service neutron] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:20:35.927939 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521f3526-9b88-4e06-8ee3-13b908c8dabf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:20:35.928612 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521f3526-9b88-4e06-8ee3-13b908c8dabf admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:20:35.928902 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521f3526-9b88-4e06-8ee3-13b908c8dabf admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:20:35.929186 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521f3526-9b88-4e06-8ee3-13b908c8dabf admin admin] PATH_INFO: `/v3/projects` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:20:35.929890 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521f3526-9b88-4e06-8ee3-13b908c8dabf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:20:35.931850 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521f3526-9b88-4e06-8ee3-13b908c8dabf admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:20:35.959354 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1397/2811] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 14 10:20:35 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:20:35.963974 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338ede3f-c686-4687-a29f-d9edaa051a1a None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:20:35.983250 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338ede3f-c686-4687-a29f-d9edaa051a1a None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:20:36.050236 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2935943c-4ced-4479-a3eb-9bde44a342fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:20:36.050933 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2935943c-4ced-4479-a3eb-9bde44a342fe admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:20:36.051222 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2935943c-4ced-4479-a3eb-9bde44a342fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:20:36.051506 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2935943c-4ced-4479-a3eb-9bde44a342fe admin admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:20:36.052223 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2935943c-4ced-4479-a3eb-9bde44a342fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:20:36.054153 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2935943c-4ced-4479-a3eb-9bde44a342fe admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:20:36.080064 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1415/2812] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 14 10:20:35 2022] POST /identity/v3/users => generated 293 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:20:36.084124 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521f3526-9b88-4e06-8ee3-13b908c8dabf admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:20:36.094595 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521f3526-9b88-4e06-8ee3-13b908c8dabf admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:20:36.099784 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aac408b-a568-4904-98af-11314a89ac0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:20:36.100449 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aac408b-a568-4904-98af-11314a89ac0c admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:20:36.100739 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aac408b-a568-4904-98af-11314a89ac0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:20:36.101022 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aac408b-a568-4904-98af-11314a89ac0c admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:20:36.101768 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aac408b-a568-4904-98af-11314a89ac0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:20:36.103454 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aac408b-a568-4904-98af-11314a89ac0c admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:20:36.116806 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1398/2813] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 10:20:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 10:20:36.120528 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2935943c-4ced-4479-a3eb-9bde44a342fe admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:20:36.130731 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2935943c-4ced-4479-a3eb-9bde44a342fe admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:20:36.135875 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e55b29-de0d-444f-9bd0-801b9274d808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:20:36.136772 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e55b29-de0d-444f-9bd0-801b9274d808 admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:20:36.137059 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e55b29-de0d-444f-9bd0-801b9274d808 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:20:36.137341 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e55b29-de0d-444f-9bd0-801b9274d808 admin admin] PATH_INFO: `/v3/projects/b7d8db2ef35d4dc4ab0dcb68593674b3/users/233cbddcf50e4e95903e84054ffcf7a2/roles/e3965bd0d5f1427a86a313c0c90bfef3` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:20:36.152074 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e55b29-de0d-444f-9bd0-801b9274d808 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7d8db2ef35d4dc4ab0dcb68593674b3, user_id=233cbddcf50e4e95903e84054ffcf7a2, role_id=e3965bd0d5f1427a86a313c0c90bfef3)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:20:36.154790 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e55b29-de0d-444f-9bd0-801b9274d808 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:20:36.167681 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1416/2814] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 14 10:20:36 2022] PUT /identity/v3/projects/b7d8db2ef35d4dc4ab0dcb68593674b3/users/233cbddcf50e4e95903e84054ffcf7a2/roles/e3965bd0d5f1427a86a313c0c90bfef3 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:20:36.171680 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aac408b-a568-4904-98af-11314a89ac0c admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:20:36.182543 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aac408b-a568-4904-98af-11314a89ac0c admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:20:36.237292 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25966f0-98ea-4a21-a488-d5ba1d39e517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:20:36.237956 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25966f0-98ea-4a21-a488-d5ba1d39e517 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:20:36.238374 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25966f0-98ea-4a21-a488-d5ba1d39e517 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:20:36.238583 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25966f0-98ea-4a21-a488-d5ba1d39e517 admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:20:36.239276 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25966f0-98ea-4a21-a488-d5ba1d39e517 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:20:36.240920 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25966f0-98ea-4a21-a488-d5ba1d39e517 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:20:36.250485 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1399/2815] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 10:20:36 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:20:36.254541 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e55b29-de0d-444f-9bd0-801b9274d808 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:20:36.264631 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e55b29-de0d-444f-9bd0-801b9274d808 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:20:36.269787 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021e67a5-ec94-42a4-9955-315a9c01679e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:20:36.270706 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021e67a5-ec94-42a4-9955-315a9c01679e admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:20:36.270991 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021e67a5-ec94-42a4-9955-315a9c01679e admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:20:36.271272 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021e67a5-ec94-42a4-9955-315a9c01679e admin admin] PATH_INFO: `/v3/projects/b7d8db2ef35d4dc4ab0dcb68593674b3/users/233cbddcf50e4e95903e84054ffcf7a2/roles/e3965bd0d5f1427a86a313c0c90bfef3` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:20:36.273245 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021e67a5-ec94-42a4-9955-315a9c01679e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7d8db2ef35d4dc4ab0dcb68593674b3, user_id=233cbddcf50e4e95903e84054ffcf7a2, role_id=e3965bd0d5f1427a86a313c0c90bfef3)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:20:36.275920 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021e67a5-ec94-42a4-9955-315a9c01679e admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:20:36.287151 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1417/2816] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 14 10:20:36 2022] PUT /identity/v3/projects/b7d8db2ef35d4dc4ab0dcb68593674b3/users/233cbddcf50e4e95903e84054ffcf7a2/roles/e3965bd0d5f1427a86a313c0c90bfef3 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:20:36.906104 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed262b7e-c4bf-44c8-9860-819d04c00876 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:20:36.906502 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed262b7e-c4bf-44c8-9860-819d04c00876 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:20:36.906797 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed262b7e-c4bf-44c8-9860-819d04c00876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:20:36.932816 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-ed262b7e-c4bf-44c8-9860-819d04c00876 None None] MFA Rules not processed for user `233cbddcf50e4e95903e84054ffcf7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:20:36.934049 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-ed262b7e-c4bf-44c8-9860-819d04c00876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:20:36.943288 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:20:37.008044 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1400/2817] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 10:20:36 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:20:37.021073 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021e67a5-ec94-42a4-9955-315a9c01679e admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:20:37.022838 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-021e67a5-ec94-42a4-9955-315a9c01679e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:20:37.085571 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021e67a5-ec94-42a4-9955-315a9c01679e admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:20:37.089050 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6baf098-aba5-4dd1-abd4-0f1b8483d2de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25048b29787d482783ebc944f1a7df65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:20:37.089698 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6baf098-aba5-4dd1-abd4-0f1b8483d2de service cinder] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:20:37.089982 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6baf098-aba5-4dd1-abd4-0f1b8483d2de service cinder] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:20:37.090286 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6baf098-aba5-4dd1-abd4-0f1b8483d2de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:20:37.131749 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:20:37.147966 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6baf098-aba5-4dd1-abd4-0f1b8483d2de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:20:37.149411 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6baf098-aba5-4dd1-abd4-0f1b8483d2de service cinder] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:20:37.159824 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1418/2818] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 10:20:37 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:20:38.679046 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed262b7e-c4bf-44c8-9860-819d04c00876 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:20:38.680730 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-ed262b7e-c4bf-44c8-9860-819d04c00876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:20:38.693817 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed262b7e-c4bf-44c8-9860-819d04c00876 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:20:38.697479 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0069cd1-7cb7-49ca-81b7-518093b56743 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25048b29787d482783ebc944f1a7df65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:20:38.698146 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0069cd1-7cb7-49ca-81b7-518093b56743 service cinder] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:20:38.698456 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0069cd1-7cb7-49ca-81b7-518093b56743 service cinder] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:20:38.698744 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0069cd1-7cb7-49ca-81b7-518093b56743 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:20:38.708411 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0069cd1-7cb7-49ca-81b7-518093b56743 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:20:38.709880 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0069cd1-7cb7-49ca-81b7-518093b56743 service cinder] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:20:38.719672 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1401/2819] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 10:20:38 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:20:46.819280 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6baf098-aba5-4dd1-abd4-0f1b8483d2de service cinder] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:20:46.820683 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-f6baf098-aba5-4dd1-abd4-0f1b8483d2de service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:20:46.877888 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6baf098-aba5-4dd1-abd4-0f1b8483d2de service cinder] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:20:46.881561 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9e8dfa-b28f-41d6-b14d-212a1ad380aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e4a5a8965e4802a9055d332179b7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:20:46.882227 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9e8dfa-b28f-41d6-b14d-212a1ad380aa service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:20:46.882522 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9e8dfa-b28f-41d6-b14d-212a1ad380aa service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:20:46.882820 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9e8dfa-b28f-41d6-b14d-212a1ad380aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:20:46.884575 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-cf9e8dfa-b28f-41d6-b14d-212a1ad380aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:20:46.945504 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9e8dfa-b28f-41d6-b14d-212a1ad380aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:20:46.946979 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9e8dfa-b28f-41d6-b14d-212a1ad380aa service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:20:46.956366 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1419/2820] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 10:20:46 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:20:48.715466 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=31 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:20:51.524694 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0069cd1-7cb7-49ca-81b7-518093b56743 service cinder] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:20:51.526145 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-d0069cd1-7cb7-49ca-81b7-518093b56743 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:20:51.590521 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9e8dfa-b28f-41d6-b14d-212a1ad380aa service neutron] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:20:51.608211 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0069cd1-7cb7-49ca-81b7-518093b56743 service cinder] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:20:51.613412 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3f2611-ec54-4cab-95db-dd8700418eac service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc5a80144b84c609944a51a84fd5e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:20:51.614070 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3f2611-ec54-4cab-95db-dd8700418eac service placement] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:20:51.614388 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3f2611-ec54-4cab-95db-dd8700418eac service placement] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:20:51.614671 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3f2611-ec54-4cab-95db-dd8700418eac service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:20:51.616456 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-4f3f2611-ec54-4cab-95db-dd8700418eac service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:20:51.629134 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3f2611-ec54-4cab-95db-dd8700418eac service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:20:51.630949 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3f2611-ec54-4cab-95db-dd8700418eac service placement] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:20:51.641234 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1402/2821] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 10:20:51 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:20:51.658393 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9e8dfa-b28f-41d6-b14d-212a1ad380aa service neutron] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:20:51.663249 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8004406e-d2e4-4ebb-be10-acb2661d512b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:20:51.664167 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8004406e-d2e4-4ebb-be10-acb2661d512b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:20:51.664454 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8004406e-d2e4-4ebb-be10-acb2661d512b admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:20:51.664735 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8004406e-d2e4-4ebb-be10-acb2661d512b admin admin] PATH_INFO: `/v3/users/b53d78d3a1cc41dc822c6bf6db2b4b86` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:20:51.666060 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8004406e-d2e4-4ebb-be10-acb2661d512b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b53d78d3a1cc41dc822c6bf6db2b4b86)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:20:51.668142 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8004406e-d2e4-4ebb-be10-acb2661d512b admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:20:51.704996 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:20:51.715337 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-8004406e-d2e4-4ebb-be10-acb2661d512b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b53d78d3a1cc41dc822c6bf6db2b4b86'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:20:51.727256 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-8004406e-d2e4-4ebb-be10-acb2661d512b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b53d78d3a1cc41dc822c6bf6db2b4b86'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:20:51.727915 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-8004406e-d2e4-4ebb-be10-acb2661d512b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b53d78d3a1cc41dc822c6bf6db2b4b86'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:20:51.735818 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-8004406e-d2e4-4ebb-be10-acb2661d512b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b53d78d3a1cc41dc822c6bf6db2b4b86'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:20:51.742847 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-8004406e-d2e4-4ebb-be10-acb2661d512b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b53d78d3a1cc41dc822c6bf6db2b4b86'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:20:51.749154 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1420/2822] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 14 10:20:51 2022] DELETE /identity/v3/users/b53d78d3a1cc41dc822c6bf6db2b4b86 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:20:51.921348 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3f2611-ec54-4cab-95db-dd8700418eac service placement] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:20:51.932187 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3f2611-ec54-4cab-95db-dd8700418eac service placement] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:20:51.991401 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a2c0d7-9710-43f1-b1cf-b95cac2d174e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:20:51.992266 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a2c0d7-9710-43f1-b1cf-b95cac2d174e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:20:51.992548 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a2c0d7-9710-43f1-b1cf-b95cac2d174e admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:20:51.992824 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a2c0d7-9710-43f1-b1cf-b95cac2d174e admin admin] PATH_INFO: `/v3/projects/1d6294a8c0004e598c48eeede1d20eec` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:20:51.994000 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a2c0d7-9710-43f1-b1cf-b95cac2d174e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d6294a8c0004e598c48eeede1d20eec)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:20:51.995911 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a2c0d7-9710-43f1-b1cf-b95cac2d174e admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:20:52.041161 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-51a2c0d7-9710-43f1-b1cf-b95cac2d174e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d6294a8c0004e598c48eeede1d20eec', 'request_id': 'req-51a2c0d7-9710-43f1-b1cf-b95cac2d174e'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:20:52.057036 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-51a2c0d7-9710-43f1-b1cf-b95cac2d174e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d6294a8c0004e598c48eeede1d20eec', 'request_id': 'req-51a2c0d7-9710-43f1-b1cf-b95cac2d174e'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:20:52.064191 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-51a2c0d7-9710-43f1-b1cf-b95cac2d174e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d6294a8c0004e598c48eeede1d20eec', 'request_id': 'req-51a2c0d7-9710-43f1-b1cf-b95cac2d174e'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:20:52.077276 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-51a2c0d7-9710-43f1-b1cf-b95cac2d174e admin admin] The token cache is being invalidate because project 1d6294a8c0004e598c48eeede1d20eec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:20:52.077566 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-51a2c0d7-9710-43f1-b1cf-b95cac2d174e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:20:52.078236 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-51a2c0d7-9710-43f1-b1cf-b95cac2d174e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:20:52.079802 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1403/2823] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 14 10:20:51 2022] DELETE /identity/v3/projects/1d6294a8c0004e598c48eeede1d20eec => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:20:52.083952 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8004406e-d2e4-4ebb-be10-acb2661d512b admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:20:52.085355 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-8004406e-d2e4-4ebb-be10-acb2661d512b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:20:52.098331 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8004406e-d2e4-4ebb-be10-acb2661d512b admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:20:52.152945 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a749ba69-1750-4574-88bc-5e7237ea81ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:20:52.153752 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a749ba69-1750-4574-88bc-5e7237ea81ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:20:52.154035 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a749ba69-1750-4574-88bc-5e7237ea81ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:20:52.154342 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a749ba69-1750-4574-88bc-5e7237ea81ed admin admin] PATH_INFO: `/v3/users/233cbddcf50e4e95903e84054ffcf7a2` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:20:52.155546 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a749ba69-1750-4574-88bc-5e7237ea81ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=233cbddcf50e4e95903e84054ffcf7a2)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:20:52.157444 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a749ba69-1750-4574-88bc-5e7237ea81ed admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:20:52.202929 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-a749ba69-1750-4574-88bc-5e7237ea81ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '233cbddcf50e4e95903e84054ffcf7a2'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:20:52.214742 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-a749ba69-1750-4574-88bc-5e7237ea81ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '233cbddcf50e4e95903e84054ffcf7a2'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:20:52.215400 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-a749ba69-1750-4574-88bc-5e7237ea81ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '233cbddcf50e4e95903e84054ffcf7a2'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:20:52.222607 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-a749ba69-1750-4574-88bc-5e7237ea81ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '233cbddcf50e4e95903e84054ffcf7a2'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:20:52.229448 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-a749ba69-1750-4574-88bc-5e7237ea81ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '233cbddcf50e4e95903e84054ffcf7a2'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:20:52.235278 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1421/2824] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 14 10:20:52 2022] DELETE /identity/v3/users/233cbddcf50e4e95903e84054ffcf7a2 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:20:52.404161 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a2c0d7-9710-43f1-b1cf-b95cac2d174e admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:20:52.405679 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-51a2c0d7-9710-43f1-b1cf-b95cac2d174e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:20:52.419184 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a2c0d7-9710-43f1-b1cf-b95cac2d174e admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:20:52.442232 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:20:52.484939 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151d6f1f-56f3-465a-ad0b-ef06167c3517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:20:52.485833 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151d6f1f-56f3-465a-ad0b-ef06167c3517 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:20:52.486115 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151d6f1f-56f3-465a-ad0b-ef06167c3517 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:20:52.486418 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151d6f1f-56f3-465a-ad0b-ef06167c3517 admin admin] PATH_INFO: `/v3/projects/b7d8db2ef35d4dc4ab0dcb68593674b3` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:20:52.487629 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151d6f1f-56f3-465a-ad0b-ef06167c3517 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7d8db2ef35d4dc4ab0dcb68593674b3)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:20:52.490169 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151d6f1f-56f3-465a-ad0b-ef06167c3517 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:20:52.534686 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-151d6f1f-56f3-465a-ad0b-ef06167c3517 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7d8db2ef35d4dc4ab0dcb68593674b3', 'request_id': 'req-151d6f1f-56f3-465a-ad0b-ef06167c3517'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:20:52.542568 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-151d6f1f-56f3-465a-ad0b-ef06167c3517 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7d8db2ef35d4dc4ab0dcb68593674b3', 'request_id': 'req-151d6f1f-56f3-465a-ad0b-ef06167c3517'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:20:52.548034 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-151d6f1f-56f3-465a-ad0b-ef06167c3517 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7d8db2ef35d4dc4ab0dcb68593674b3', 'request_id': 'req-151d6f1f-56f3-465a-ad0b-ef06167c3517'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:20:52.559839 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-151d6f1f-56f3-465a-ad0b-ef06167c3517 admin admin] The token cache is being invalidate because project b7d8db2ef35d4dc4ab0dcb68593674b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:20:52.560154 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-151d6f1f-56f3-465a-ad0b-ef06167c3517 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:20:52.560823 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-151d6f1f-56f3-465a-ad0b-ef06167c3517 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:20:52.562373 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1404/2825] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 14 10:20:52 2022] DELETE /identity/v3/projects/b7d8db2ef35d4dc4ab0dcb68593674b3 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:20:52.567236 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8aaf14-49c2-4912-a7c2-6371a21d5d6b None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:20:52.567535 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8aaf14-49c2-4912-a7c2-6371a21d5d6b None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:20:52.567857 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8aaf14-49c2-4912-a7c2-6371a21d5d6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:20:52.587368 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-9a8aaf14-49c2-4912-a7c2-6371a21d5d6b None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:20:52.588579 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-9a8aaf14-49c2-4912-a7c2-6371a21d5d6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:20:52.614574 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:20:52.648538 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1422/2826] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 10:20:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:20:52.656347 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd95289-3a91-45ff-8bcc-088076f305b4 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:20:52.656583 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd95289-3a91-45ff-8bcc-088076f305b4 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:20:52.656902 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd95289-3a91-45ff-8bcc-088076f305b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:20:52.675283 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-abd95289-3a91-45ff-8bcc-088076f305b4 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:20:52.677083 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-abd95289-3a91-45ff-8bcc-088076f305b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:20:52.685048 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1405/2827] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 10:20:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:20:52.689039 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8aaf14-49c2-4912-a7c2-6371a21d5d6b None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:20:52.698895 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8aaf14-49c2-4912-a7c2-6371a21d5d6b None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:20:52.703367 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c60bc6d-c989-4335-9c01-19f6f885b6aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:20:52.704015 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c60bc6d-c989-4335-9c01-19f6f885b6aa admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:20:52.704298 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c60bc6d-c989-4335-9c01-19f6f885b6aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:20:52.704573 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c60bc6d-c989-4335-9c01-19f6f885b6aa admin admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:20:52.705299 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c60bc6d-c989-4335-9c01-19f6f885b6aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:20:52.705605 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c60bc6d-c989-4335-9c01-19f6f885b6aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:20:52.707802 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c60bc6d-c989-4335-9c01-19f6f885b6aa admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:20:52.719332 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1423/2828] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jul 14 10:20:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:20:52.723922 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd95289-3a91-45ff-8bcc-088076f305b4 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:20:52.733247 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd95289-3a91-45ff-8bcc-088076f305b4 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:20:52.737819 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4359d0-f183-4488-a944-674e53ce1f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:20:52.738500 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4359d0-f183-4488-a944-674e53ce1f41 admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:20:52.738785 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4359d0-f183-4488-a944-674e53ce1f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:20:52.739064 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4359d0-f183-4488-a944-674e53ce1f41 admin admin] PATH_INFO: `/v3/projects` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:20:52.739759 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4359d0-f183-4488-a944-674e53ce1f41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:20:52.741673 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4359d0-f183-4488-a944-674e53ce1f41 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:20:52.768646 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1406/2829] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 14 10:20:52 2022] POST /identity/v3/projects => generated 385 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:20:52.771040 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c60bc6d-c989-4335-9c01-19f6f885b6aa admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:20:52.781118 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c60bc6d-c989-4335-9c01-19f6f885b6aa admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:20:52.836577 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b74206-4655-4519-add4-d38c48ee7fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:20:52.837249 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b74206-4655-4519-add4-d38c48ee7fc1 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:20:52.837540 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b74206-4655-4519-add4-d38c48ee7fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:20:52.837824 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b74206-4655-4519-add4-d38c48ee7fc1 admin admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:20:52.838575 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b74206-4655-4519-add4-d38c48ee7fc1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:20:52.840467 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b74206-4655-4519-add4-d38c48ee7fc1 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:20:52.860378 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1424/2830] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 14 10:20:52 2022] POST /identity/v3/users => generated 293 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:20:52.864435 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4359d0-f183-4488-a944-674e53ce1f41 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:20:52.874471 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4359d0-f183-4488-a944-674e53ce1f41 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:20:52.878997 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe97f02-838c-4f5b-97b0-60f7102e6b64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:20:52.879649 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe97f02-838c-4f5b-97b0-60f7102e6b64 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:20:52.879933 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe97f02-838c-4f5b-97b0-60f7102e6b64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:20:52.880210 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe97f02-838c-4f5b-97b0-60f7102e6b64 admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:20:52.881137 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe97f02-838c-4f5b-97b0-60f7102e6b64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:20:52.882840 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe97f02-838c-4f5b-97b0-60f7102e6b64 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:20:52.893283 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1407/2831] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 10:20:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:20:52.897641 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b74206-4655-4519-add4-d38c48ee7fc1 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:20:52.907662 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b74206-4655-4519-add4-d38c48ee7fc1 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:20:52.912777 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700f25a8-e944-407e-8341-934fc69ac732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:20:52.913432 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700f25a8-e944-407e-8341-934fc69ac732 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:20:52.913741 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700f25a8-e944-407e-8341-934fc69ac732 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:20:52.914018 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700f25a8-e944-407e-8341-934fc69ac732 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:20:52.914781 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700f25a8-e944-407e-8341-934fc69ac732 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:20:52.916570 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700f25a8-e944-407e-8341-934fc69ac732 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:20:52.926319 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1425/2832] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 10:20:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:20:52.930613 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe97f02-838c-4f5b-97b0-60f7102e6b64 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:20:52.940479 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe97f02-838c-4f5b-97b0-60f7102e6b64 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:20:52.945302 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed4914c-0fff-4741-bdf6-0905e5767dd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:20:52.946177 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed4914c-0fff-4741-bdf6-0905e5767dd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:20:52.946493 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed4914c-0fff-4741-bdf6-0905e5767dd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:20:52.946771 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed4914c-0fff-4741-bdf6-0905e5767dd7 admin admin] PATH_INFO: `/v3/projects/858eaa1ed8994a9a98dee9cc71009862/users/64fdc00318bc4cd4b7867945c333e852/roles/17dfac38a2e540fea229af7de99911bb` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:20:52.961754 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed4914c-0fff-4741-bdf6-0905e5767dd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=858eaa1ed8994a9a98dee9cc71009862, user_id=64fdc00318bc4cd4b7867945c333e852, role_id=17dfac38a2e540fea229af7de99911bb)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:20:52.964433 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed4914c-0fff-4741-bdf6-0905e5767dd7 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:20:52.977253 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1408/2833] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 14 10:20:52 2022] PUT /identity/v3/projects/858eaa1ed8994a9a98dee9cc71009862/users/64fdc00318bc4cd4b7867945c333e852/roles/17dfac38a2e540fea229af7de99911bb => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:20:52.987419 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f9edaa-d1a4-4430-9c29-77d09d6c4dbd None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:20:52.987715 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f9edaa-d1a4-4430-9c29-77d09d6c4dbd None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:20:52.988027 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f9edaa-d1a4-4430-9c29-77d09d6c4dbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:20:53.014052 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-c0f9edaa-d1a4-4430-9c29-77d09d6c4dbd None None] MFA Rules not processed for user `64fdc00318bc4cd4b7867945c333e852`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:20:53.015280 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-c0f9edaa-d1a4-4430-9c29-77d09d6c4dbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:20:53.079252 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1426/2834] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 10:20:52 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:20:53.084262 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed4914c-0fff-4741-bdf6-0905e5767dd7 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:20:53.137351 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:20:53.155129 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed4914c-0fff-4741-bdf6-0905e5767dd7 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:20:53.159884 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e741ec77-d396-4e20-bc12-cc2b4bb95af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:20:53.160520 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e741ec77-d396-4e20-bc12-cc2b4bb95af8 admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:20:53.160810 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e741ec77-d396-4e20-bc12-cc2b4bb95af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:20:53.161091 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e741ec77-d396-4e20-bc12-cc2b4bb95af8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:20:53.161804 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e741ec77-d396-4e20-bc12-cc2b4bb95af8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:20:53.163751 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e741ec77-d396-4e20-bc12-cc2b4bb95af8 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:20:53.188148 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1409/2835] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 14 10:20:53 2022] POST /identity/v3/projects => generated 385 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:20:53.192873 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f9edaa-d1a4-4430-9c29-77d09d6c4dbd None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:20:53.203921 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f9edaa-d1a4-4430-9c29-77d09d6c4dbd None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:20:53.228572 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:20:53.261874 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5c2e18-12bc-4d76-b1b7-aa31866a76cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:20:53.262585 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5c2e18-12bc-4d76-b1b7-aa31866a76cc admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:20:53.262870 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5c2e18-12bc-4d76-b1b7-aa31866a76cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:20:53.263148 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5c2e18-12bc-4d76-b1b7-aa31866a76cc admin admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:20:53.263844 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5c2e18-12bc-4d76-b1b7-aa31866a76cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:20:53.265788 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5c2e18-12bc-4d76-b1b7-aa31866a76cc admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:20:53.285313 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1427/2836] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 14 10:20:53 2022] POST /identity/v3/users => generated 299 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:20:53.289236 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e741ec77-d396-4e20-bc12-cc2b4bb95af8 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:20:53.299623 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e741ec77-d396-4e20-bc12-cc2b4bb95af8 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:20:53.304266 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a567d09-a61b-4800-92ff-01af096bf8d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:20:53.304926 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a567d09-a61b-4800-92ff-01af096bf8d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:20:53.305212 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a567d09-a61b-4800-92ff-01af096bf8d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:20:53.305493 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a567d09-a61b-4800-92ff-01af096bf8d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:20:53.306248 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a567d09-a61b-4800-92ff-01af096bf8d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:20:53.307838 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a567d09-a61b-4800-92ff-01af096bf8d2 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:20:53.321749 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1410/2837] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 10:20:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:20:53.322903 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5c2e18-12bc-4d76-b1b7-aa31866a76cc admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:20:53.334454 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5c2e18-12bc-4d76-b1b7-aa31866a76cc admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:20:53.339427 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91c0149-2079-42f3-bd3c-6c80fcf3c0ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:20:53.340320 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91c0149-2079-42f3-bd3c-6c80fcf3c0ae admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:20:53.340611 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91c0149-2079-42f3-bd3c-6c80fcf3c0ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:20:53.340895 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91c0149-2079-42f3-bd3c-6c80fcf3c0ae admin admin] PATH_INFO: `/v3/projects/c5950c8c9abf41a68ab00b752f9d77a4/users/c06f15087c064457bdc704fd4d7d52e3/roles/e3965bd0d5f1427a86a313c0c90bfef3` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:20:53.355798 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91c0149-2079-42f3-bd3c-6c80fcf3c0ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5950c8c9abf41a68ab00b752f9d77a4, user_id=c06f15087c064457bdc704fd4d7d52e3, role_id=e3965bd0d5f1427a86a313c0c90bfef3)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:20:53.358484 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91c0149-2079-42f3-bd3c-6c80fcf3c0ae admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:20:53.371167 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1428/2838] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 14 10:20:53 2022] PUT /identity/v3/projects/c5950c8c9abf41a68ab00b752f9d77a4/users/c06f15087c064457bdc704fd4d7d52e3/roles/e3965bd0d5f1427a86a313c0c90bfef3 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:20:53.375106 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a567d09-a61b-4800-92ff-01af096bf8d2 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:20:53.385780 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a567d09-a61b-4800-92ff-01af096bf8d2 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:20:53.444161 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9086be7-eb03-4e5a-9131-8c15038d8497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:20:53.444843 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9086be7-eb03-4e5a-9131-8c15038d8497 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:20:53.445138 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9086be7-eb03-4e5a-9131-8c15038d8497 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:20:53.445420 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9086be7-eb03-4e5a-9131-8c15038d8497 admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:20:53.446159 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9086be7-eb03-4e5a-9131-8c15038d8497 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:20:53.447818 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9086be7-eb03-4e5a-9131-8c15038d8497 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:20:53.458206 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1411/2839] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 10:20:53 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:20:53.462720 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91c0149-2079-42f3-bd3c-6c80fcf3c0ae admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:20:53.473312 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91c0149-2079-42f3-bd3c-6c80fcf3c0ae admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:20:53.478411 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c534d3a-d513-4631-b6d1-9f081e264f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:20:53.479298 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c534d3a-d513-4631-b6d1-9f081e264f65 admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:20:53.479587 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c534d3a-d513-4631-b6d1-9f081e264f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:20:53.479860 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c534d3a-d513-4631-b6d1-9f081e264f65 admin admin] PATH_INFO: `/v3/projects/c5950c8c9abf41a68ab00b752f9d77a4/users/c06f15087c064457bdc704fd4d7d52e3/roles/e3965bd0d5f1427a86a313c0c90bfef3` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:20:53.481859 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c534d3a-d513-4631-b6d1-9f081e264f65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5950c8c9abf41a68ab00b752f9d77a4, user_id=c06f15087c064457bdc704fd4d7d52e3, role_id=e3965bd0d5f1427a86a313c0c90bfef3)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:20:53.484525 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c534d3a-d513-4631-b6d1-9f081e264f65 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:20:53.495389 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1429/2840] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 14 10:20:53 2022] PUT /identity/v3/projects/c5950c8c9abf41a68ab00b752f9d77a4/users/c06f15087c064457bdc704fd4d7d52e3/roles/e3965bd0d5f1427a86a313c0c90bfef3 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:20:53.558208 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81e9126-9810-4a03-93fb-fb07977e7cd9 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:20:53.558733 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81e9126-9810-4a03-93fb-fb07977e7cd9 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:20:53.558838 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81e9126-9810-4a03-93fb-fb07977e7cd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:20:53.585293 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-c81e9126-9810-4a03-93fb-fb07977e7cd9 None None] MFA Rules not processed for user `c06f15087c064457bdc704fd4d7d52e3`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:20:53.586558 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-c81e9126-9810-4a03-93fb-fb07977e7cd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:20:53.655196 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1412/2841] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 10:20:53 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:20:53.665634 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c534d3a-d513-4631-b6d1-9f081e264f65 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:20:53.667453 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-4c534d3a-d513-4631-b6d1-9f081e264f65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:20:53.726882 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c534d3a-d513-4631-b6d1-9f081e264f65 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:20:53.730444 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b94096-cd07-4d1d-a5c7-9d341ca705bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25048b29787d482783ebc944f1a7df65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:20:53.731087 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b94096-cd07-4d1d-a5c7-9d341ca705bc service cinder] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:20:53.731374 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b94096-cd07-4d1d-a5c7-9d341ca705bc service cinder] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:20:53.731654 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b94096-cd07-4d1d-a5c7-9d341ca705bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:20:53.786491 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b94096-cd07-4d1d-a5c7-9d341ca705bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:20:53.787923 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b94096-cd07-4d1d-a5c7-9d341ca705bc service cinder] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:20:53.796929 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1430/2842] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 10:20:53 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:20:57.928897 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81e9126-9810-4a03-93fb-fb07977e7cd9 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:20:57.930326 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-c81e9126-9810-4a03-93fb-fb07977e7cd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:20:57.942223 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81e9126-9810-4a03-93fb-fb07977e7cd9 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:20:57.946000 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b98af2-32c5-4c6d-81c3-6b25f409b6fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25048b29787d482783ebc944f1a7df65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:20:57.946676 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b98af2-32c5-4c6d-81c3-6b25f409b6fb service cinder] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:20:57.946961 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b98af2-32c5-4c6d-81c3-6b25f409b6fb service cinder] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:20:57.947237 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b98af2-32c5-4c6d-81c3-6b25f409b6fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:20:57.956051 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b98af2-32c5-4c6d-81c3-6b25f409b6fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:20:57.957965 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b98af2-32c5-4c6d-81c3-6b25f409b6fb service cinder] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:20:57.967445 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1413/2843] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 10:20:57 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:21:02.797885 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b94096-cd07-4d1d-a5c7-9d341ca705bc service cinder] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:21:02.831450 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:21:02.860947 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b94096-cd07-4d1d-a5c7-9d341ca705bc service cinder] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:21:02.866201 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caafbbc6-38dc-47d7-bd1f-55d775f3d07e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:21:02.867074 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caafbbc6-38dc-47d7-bd1f-55d775f3d07e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:21:02.867354 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caafbbc6-38dc-47d7-bd1f-55d775f3d07e admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:21:02.867646 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caafbbc6-38dc-47d7-bd1f-55d775f3d07e admin admin] PATH_INFO: `/v3/users/64fdc00318bc4cd4b7867945c333e852` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:21:02.868798 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caafbbc6-38dc-47d7-bd1f-55d775f3d07e admin admin] RBAC: Authorizing `identity:delete_user(user_id=64fdc00318bc4cd4b7867945c333e852)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:21:02.870763 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caafbbc6-38dc-47d7-bd1f-55d775f3d07e admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:21:02.915458 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-caafbbc6-38dc-47d7-bd1f-55d775f3d07e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64fdc00318bc4cd4b7867945c333e852'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:21:02.927743 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-caafbbc6-38dc-47d7-bd1f-55d775f3d07e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64fdc00318bc4cd4b7867945c333e852'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:21:02.928400 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-caafbbc6-38dc-47d7-bd1f-55d775f3d07e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64fdc00318bc4cd4b7867945c333e852'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:21:02.936307 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-caafbbc6-38dc-47d7-bd1f-55d775f3d07e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64fdc00318bc4cd4b7867945c333e852'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:21:02.943176 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-caafbbc6-38dc-47d7-bd1f-55d775f3d07e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64fdc00318bc4cd4b7867945c333e852'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:21:02.949223 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1431/2844] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 14 10:21:02 2022] DELETE /identity/v3/users/64fdc00318bc4cd4b7867945c333e852 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:21:02.953707 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6e1015-f047-4504-8a1e-d05691e19e66 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:21:02.954179 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6e1015-f047-4504-8a1e-d05691e19e66 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:21:02.954299 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6e1015-f047-4504-8a1e-d05691e19e66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:21:02.971861 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-4f6e1015-f047-4504-8a1e-d05691e19e66 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:21:02.973046 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-4f6e1015-f047-4504-8a1e-d05691e19e66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:21:02.996791 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:21:03.030510 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1414/2845] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 10:21:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:21:03.040500 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caafbbc6-38dc-47d7-bd1f-55d775f3d07e admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:21:03.041983 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-caafbbc6-38dc-47d7-bd1f-55d775f3d07e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:21:03.100137 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caafbbc6-38dc-47d7-bd1f-55d775f3d07e admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:21:03.103834 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c040b82-1c60-445e-83d9-775350857b10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e4a5a8965e4802a9055d332179b7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:21:03.104476 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c040b82-1c60-445e-83d9-775350857b10 service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:21:03.104762 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c040b82-1c60-445e-83d9-775350857b10 service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:21:03.105040 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c040b82-1c60-445e-83d9-775350857b10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:21:03.113927 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c040b82-1c60-445e-83d9-775350857b10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:21:03.115942 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c040b82-1c60-445e-83d9-775350857b10 service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:21:03.128260 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1432/2846] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 10:21:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 10:21:03.395261 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6e1015-f047-4504-8a1e-d05691e19e66 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:21:03.397338 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-4f6e1015-f047-4504-8a1e-d05691e19e66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:21:03.411412 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6e1015-f047-4504-8a1e-d05691e19e66 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:21:03.416658 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fe4701-9793-4c40-8319-40d12274b5e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:21:03.417549 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fe4701-9793-4c40-8319-40d12274b5e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:21:03.417838 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fe4701-9793-4c40-8319-40d12274b5e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:21:03.418122 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fe4701-9793-4c40-8319-40d12274b5e2 admin admin] PATH_INFO: `/v3/projects/858eaa1ed8994a9a98dee9cc71009862` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:21:03.419390 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fe4701-9793-4c40-8319-40d12274b5e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=858eaa1ed8994a9a98dee9cc71009862)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:21:03.421317 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fe4701-9793-4c40-8319-40d12274b5e2 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:21:03.472789 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-a5fe4701-9793-4c40-8319-40d12274b5e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '858eaa1ed8994a9a98dee9cc71009862', 'request_id': 'req-a5fe4701-9793-4c40-8319-40d12274b5e2'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:21:03.483134 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-a5fe4701-9793-4c40-8319-40d12274b5e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '858eaa1ed8994a9a98dee9cc71009862', 'request_id': 'req-a5fe4701-9793-4c40-8319-40d12274b5e2'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:21:03.489550 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-a5fe4701-9793-4c40-8319-40d12274b5e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '858eaa1ed8994a9a98dee9cc71009862', 'request_id': 'req-a5fe4701-9793-4c40-8319-40d12274b5e2'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:21:03.501357 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-a5fe4701-9793-4c40-8319-40d12274b5e2 admin admin] The token cache is being invalidate because project 858eaa1ed8994a9a98dee9cc71009862 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:21:03.501650 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-a5fe4701-9793-4c40-8319-40d12274b5e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:21:03.502355 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-a5fe4701-9793-4c40-8319-40d12274b5e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:21:03.503883 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1415/2847] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 14 10:21:03 2022] DELETE /identity/v3/projects/858eaa1ed8994a9a98dee9cc71009862 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:21:03.507942 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c040b82-1c60-445e-83d9-775350857b10 service neutron] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:21:03.517547 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c040b82-1c60-445e-83d9-775350857b10 service neutron] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:21:03.566389 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:21:03.574929 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797d48ed-fffc-40cb-8056-807903d7f54e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:21:03.575850 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797d48ed-fffc-40cb-8056-807903d7f54e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:21:03.576517 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797d48ed-fffc-40cb-8056-807903d7f54e admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:21:03.576809 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797d48ed-fffc-40cb-8056-807903d7f54e admin admin] PATH_INFO: `/v3/users/c06f15087c064457bdc704fd4d7d52e3` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:21:03.578138 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797d48ed-fffc-40cb-8056-807903d7f54e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c06f15087c064457bdc704fd4d7d52e3)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:21:03.580369 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797d48ed-fffc-40cb-8056-807903d7f54e admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:21:03.624229 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-797d48ed-fffc-40cb-8056-807903d7f54e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c06f15087c064457bdc704fd4d7d52e3'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:21:03.636332 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-797d48ed-fffc-40cb-8056-807903d7f54e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c06f15087c064457bdc704fd4d7d52e3'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:21:03.636999 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-797d48ed-fffc-40cb-8056-807903d7f54e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c06f15087c064457bdc704fd4d7d52e3'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:21:03.644015 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-797d48ed-fffc-40cb-8056-807903d7f54e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c06f15087c064457bdc704fd4d7d52e3'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:21:03.651467 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-797d48ed-fffc-40cb-8056-807903d7f54e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c06f15087c064457bdc704fd4d7d52e3'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:21:03.657260 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1433/2848] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 14 10:21:03 2022] DELETE /identity/v3/users/c06f15087c064457bdc704fd4d7d52e3 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:21:03.920963 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fe4701-9793-4c40-8319-40d12274b5e2 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:21:03.922433 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-a5fe4701-9793-4c40-8319-40d12274b5e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:21:03.935444 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fe4701-9793-4c40-8319-40d12274b5e2 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:21:03.995202 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a8736d-5326-46f3-83a0-28daf7cf7ca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:21:03.996078 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a8736d-5326-46f3-83a0-28daf7cf7ca1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:21:03.996367 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a8736d-5326-46f3-83a0-28daf7cf7ca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:21:03.996648 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a8736d-5326-46f3-83a0-28daf7cf7ca1 admin admin] PATH_INFO: `/v3/projects/c5950c8c9abf41a68ab00b752f9d77a4` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:21:03.997848 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a8736d-5326-46f3-83a0-28daf7cf7ca1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5950c8c9abf41a68ab00b752f9d77a4)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:21:03.999799 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a8736d-5326-46f3-83a0-28daf7cf7ca1 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:21:04.046482 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-68a8736d-5326-46f3-83a0-28daf7cf7ca1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5950c8c9abf41a68ab00b752f9d77a4', 'request_id': 'req-68a8736d-5326-46f3-83a0-28daf7cf7ca1'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:21:04.050029 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:21:04.054543 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-68a8736d-5326-46f3-83a0-28daf7cf7ca1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5950c8c9abf41a68ab00b752f9d77a4', 'request_id': 'req-68a8736d-5326-46f3-83a0-28daf7cf7ca1'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:21:04.061108 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-68a8736d-5326-46f3-83a0-28daf7cf7ca1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5950c8c9abf41a68ab00b752f9d77a4', 'request_id': 'req-68a8736d-5326-46f3-83a0-28daf7cf7ca1'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:21:04.073521 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-68a8736d-5326-46f3-83a0-28daf7cf7ca1 admin admin] The token cache is being invalidate because project c5950c8c9abf41a68ab00b752f9d77a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:21:04.073808 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-68a8736d-5326-46f3-83a0-28daf7cf7ca1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:21:04.074454 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-68a8736d-5326-46f3-83a0-28daf7cf7ca1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:21:04.075971 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1416/2849] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 14 10:21:03 2022] DELETE /identity/v3/projects/c5950c8c9abf41a68ab00b752f9d77a4 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:21:04.082061 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687463eb-aeb9-41ad-ac05-f1679fda22d9 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:21:04.082556 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687463eb-aeb9-41ad-ac05-f1679fda22d9 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:21:04.082717 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687463eb-aeb9-41ad-ac05-f1679fda22d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:21:04.101165 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-687463eb-aeb9-41ad-ac05-f1679fda22d9 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:21:04.102651 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-687463eb-aeb9-41ad-ac05-f1679fda22d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:21:04.165657 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1434/2850] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 10:21:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:21:04.173973 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3dc6b1-9e3e-4385-adb0-98a095cb934d None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:21:04.174310 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3dc6b1-9e3e-4385-adb0-98a095cb934d None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:21:04.174599 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3dc6b1-9e3e-4385-adb0-98a095cb934d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:21:04.194335 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-cd3dc6b1-9e3e-4385-adb0-98a095cb934d None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:21:04.195543 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-cd3dc6b1-9e3e-4385-adb0-98a095cb934d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:21:04.203455 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1417/2851] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 10:21:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:21:04.207585 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687463eb-aeb9-41ad-ac05-f1679fda22d9 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:21:04.217355 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687463eb-aeb9-41ad-ac05-f1679fda22d9 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:21:04.221853 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7253835-f646-4d20-95cb-0647a0caccea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:21:04.222538 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7253835-f646-4d20-95cb-0647a0caccea admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:21:04.222824 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7253835-f646-4d20-95cb-0647a0caccea admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:21:04.223099 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7253835-f646-4d20-95cb-0647a0caccea admin admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:21:04.223824 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7253835-f646-4d20-95cb-0647a0caccea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:21:04.224158 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7253835-f646-4d20-95cb-0647a0caccea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:21:04.225742 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7253835-f646-4d20-95cb-0647a0caccea admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:21:04.237002 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1435/2852] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jul 14 10:21:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:21:04.242019 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3dc6b1-9e3e-4385-adb0-98a095cb934d None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:21:04.251412 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3dc6b1-9e3e-4385-adb0-98a095cb934d None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:21:04.256605 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494fd4ea-e09c-46ee-b6fc-6db47843593a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:21:04.257246 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494fd4ea-e09c-46ee-b6fc-6db47843593a admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:21:04.257528 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494fd4ea-e09c-46ee-b6fc-6db47843593a admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:21:04.257802 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494fd4ea-e09c-46ee-b6fc-6db47843593a admin admin] PATH_INFO: `/v3/projects` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:21:04.258525 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494fd4ea-e09c-46ee-b6fc-6db47843593a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:21:04.260403 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494fd4ea-e09c-46ee-b6fc-6db47843593a admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:21:04.284808 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1418/2853] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 14 10:21:04 2022] POST /identity/v3/projects => generated 385 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:21:04.289300 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7253835-f646-4d20-95cb-0647a0caccea admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:21:04.299141 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7253835-f646-4d20-95cb-0647a0caccea admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:21:04.354217 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ab85a7-0aa4-4c57-b899-7370d547df43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:21:04.354828 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ab85a7-0aa4-4c57-b899-7370d547df43 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:21:04.355115 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ab85a7-0aa4-4c57-b899-7370d547df43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:21:04.355394 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ab85a7-0aa4-4c57-b899-7370d547df43 admin admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:21:04.356111 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ab85a7-0aa4-4c57-b899-7370d547df43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:21:04.358017 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ab85a7-0aa4-4c57-b899-7370d547df43 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:21:04.365888 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:21:04.381523 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1436/2854] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 14 10:21:04 2022] POST /identity/v3/users => generated 293 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 10:21:04.382887 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494fd4ea-e09c-46ee-b6fc-6db47843593a admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:21:04.393015 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494fd4ea-e09c-46ee-b6fc-6db47843593a admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:21:04.397619 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91178a2-2bf0-4032-9299-af8c10a4f0d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:21:04.398303 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91178a2-2bf0-4032-9299-af8c10a4f0d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:21:04.398587 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91178a2-2bf0-4032-9299-af8c10a4f0d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:21:04.398866 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91178a2-2bf0-4032-9299-af8c10a4f0d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:21:04.399660 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91178a2-2bf0-4032-9299-af8c10a4f0d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:21:04.401185 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91178a2-2bf0-4032-9299-af8c10a4f0d8 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:21:04.412340 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1419/2855] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 10:21:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:21:04.416129 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ab85a7-0aa4-4c57-b899-7370d547df43 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:21:04.425905 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ab85a7-0aa4-4c57-b899-7370d547df43 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:21:04.431128 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27f7bed-8d48-423f-ad86-02190f1a4e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:21:04.431779 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27f7bed-8d48-423f-ad86-02190f1a4e8d admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:21:04.432064 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27f7bed-8d48-423f-ad86-02190f1a4e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:21:04.432360 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27f7bed-8d48-423f-ad86-02190f1a4e8d admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:21:04.433055 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27f7bed-8d48-423f-ad86-02190f1a4e8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:21:04.434682 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27f7bed-8d48-423f-ad86-02190f1a4e8d admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:21:04.444645 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1437/2856] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 10:21:04 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:21:04.448510 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91178a2-2bf0-4032-9299-af8c10a4f0d8 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:21:04.458257 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91178a2-2bf0-4032-9299-af8c10a4f0d8 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:21:04.462896 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbfc415-b18e-47a3-84f5-aa94e2d92444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:21:04.463851 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbfc415-b18e-47a3-84f5-aa94e2d92444 admin admin] REQUEST_METHOD: `PUT` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:21:04.464184 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbfc415-b18e-47a3-84f5-aa94e2d92444 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:21:04.464474 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbfc415-b18e-47a3-84f5-aa94e2d92444 admin admin] PATH_INFO: `/v3/projects/7a3cbb1000d7446dbfbc109fd4f20ede/users/12048df41638418dbc719855ed3d4dfb/roles/17dfac38a2e540fea229af7de99911bb` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:21:04.483691 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbfc415-b18e-47a3-84f5-aa94e2d92444 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a3cbb1000d7446dbfbc109fd4f20ede, user_id=12048df41638418dbc719855ed3d4dfb, role_id=17dfac38a2e540fea229af7de99911bb)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:21:04.486395 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbfc415-b18e-47a3-84f5-aa94e2d92444 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:21:04.500235 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1420/2857] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 14 10:21:04 2022] PUT /identity/v3/projects/7a3cbb1000d7446dbfbc109fd4f20ede/users/12048df41638418dbc719855ed3d4dfb/roles/17dfac38a2e540fea229af7de99911bb => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:21:04.511308 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fde8c4-21a0-42c1-bd72-a468e5ff5647 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:21:04.511625 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fde8c4-21a0-42c1-bd72-a468e5ff5647 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:21:04.511906 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fde8c4-21a0-42c1-bd72-a468e5ff5647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:21:04.538583 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-68fde8c4-21a0-42c1-bd72-a468e5ff5647 None None] MFA Rules not processed for user `12048df41638418dbc719855ed3d4dfb`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:21:04.539803 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-68fde8c4-21a0-42c1-bd72-a468e5ff5647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:21:04.603048 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1438/2858] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 10:21:04 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 10:21:04.614146 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbfc415-b18e-47a3-84f5-aa94e2d92444 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:21:04.616495 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-6bbfc415-b18e-47a3-84f5-aa94e2d92444 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:21:04.670917 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbfc415-b18e-47a3-84f5-aa94e2d92444 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:21:04.674566 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cf194f-b8e9-4220-bc41-7256ef819481 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25048b29787d482783ebc944f1a7df65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:21:04.675208 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cf194f-b8e9-4220-bc41-7256ef819481 service cinder] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:21:04.675493 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cf194f-b8e9-4220-bc41-7256ef819481 service cinder] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:21:04.675771 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cf194f-b8e9-4220-bc41-7256ef819481 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:21:04.684582 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cf194f-b8e9-4220-bc41-7256ef819481 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:21:04.686000 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cf194f-b8e9-4220-bc41-7256ef819481 service cinder] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:21:04.694962 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1421/2859] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 10:21:04 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:21:04.713781 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fde8c4-21a0-42c1-bd72-a468e5ff5647 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:21:04.775867 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fde8c4-21a0-42c1-bd72-a468e5ff5647 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:21:04.780440 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10377fb4-754c-4604-a71b-d041b638cb8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:21:04.781340 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10377fb4-754c-4604-a71b-d041b638cb8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:21:04.781622 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10377fb4-754c-4604-a71b-d041b638cb8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:21:04.781896 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10377fb4-754c-4604-a71b-d041b638cb8d admin admin] PATH_INFO: `/v3/users/12048df41638418dbc719855ed3d4dfb` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:21:04.783580 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10377fb4-754c-4604-a71b-d041b638cb8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=12048df41638418dbc719855ed3d4dfb)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:21:04.785490 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10377fb4-754c-4604-a71b-d041b638cb8d admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:21:04.836921 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-10377fb4-754c-4604-a71b-d041b638cb8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12048df41638418dbc719855ed3d4dfb'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:21:04.848686 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-10377fb4-754c-4604-a71b-d041b638cb8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12048df41638418dbc719855ed3d4dfb'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:21:04.849957 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-10377fb4-754c-4604-a71b-d041b638cb8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12048df41638418dbc719855ed3d4dfb'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:21:04.856821 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-10377fb4-754c-4604-a71b-d041b638cb8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12048df41638418dbc719855ed3d4dfb'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:21:04.857990 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:INSERT=3,keystone:SELECT=87,keystone:DELETE=10 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:21:04.866539 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-10377fb4-754c-4604-a71b-d041b638cb8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12048df41638418dbc719855ed3d4dfb'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:21:04.872703 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1439/2860] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 14 10:21:04 2022] DELETE /identity/v3/users/12048df41638418dbc719855ed3d4dfb => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:21:04.877348 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540cd4ff-e21d-4481-80cb-f6029fa26c12 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:21:04.877642 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540cd4ff-e21d-4481-80cb-f6029fa26c12 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:21:04.877920 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540cd4ff-e21d-4481-80cb-f6029fa26c12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:21:04.894701 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-540cd4ff-e21d-4481-80cb-f6029fa26c12 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:21:04.896399 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-540cd4ff-e21d-4481-80cb-f6029fa26c12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:21:04.953400 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1422/2861] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 10:21:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 10:21:04.963451 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10377fb4-754c-4604-a71b-d041b638cb8d admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:21:04.964840 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-10377fb4-754c-4604-a71b-d041b638cb8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:21:05.020194 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10377fb4-754c-4604-a71b-d041b638cb8d admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:21:05.024330 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0b1984-1e03-40fc-96ab-459e7073abf3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e4a5a8965e4802a9055d332179b7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:21:05.024978 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0b1984-1e03-40fc-96ab-459e7073abf3 service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:21:05.025267 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0b1984-1e03-40fc-96ab-459e7073abf3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:21:05.025547 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0b1984-1e03-40fc-96ab-459e7073abf3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:21:05.034525 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0b1984-1e03-40fc-96ab-459e7073abf3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:21:05.035963 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0b1984-1e03-40fc-96ab-459e7073abf3 service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:21:05.045943 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1440/2862] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 10:21:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:21:05.312128 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540cd4ff-e21d-4481-80cb-f6029fa26c12 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:21:05.313655 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-540cd4ff-e21d-4481-80cb-f6029fa26c12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:21:05.327027 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540cd4ff-e21d-4481-80cb-f6029fa26c12 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:21:05.331843 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acf0d52-8cc3-4bee-9f48-e42425b6cb46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:21:05.332786 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acf0d52-8cc3-4bee-9f48-e42425b6cb46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:21:05.333141 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acf0d52-8cc3-4bee-9f48-e42425b6cb46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:21:05.333474 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acf0d52-8cc3-4bee-9f48-e42425b6cb46 admin admin] PATH_INFO: `/v3/projects/7a3cbb1000d7446dbfbc109fd4f20ede` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:21:05.335269 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acf0d52-8cc3-4bee-9f48-e42425b6cb46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a3cbb1000d7446dbfbc109fd4f20ede)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:21:05.337179 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acf0d52-8cc3-4bee-9f48-e42425b6cb46 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:21:05.354494 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:21:05.384455 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-9acf0d52-8cc3-4bee-9f48-e42425b6cb46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a3cbb1000d7446dbfbc109fd4f20ede', 'request_id': 'req-9acf0d52-8cc3-4bee-9f48-e42425b6cb46'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:21:05.390864 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-9acf0d52-8cc3-4bee-9f48-e42425b6cb46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a3cbb1000d7446dbfbc109fd4f20ede', 'request_id': 'req-9acf0d52-8cc3-4bee-9f48-e42425b6cb46'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:21:05.396906 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-9acf0d52-8cc3-4bee-9f48-e42425b6cb46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a3cbb1000d7446dbfbc109fd4f20ede', 'request_id': 'req-9acf0d52-8cc3-4bee-9f48-e42425b6cb46'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:21:05.407725 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-9acf0d52-8cc3-4bee-9f48-e42425b6cb46 admin admin] The token cache is being invalidate because project 7a3cbb1000d7446dbfbc109fd4f20ede was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:21:05.408014 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-9acf0d52-8cc3-4bee-9f48-e42425b6cb46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:21:05.408885 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-9acf0d52-8cc3-4bee-9f48-e42425b6cb46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:21:05.410483 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1423/2863] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 14 10:21:05 2022] DELETE /identity/v3/projects/7a3cbb1000d7446dbfbc109fd4f20ede => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:21:05.415390 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e6a070-34fc-42c6-92ed-22b499dcb868 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:21:05.415848 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e6a070-34fc-42c6-92ed-22b499dcb868 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:21:05.415934 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e6a070-34fc-42c6-92ed-22b499dcb868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:21:05.434422 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-03e6a070-34fc-42c6-92ed-22b499dcb868 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:21:05.435688 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-03e6a070-34fc-42c6-92ed-22b499dcb868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:21:05.494274 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1441/2864] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 10:21:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:21:05.501823 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350ae730-7ebc-4926-9252-c213a35228f8 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:21:05.502114 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350ae730-7ebc-4926-9252-c213a35228f8 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:21:05.502418 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350ae730-7ebc-4926-9252-c213a35228f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:21:05.520824 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-350ae730-7ebc-4926-9252-c213a35228f8 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:21:05.522013 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-350ae730-7ebc-4926-9252-c213a35228f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:21:05.530015 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1424/2865] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 10:21:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:21:05.534180 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e6a070-34fc-42c6-92ed-22b499dcb868 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:21:05.543783 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e6a070-34fc-42c6-92ed-22b499dcb868 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:21:05.548430 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a0d5a5-5233-4ead-a12c-0dabd34b0ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:21:05.549107 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a0d5a5-5233-4ead-a12c-0dabd34b0ea4 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:21:05.549400 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a0d5a5-5233-4ead-a12c-0dabd34b0ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:21:05.549686 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a0d5a5-5233-4ead-a12c-0dabd34b0ea4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:21:05.550456 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a0d5a5-5233-4ead-a12c-0dabd34b0ea4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:21:05.550770 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a0d5a5-5233-4ead-a12c-0dabd34b0ea4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:21:05.552946 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a0d5a5-5233-4ead-a12c-0dabd34b0ea4 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:21:05.564569 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1442/2866] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jul 14 10:21:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:21:05.569579 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350ae730-7ebc-4926-9252-c213a35228f8 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:21:05.578843 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350ae730-7ebc-4926-9252-c213a35228f8 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:21:05.583482 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bceac0a9-d3a3-4910-b083-81655d9f5120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:21:05.584126 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceac0a9-d3a3-4910-b083-81655d9f5120 admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:21:05.584408 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceac0a9-d3a3-4910-b083-81655d9f5120 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:21:05.584684 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceac0a9-d3a3-4910-b083-81655d9f5120 admin admin] PATH_INFO: `/v3/projects` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:21:05.585384 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bceac0a9-d3a3-4910-b083-81655d9f5120 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:21:05.587343 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bceac0a9-d3a3-4910-b083-81655d9f5120 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:21:05.613655 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1425/2867] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 14 10:21:05 2022] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:21:05.618178 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a0d5a5-5233-4ead-a12c-0dabd34b0ea4 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:21:05.628083 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a0d5a5-5233-4ead-a12c-0dabd34b0ea4 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:21:05.683040 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b33610-3738-403d-a085-569ede853093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:21:05.683709 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b33610-3738-403d-a085-569ede853093 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:21:05.683996 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b33610-3738-403d-a085-569ede853093 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:21:05.684274 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b33610-3738-403d-a085-569ede853093 admin admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:21:05.684969 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b33610-3738-403d-a085-569ede853093 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:21:05.686924 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b33610-3738-403d-a085-569ede853093 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:21:05.706720 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1443/2868] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 14 10:21:05 2022] POST /identity/v3/users => generated 287 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:21:05.710848 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bceac0a9-d3a3-4910-b083-81655d9f5120 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:21:05.721118 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bceac0a9-d3a3-4910-b083-81655d9f5120 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:21:05.725703 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b65e7a-16d5-48e0-a047-d9da1916ddef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:21:05.726401 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b65e7a-16d5-48e0-a047-d9da1916ddef admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:21:05.726691 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b65e7a-16d5-48e0-a047-d9da1916ddef admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:21:05.726968 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b65e7a-16d5-48e0-a047-d9da1916ddef admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:21:05.727702 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b65e7a-16d5-48e0-a047-d9da1916ddef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:21:05.729287 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b65e7a-16d5-48e0-a047-d9da1916ddef admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:21:05.739492 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1426/2869] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 10:21:05 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:21:05.743564 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b33610-3738-403d-a085-569ede853093 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:21:05.753334 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b33610-3738-403d-a085-569ede853093 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:21:05.758689 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ee1c42-0d84-481f-850e-a84d9fbeab9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:21:05.759340 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ee1c42-0d84-481f-850e-a84d9fbeab9a admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:21:05.759624 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ee1c42-0d84-481f-850e-a84d9fbeab9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:21:05.759909 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ee1c42-0d84-481f-850e-a84d9fbeab9a admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:21:05.760632 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ee1c42-0d84-481f-850e-a84d9fbeab9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:21:05.762349 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ee1c42-0d84-481f-850e-a84d9fbeab9a admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:21:05.764393 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:21:05.775745 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1444/2870] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 10:21:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 10:21:05.779731 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b65e7a-16d5-48e0-a047-d9da1916ddef admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:21:05.790001 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b65e7a-16d5-48e0-a047-d9da1916ddef admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:21:05.794570 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c403db6-e355-4820-ab66-9bde5e6aeb7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:21:05.795440 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c403db6-e355-4820-ab66-9bde5e6aeb7b admin admin] REQUEST_METHOD: `PUT` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:21:05.795721 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c403db6-e355-4820-ab66-9bde5e6aeb7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:21:05.795994 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c403db6-e355-4820-ab66-9bde5e6aeb7b admin admin] PATH_INFO: `/v3/projects/350b009e07ab4b32bfe40f7a5ba7f638/users/f0b72abce3844fb7a080148eba22c993/roles/17dfac38a2e540fea229af7de99911bb` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:21:05.810746 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c403db6-e355-4820-ab66-9bde5e6aeb7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=350b009e07ab4b32bfe40f7a5ba7f638, user_id=f0b72abce3844fb7a080148eba22c993, role_id=17dfac38a2e540fea229af7de99911bb)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:21:05.813387 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c403db6-e355-4820-ab66-9bde5e6aeb7b admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:21:05.826613 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1427/2871] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 14 10:21:05 2022] PUT /identity/v3/projects/350b009e07ab4b32bfe40f7a5ba7f638/users/f0b72abce3844fb7a080148eba22c993/roles/17dfac38a2e540fea229af7de99911bb => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:21:05.836509 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c538d7-9fb4-45eb-bc47-1a2a545686da None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:21:05.836797 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c538d7-9fb4-45eb-bc47-1a2a545686da None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:21:05.837076 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c538d7-9fb4-45eb-bc47-1a2a545686da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:21:05.863457 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-b0c538d7-9fb4-45eb-bc47-1a2a545686da None None] MFA Rules not processed for user `f0b72abce3844fb7a080148eba22c993`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:21:05.865279 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-b0c538d7-9fb4-45eb-bc47-1a2a545686da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:21:05.928377 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1445/2872] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 10:21:05 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:21:05.932825 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c403db6-e355-4820-ab66-9bde5e6aeb7b admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:21:05.993691 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c403db6-e355-4820-ab66-9bde5e6aeb7b admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:21:05.998173 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6594cc-803c-4ce8-91d6-0df10d54300a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:21:05.998854 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6594cc-803c-4ce8-91d6-0df10d54300a admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:21:05.999140 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6594cc-803c-4ce8-91d6-0df10d54300a admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:21:05.999421 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6594cc-803c-4ce8-91d6-0df10d54300a admin admin] PATH_INFO: `/v3/projects` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:21:06.000119 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6594cc-803c-4ce8-91d6-0df10d54300a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:21:06.002022 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6594cc-803c-4ce8-91d6-0df10d54300a admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:21:06.028318 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1428/2873] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 14 10:21:05 2022] POST /identity/v3/projects => generated 373 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 10:21:06.032426 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c538d7-9fb4-45eb-bc47-1a2a545686da None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:21:06.043809 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c538d7-9fb4-45eb-bc47-1a2a545686da None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:21:06.100034 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd0aa75-e51b-4557-a7ab-69918e47457c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:21:06.100704 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd0aa75-e51b-4557-a7ab-69918e47457c admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:21:06.100992 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd0aa75-e51b-4557-a7ab-69918e47457c admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:21:06.101273 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd0aa75-e51b-4557-a7ab-69918e47457c admin admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:21:06.101972 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd0aa75-e51b-4557-a7ab-69918e47457c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:21:06.103929 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd0aa75-e51b-4557-a7ab-69918e47457c admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:21:06.123665 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1446/2874] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 14 10:21:06 2022] POST /identity/v3/users => generated 293 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 10:21:06.127807 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6594cc-803c-4ce8-91d6-0df10d54300a admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:21:06.138476 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6594cc-803c-4ce8-91d6-0df10d54300a admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:21:06.143104 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaa78c5-d18c-4f70-a719-c20b346a88e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:21:06.143767 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaa78c5-d18c-4f70-a719-c20b346a88e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:21:06.144057 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaa78c5-d18c-4f70-a719-c20b346a88e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:21:06.144339 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaa78c5-d18c-4f70-a719-c20b346a88e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:21:06.145074 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaa78c5-d18c-4f70-a719-c20b346a88e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:21:06.146722 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaa78c5-d18c-4f70-a719-c20b346a88e9 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:21:06.157101 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1429/2875] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 10:21:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 10:21:06.161006 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd0aa75-e51b-4557-a7ab-69918e47457c admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:21:06.171645 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd0aa75-e51b-4557-a7ab-69918e47457c admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:21:06.176247 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f02638-16e9-48f6-a113-1c546cbf6c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:21:06.177688 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f02638-16e9-48f6-a113-1c546cbf6c70 admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:21:06.177984 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f02638-16e9-48f6-a113-1c546cbf6c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:21:06.178294 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f02638-16e9-48f6-a113-1c546cbf6c70 admin admin] PATH_INFO: `/v3/projects/a6b3c9cd7acc42d5a0a7ab0243b546b2/users/45be2f99f64e452a890edb7dabb24149/roles/e3965bd0d5f1427a86a313c0c90bfef3` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:21:06.192773 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f02638-16e9-48f6-a113-1c546cbf6c70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6b3c9cd7acc42d5a0a7ab0243b546b2, user_id=45be2f99f64e452a890edb7dabb24149, role_id=e3965bd0d5f1427a86a313c0c90bfef3)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:21:06.195713 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f02638-16e9-48f6-a113-1c546cbf6c70 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:21:06.208251 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1447/2876] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 14 10:21:06 2022] PUT /identity/v3/projects/a6b3c9cd7acc42d5a0a7ab0243b546b2/users/45be2f99f64e452a890edb7dabb24149/roles/e3965bd0d5f1427a86a313c0c90bfef3 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:21:06.212521 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaa78c5-d18c-4f70-a719-c20b346a88e9 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:21:06.222344 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaa78c5-d18c-4f70-a719-c20b346a88e9 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:21:06.234052 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:21:06.279569 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a6290c-e4b0-4e10-aa57-2ea5570e444a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:21:06.280171 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a6290c-e4b0-4e10-aa57-2ea5570e444a admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:21:06.280458 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a6290c-e4b0-4e10-aa57-2ea5570e444a admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:21:06.280738 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a6290c-e4b0-4e10-aa57-2ea5570e444a admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:21:06.281465 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a6290c-e4b0-4e10-aa57-2ea5570e444a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:21:06.283086 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a6290c-e4b0-4e10-aa57-2ea5570e444a admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:21:06.293220 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1430/2877] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 10:21:06 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:21:06.297394 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f02638-16e9-48f6-a113-1c546cbf6c70 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:21:06.307534 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f02638-16e9-48f6-a113-1c546cbf6c70 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:21:06.312044 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efdafd0-ef38-4d52-b0f5-97bba3d9386e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:21:06.312916 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efdafd0-ef38-4d52-b0f5-97bba3d9386e admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:21:06.313198 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efdafd0-ef38-4d52-b0f5-97bba3d9386e admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:21:06.313473 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efdafd0-ef38-4d52-b0f5-97bba3d9386e admin admin] PATH_INFO: `/v3/projects/a6b3c9cd7acc42d5a0a7ab0243b546b2/users/45be2f99f64e452a890edb7dabb24149/roles/e3965bd0d5f1427a86a313c0c90bfef3` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:21:06.315573 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efdafd0-ef38-4d52-b0f5-97bba3d9386e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6b3c9cd7acc42d5a0a7ab0243b546b2, user_id=45be2f99f64e452a890edb7dabb24149, role_id=e3965bd0d5f1427a86a313c0c90bfef3)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:21:06.318292 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efdafd0-ef38-4d52-b0f5-97bba3d9386e admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:21:06.328635 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1448/2878] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 14 10:21:06 2022] PUT /identity/v3/projects/a6b3c9cd7acc42d5a0a7ab0243b546b2/users/45be2f99f64e452a890edb7dabb24149/roles/e3965bd0d5f1427a86a313c0c90bfef3 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:21:06.340054 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cfd714-f997-425b-ac59-9c5be76d9f48 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:21:06.340541 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cfd714-f997-425b-ac59-9c5be76d9f48 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:21:06.340637 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cfd714-f997-425b-ac59-9c5be76d9f48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:21:06.366527 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-14cfd714-f997-425b-ac59-9c5be76d9f48 None None] MFA Rules not processed for user `45be2f99f64e452a890edb7dabb24149`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:21:06.367714 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-14cfd714-f997-425b-ac59-9c5be76d9f48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:21:06.434264 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1431/2879] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 10:21:06 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:21:06.445291 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efdafd0-ef38-4d52-b0f5-97bba3d9386e admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:21:06.447034 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-8efdafd0-ef38-4d52-b0f5-97bba3d9386e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:21:06.491817 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:21:06.507536 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efdafd0-ef38-4d52-b0f5-97bba3d9386e admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:21:06.514419 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608bca69-a060-47cd-8910-10e03debe00a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25048b29787d482783ebc944f1a7df65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:21:06.515068 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608bca69-a060-47cd-8910-10e03debe00a service cinder] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:21:06.515351 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608bca69-a060-47cd-8910-10e03debe00a service cinder] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:21:06.515627 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608bca69-a060-47cd-8910-10e03debe00a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:21:06.573118 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608bca69-a060-47cd-8910-10e03debe00a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:21:06.574590 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608bca69-a060-47cd-8910-10e03debe00a service cinder] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:21:06.584094 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1449/2880] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 10:21:06 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 10:21:09.081007 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cfd714-f997-425b-ac59-9c5be76d9f48 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:21:09.147634 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cfd714-f997-425b-ac59-9c5be76d9f48 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:21:09.152075 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c318c6-a2d5-45cd-8e18-e8cee4a913bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:21:09.152943 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c318c6-a2d5-45cd-8e18-e8cee4a913bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:21:09.153228 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c318c6-a2d5-45cd-8e18-e8cee4a913bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:21:09.153503 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c318c6-a2d5-45cd-8e18-e8cee4a913bc admin admin] PATH_INFO: `/v3/users/f0b72abce3844fb7a080148eba22c993` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:21:09.154711 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c318c6-a2d5-45cd-8e18-e8cee4a913bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0b72abce3844fb7a080148eba22c993)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:21:09.156620 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c318c6-a2d5-45cd-8e18-e8cee4a913bc admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:21:09.200267 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:21:09.206714 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-98c318c6-a2d5-45cd-8e18-e8cee4a913bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0b72abce3844fb7a080148eba22c993'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:21:09.213521 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-98c318c6-a2d5-45cd-8e18-e8cee4a913bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0b72abce3844fb7a080148eba22c993'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:21:09.214180 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-98c318c6-a2d5-45cd-8e18-e8cee4a913bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0b72abce3844fb7a080148eba22c993'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:21:09.221108 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-98c318c6-a2d5-45cd-8e18-e8cee4a913bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0b72abce3844fb7a080148eba22c993'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:21:09.221730 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-98c318c6-a2d5-45cd-8e18-e8cee4a913bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0b72abce3844fb7a080148eba22c993'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:21:09.238747 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1432/2881] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 14 10:21:09 2022] DELETE /identity/v3/users/f0b72abce3844fb7a080148eba22c993 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:21:09.243817 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c9cc05-bffe-4d13-b0f7-a8ab8e4e68b9 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:21:09.244284 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c9cc05-bffe-4d13-b0f7-a8ab8e4e68b9 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:21:09.244407 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c9cc05-bffe-4d13-b0f7-a8ab8e4e68b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:21:09.262012 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-01c9cc05-bffe-4d13-b0f7-a8ab8e4e68b9 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:21:09.263224 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-01c9cc05-bffe-4d13-b0f7-a8ab8e4e68b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:21:09.320410 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1450/2882] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 10:21:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:21:09.329885 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c318c6-a2d5-45cd-8e18-e8cee4a913bc admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:21:09.331342 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-98c318c6-a2d5-45cd-8e18-e8cee4a913bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:21:09.387643 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c318c6-a2d5-45cd-8e18-e8cee4a913bc admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:21:09.391309 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3860b5db-73e3-4db0-a317-1b197b8a2f9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e4a5a8965e4802a9055d332179b7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:21:09.391954 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3860b5db-73e3-4db0-a317-1b197b8a2f9c service neutron] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:21:09.392237 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3860b5db-73e3-4db0-a317-1b197b8a2f9c service neutron] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:21:09.392513 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3860b5db-73e3-4db0-a317-1b197b8a2f9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:21:09.401332 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3860b5db-73e3-4db0-a317-1b197b8a2f9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:21:09.402794 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3860b5db-73e3-4db0-a317-1b197b8a2f9c service neutron] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:21:09.412145 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1433/2883] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 10:21:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:21:09.680655 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c9cc05-bffe-4d13-b0f7-a8ab8e4e68b9 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:21:09.682070 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-01c9cc05-bffe-4d13-b0f7-a8ab8e4e68b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:21:09.693852 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c9cc05-bffe-4d13-b0f7-a8ab8e4e68b9 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:21:09.698873 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604ed845-cb1e-47fb-abd5-c0f6fc040033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:21:09.699811 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604ed845-cb1e-47fb-abd5-c0f6fc040033 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:21:09.700161 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604ed845-cb1e-47fb-abd5-c0f6fc040033 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:21:09.700501 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604ed845-cb1e-47fb-abd5-c0f6fc040033 admin admin] PATH_INFO: `/v3/projects/350b009e07ab4b32bfe40f7a5ba7f638` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:21:09.701869 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604ed845-cb1e-47fb-abd5-c0f6fc040033 admin admin] RBAC: Authorizing `identity:delete_project(project_id=350b009e07ab4b32bfe40f7a5ba7f638)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:21:09.703957 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604ed845-cb1e-47fb-abd5-c0f6fc040033 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:21:09.750941 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-604ed845-cb1e-47fb-abd5-c0f6fc040033 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '350b009e07ab4b32bfe40f7a5ba7f638', 'request_id': 'req-604ed845-cb1e-47fb-abd5-c0f6fc040033'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:21:09.756942 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-604ed845-cb1e-47fb-abd5-c0f6fc040033 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '350b009e07ab4b32bfe40f7a5ba7f638', 'request_id': 'req-604ed845-cb1e-47fb-abd5-c0f6fc040033'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:21:09.762695 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-604ed845-cb1e-47fb-abd5-c0f6fc040033 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '350b009e07ab4b32bfe40f7a5ba7f638', 'request_id': 'req-604ed845-cb1e-47fb-abd5-c0f6fc040033'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:21:09.775398 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-604ed845-cb1e-47fb-abd5-c0f6fc040033 admin admin] The token cache is being invalidate because project 350b009e07ab4b32bfe40f7a5ba7f638 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:21:09.775683 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-604ed845-cb1e-47fb-abd5-c0f6fc040033 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:21:09.776310 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-604ed845-cb1e-47fb-abd5-c0f6fc040033 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:21:09.777850 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1451/2884] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 14 10:21:09 2022] DELETE /identity/v3/projects/350b009e07ab4b32bfe40f7a5ba7f638 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:21:09.781813 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3860b5db-73e3-4db0-a317-1b197b8a2f9c service neutron] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:21:09.792094 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3860b5db-73e3-4db0-a317-1b197b8a2f9c service neutron] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:21:09.846461 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b915b726-f232-42f7-b401-8ac8a3346715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:21:09.847336 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b915b726-f232-42f7-b401-8ac8a3346715 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:21:09.847620 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b915b726-f232-42f7-b401-8ac8a3346715 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:21:09.847896 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b915b726-f232-42f7-b401-8ac8a3346715 admin admin] PATH_INFO: `/v3/users/45be2f99f64e452a890edb7dabb24149` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:21:09.849183 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b915b726-f232-42f7-b401-8ac8a3346715 admin admin] RBAC: Authorizing `identity:delete_user(user_id=45be2f99f64e452a890edb7dabb24149)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:21:09.851806 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b915b726-f232-42f7-b401-8ac8a3346715 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:21:09.897207 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-b915b726-f232-42f7-b401-8ac8a3346715 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45be2f99f64e452a890edb7dabb24149'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:21:09.903922 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-b915b726-f232-42f7-b401-8ac8a3346715 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45be2f99f64e452a890edb7dabb24149'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:21:09.904566 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-b915b726-f232-42f7-b401-8ac8a3346715 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45be2f99f64e452a890edb7dabb24149'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:21:09.908102 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:21:09.911985 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-b915b726-f232-42f7-b401-8ac8a3346715 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45be2f99f64e452a890edb7dabb24149'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:21:09.913389 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-b915b726-f232-42f7-b401-8ac8a3346715 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45be2f99f64e452a890edb7dabb24149'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:21:09.931419 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1434/2885] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 14 10:21:09 2022] DELETE /identity/v3/users/45be2f99f64e452a890edb7dabb24149 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:21:10.198311 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604ed845-cb1e-47fb-abd5-c0f6fc040033 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:21:10.199802 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-604ed845-cb1e-47fb-abd5-c0f6fc040033 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:21:10.220547 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604ed845-cb1e-47fb-abd5-c0f6fc040033 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:21:10.234950 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:21:10.279911 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba836f45-c6c3-4a61-a552-e9b864ad3222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:21:10.280742 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba836f45-c6c3-4a61-a552-e9b864ad3222 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:21:10.281030 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba836f45-c6c3-4a61-a552-e9b864ad3222 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:21:10.281311 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba836f45-c6c3-4a61-a552-e9b864ad3222 admin admin] PATH_INFO: `/v3/projects/a6b3c9cd7acc42d5a0a7ab0243b546b2` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:21:10.282572 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba836f45-c6c3-4a61-a552-e9b864ad3222 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6b3c9cd7acc42d5a0a7ab0243b546b2)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:21:10.284468 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba836f45-c6c3-4a61-a552-e9b864ad3222 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:21:10.329797 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-ba836f45-c6c3-4a61-a552-e9b864ad3222 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6b3c9cd7acc42d5a0a7ab0243b546b2', 'request_id': 'req-ba836f45-c6c3-4a61-a552-e9b864ad3222'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:21:10.336364 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-ba836f45-c6c3-4a61-a552-e9b864ad3222 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6b3c9cd7acc42d5a0a7ab0243b546b2', 'request_id': 'req-ba836f45-c6c3-4a61-a552-e9b864ad3222'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:21:10.341921 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-ba836f45-c6c3-4a61-a552-e9b864ad3222 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6b3c9cd7acc42d5a0a7ab0243b546b2', 'request_id': 'req-ba836f45-c6c3-4a61-a552-e9b864ad3222'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:21:10.354539 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-ba836f45-c6c3-4a61-a552-e9b864ad3222 admin admin] The token cache is being invalidate because project a6b3c9cd7acc42d5a0a7ab0243b546b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:21:10.354861 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-ba836f45-c6c3-4a61-a552-e9b864ad3222 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:21:10.355531 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-ba836f45-c6c3-4a61-a552-e9b864ad3222 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:21:10.357100 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1452/2886] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 14 10:21:10 2022] DELETE /identity/v3/projects/a6b3c9cd7acc42d5a0a7ab0243b546b2 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:21:10.362204 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f66614-da36-4df0-ac69-8f9af0dac99b None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:21:10.362690 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f66614-da36-4df0-ac69-8f9af0dac99b None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:21:10.363198 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f66614-da36-4df0-ac69-8f9af0dac99b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:21:10.382576 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-a6f66614-da36-4df0-ac69-8f9af0dac99b None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:21:10.383770 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-a6f66614-da36-4df0-ac69-8f9af0dac99b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:21:10.440019 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1435/2887] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 10:21:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:21:10.448382 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3055e17-066a-4fdc-870f-ab293ba07449 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:21:10.448720 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3055e17-066a-4fdc-870f-ab293ba07449 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:21:10.449006 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3055e17-066a-4fdc-870f-ab293ba07449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:21:10.469302 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-b3055e17-066a-4fdc-870f-ab293ba07449 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:21:10.470550 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-b3055e17-066a-4fdc-870f-ab293ba07449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:21:10.479194 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1453/2888] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 10:21:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:21:10.483567 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f66614-da36-4df0-ac69-8f9af0dac99b None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:21:10.493609 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f66614-da36-4df0-ac69-8f9af0dac99b None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:21:10.498139 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0effe5-318e-4f8b-a68b-3308e15706a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:21:10.498818 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0effe5-318e-4f8b-a68b-3308e15706a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:21:10.499128 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0effe5-318e-4f8b-a68b-3308e15706a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:21:10.499405 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0effe5-318e-4f8b-a68b-3308e15706a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:21:10.500131 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0effe5-318e-4f8b-a68b-3308e15706a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:21:10.500438 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0effe5-318e-4f8b-a68b-3308e15706a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:21:10.502017 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0effe5-318e-4f8b-a68b-3308e15706a5 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:21:10.513859 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1436/2889] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jul 14 10:21:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:21:10.518154 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3055e17-066a-4fdc-870f-ab293ba07449 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:21:10.528294 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3055e17-066a-4fdc-870f-ab293ba07449 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:21:10.533019 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf3801c-406b-4b8f-b317-4802a3e867fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:21:10.533622 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf3801c-406b-4b8f-b317-4802a3e867fb admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:21:10.533911 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf3801c-406b-4b8f-b317-4802a3e867fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:21:10.534216 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf3801c-406b-4b8f-b317-4802a3e867fb admin admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:21:10.534962 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf3801c-406b-4b8f-b317-4802a3e867fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:21:10.536878 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf3801c-406b-4b8f-b317-4802a3e867fb admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:21:10.562402 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1454/2890] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 14 10:21:10 2022] POST /identity/v3/projects => generated 375 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:21:10.566550 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0effe5-318e-4f8b-a68b-3308e15706a5 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:21:10.577603 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0effe5-318e-4f8b-a68b-3308e15706a5 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:21:10.632196 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6aba0c4-ea67-4fa7-81d3-9be506021da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:21:10.632870 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aba0c4-ea67-4fa7-81d3-9be506021da5 admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:21:10.633161 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aba0c4-ea67-4fa7-81d3-9be506021da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:21:10.633453 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aba0c4-ea67-4fa7-81d3-9be506021da5 admin admin] PATH_INFO: `/v3/users` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:21:10.634155 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6aba0c4-ea67-4fa7-81d3-9be506021da5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:21:10.636114 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6aba0c4-ea67-4fa7-81d3-9be506021da5 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:21:10.655854 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1437/2891] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 14 10:21:10 2022] POST /identity/v3/users => generated 288 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:21:10.660019 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf3801c-406b-4b8f-b317-4802a3e867fb admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:21:10.670354 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf3801c-406b-4b8f-b317-4802a3e867fb admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:21:10.674924 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c74df2c-760b-44b2-bd71-abe7976476cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:21:10.675584 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c74df2c-760b-44b2-bd71-abe7976476cb admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:21:10.675870 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c74df2c-760b-44b2-bd71-abe7976476cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:21:10.676151 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c74df2c-760b-44b2-bd71-abe7976476cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:21:10.676942 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c74df2c-760b-44b2-bd71-abe7976476cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:21:10.679088 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c74df2c-760b-44b2-bd71-abe7976476cb admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:21:10.689262 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1455/2892] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 10:21:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:21:10.693014 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6aba0c4-ea67-4fa7-81d3-9be506021da5 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:21:10.704216 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6aba0c4-ea67-4fa7-81d3-9be506021da5 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:21:10.708959 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3fbe5e-0629-4229-8860-abad371c2084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:21:10.709670 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3fbe5e-0629-4229-8860-abad371c2084 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:21:10.709960 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3fbe5e-0629-4229-8860-abad371c2084 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:21:10.710272 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3fbe5e-0629-4229-8860-abad371c2084 admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:21:10.711014 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3fbe5e-0629-4229-8860-abad371c2084 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:21:10.712615 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3fbe5e-0629-4229-8860-abad371c2084 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:21:10.722869 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1438/2893] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 10:21:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:21:10.727041 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c74df2c-760b-44b2-bd71-abe7976476cb admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:21:10.738088 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c74df2c-760b-44b2-bd71-abe7976476cb admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:21:10.743521 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd47c935-e4df-4405-8d18-7972ec89a70b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:21:10.744399 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd47c935-e4df-4405-8d18-7972ec89a70b admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:21:10.744682 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd47c935-e4df-4405-8d18-7972ec89a70b admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:21:10.744958 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd47c935-e4df-4405-8d18-7972ec89a70b admin admin] PATH_INFO: `/v3/projects/b7bfcd3410a744cb950bb28c3f84e9bb/users/0868161690204443be7ed1adf302d50b/roles/17dfac38a2e540fea229af7de99911bb` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:21:10.759973 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd47c935-e4df-4405-8d18-7972ec89a70b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7bfcd3410a744cb950bb28c3f84e9bb, user_id=0868161690204443be7ed1adf302d50b, role_id=17dfac38a2e540fea229af7de99911bb)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:21:10.762668 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd47c935-e4df-4405-8d18-7972ec89a70b admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:21:10.775456 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1456/2894] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 14 10:21:10 2022] PUT /identity/v3/projects/b7bfcd3410a744cb950bb28c3f84e9bb/users/0868161690204443be7ed1adf302d50b/roles/17dfac38a2e540fea229af7de99911bb => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:21:10.785690 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5377671e-52a7-4df7-954d-9419aaaedee5 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:21:10.785924 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5377671e-52a7-4df7-954d-9419aaaedee5 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:21:10.786265 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5377671e-52a7-4df7-954d-9419aaaedee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:21:10.812860 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-5377671e-52a7-4df7-954d-9419aaaedee5 None None] MFA Rules not processed for user `0868161690204443be7ed1adf302d50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:21:10.814064 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-5377671e-52a7-4df7-954d-9419aaaedee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:21:10.846729 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:21:10.881916 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1439/2895] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 10:21:10 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:21:10.886414 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd47c935-e4df-4405-8d18-7972ec89a70b admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:21:10.930966 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:21:10.948725 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd47c935-e4df-4405-8d18-7972ec89a70b admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:21:10.953403 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81fefb8-a486-4e6b-a16a-114cedc4893a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:21:10.954060 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81fefb8-a486-4e6b-a16a-114cedc4893a admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:21:10.954387 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81fefb8-a486-4e6b-a16a-114cedc4893a admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:21:10.954669 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81fefb8-a486-4e6b-a16a-114cedc4893a admin admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:21:10.955372 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81fefb8-a486-4e6b-a16a-114cedc4893a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:21:10.957257 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81fefb8-a486-4e6b-a16a-114cedc4893a admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:21:10.983149 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1457/2896] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 14 10:21:10 2022] POST /identity/v3/projects => generated 375 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:21:10.987134 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5377671e-52a7-4df7-954d-9419aaaedee5 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:21:10.998099 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5377671e-52a7-4df7-954d-9419aaaedee5 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:21:11.053685 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5189ce5d-b50f-480d-a0ff-804cf49ef3ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:21:11.054347 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5189ce5d-b50f-480d-a0ff-804cf49ef3ad admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:21:11.054642 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5189ce5d-b50f-480d-a0ff-804cf49ef3ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:21:11.054918 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5189ce5d-b50f-480d-a0ff-804cf49ef3ad admin admin] PATH_INFO: `/v3/users` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:21:11.055616 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5189ce5d-b50f-480d-a0ff-804cf49ef3ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:21:11.057531 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5189ce5d-b50f-480d-a0ff-804cf49ef3ad admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:21:11.076745 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1440/2897] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 14 10:21:10 2022] POST /identity/v3/users => generated 288 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:21:11.080745 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81fefb8-a486-4e6b-a16a-114cedc4893a admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:21:11.090995 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81fefb8-a486-4e6b-a16a-114cedc4893a admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:21:11.095662 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d251d11-ea36-440b-a816-7894d90a40b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:21:11.096322 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d251d11-ea36-440b-a816-7894d90a40b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:21:11.096609 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d251d11-ea36-440b-a816-7894d90a40b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:21:11.096891 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d251d11-ea36-440b-a816-7894d90a40b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:21:11.097619 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d251d11-ea36-440b-a816-7894d90a40b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:21:11.099252 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d251d11-ea36-440b-a816-7894d90a40b7 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:21:11.110090 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1458/2898] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 10:21:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:21:11.113704 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5189ce5d-b50f-480d-a0ff-804cf49ef3ad admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:21:11.124302 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5189ce5d-b50f-480d-a0ff-804cf49ef3ad admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:21:11.128938 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a184bc-2ad9-4710-9186-81f0b7620060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:21:11.129591 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a184bc-2ad9-4710-9186-81f0b7620060 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:21:11.129880 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a184bc-2ad9-4710-9186-81f0b7620060 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:21:11.130163 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a184bc-2ad9-4710-9186-81f0b7620060 admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:21:11.130963 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a184bc-2ad9-4710-9186-81f0b7620060 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:21:11.132549 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a184bc-2ad9-4710-9186-81f0b7620060 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:21:11.142658 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1441/2899] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 10:21:11 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:21:11.146739 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d251d11-ea36-440b-a816-7894d90a40b7 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:21:11.156633 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d251d11-ea36-440b-a816-7894d90a40b7 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:21:11.161311 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1b47f3-9310-4054-9824-8c405482575b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:21:11.162732 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1b47f3-9310-4054-9824-8c405482575b admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:21:11.163026 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1b47f3-9310-4054-9824-8c405482575b admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:21:11.163306 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1b47f3-9310-4054-9824-8c405482575b admin admin] PATH_INFO: `/v3/projects/aa4d0e34488444709a4d2811fe253dee/users/64464db902204e9ea70e1a4968800485/roles/17dfac38a2e540fea229af7de99911bb` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:21:11.180553 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1b47f3-9310-4054-9824-8c405482575b admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa4d0e34488444709a4d2811fe253dee, user_id=64464db902204e9ea70e1a4968800485, role_id=17dfac38a2e540fea229af7de99911bb)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:21:11.183232 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1b47f3-9310-4054-9824-8c405482575b admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:21:11.196555 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1459/2900] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 14 10:21:11 2022] PUT /identity/v3/projects/aa4d0e34488444709a4d2811fe253dee/users/64464db902204e9ea70e1a4968800485/roles/17dfac38a2e540fea229af7de99911bb => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:21:11.207656 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c76c2a4-d832-451e-b520-36ad422914bd None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:21:11.207950 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c76c2a4-d832-451e-b520-36ad422914bd None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:21:11.208232 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c76c2a4-d832-451e-b520-36ad422914bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:21:11.234460 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-4c76c2a4-d832-451e-b520-36ad422914bd None None] MFA Rules not processed for user `64464db902204e9ea70e1a4968800485`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:21:11.235681 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-4c76c2a4-d832-451e-b520-36ad422914bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:21:11.299929 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1442/2901] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 10:21:11 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 10:21:11.304949 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1b47f3-9310-4054-9824-8c405482575b admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:21:11.364468 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1b47f3-9310-4054-9824-8c405482575b admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:21:11.369638 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f045f88a-6ea7-472c-8ad9-e5ea0e9f92a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:21:11.370319 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f045f88a-6ea7-472c-8ad9-e5ea0e9f92a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:21:11.370607 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f045f88a-6ea7-472c-8ad9-e5ea0e9f92a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:21:11.370888 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f045f88a-6ea7-472c-8ad9-e5ea0e9f92a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:21:11.371579 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f045f88a-6ea7-472c-8ad9-e5ea0e9f92a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:21:11.373469 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f045f88a-6ea7-472c-8ad9-e5ea0e9f92a3 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:21:11.398195 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1460/2902] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 14 10:21:11 2022] POST /identity/v3/projects => generated 377 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:21:11.402458 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c76c2a4-d832-451e-b520-36ad422914bd None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:21:11.413581 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c76c2a4-d832-451e-b520-36ad422914bd None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:21:11.451572 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:21:11.469356 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a967b0-3289-4cfe-b1ac-0d8d67a6d6eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:21:11.470016 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a967b0-3289-4cfe-b1ac-0d8d67a6d6eb admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:21:11.470338 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a967b0-3289-4cfe-b1ac-0d8d67a6d6eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:21:11.470617 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a967b0-3289-4cfe-b1ac-0d8d67a6d6eb admin admin] PATH_INFO: `/v3/users` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:21:11.471307 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a967b0-3289-4cfe-b1ac-0d8d67a6d6eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:21:11.473216 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a967b0-3289-4cfe-b1ac-0d8d67a6d6eb admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:21:11.493752 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1443/2903] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 14 10:21:11 2022] POST /identity/v3/users => generated 295 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:21:11.497757 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f045f88a-6ea7-472c-8ad9-e5ea0e9f92a3 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:21:11.508298 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f045f88a-6ea7-472c-8ad9-e5ea0e9f92a3 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:21:11.512987 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add3679a-de39-40ae-87a7-84d0a08fef4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:21:11.513652 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add3679a-de39-40ae-87a7-84d0a08fef4b admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:21:11.514464 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add3679a-de39-40ae-87a7-84d0a08fef4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:21:11.514464 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add3679a-de39-40ae-87a7-84d0a08fef4b admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:21:11.514958 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add3679a-de39-40ae-87a7-84d0a08fef4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:21:11.516561 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add3679a-de39-40ae-87a7-84d0a08fef4b admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:21:11.529255 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1461/2904] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 10:21:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:21:11.533704 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a967b0-3289-4cfe-b1ac-0d8d67a6d6eb admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:21:11.544444 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a967b0-3289-4cfe-b1ac-0d8d67a6d6eb admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:21:11.549076 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4250f42-96e7-4a67-bf7e-d7c553c7cd29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:21:11.549960 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4250f42-96e7-4a67-bf7e-d7c553c7cd29 admin admin] REQUEST_METHOD: `PUT` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:21:11.550275 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4250f42-96e7-4a67-bf7e-d7c553c7cd29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:21:11.550558 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4250f42-96e7-4a67-bf7e-d7c553c7cd29 admin admin] PATH_INFO: `/v3/projects/b6776168c0e64a9d9976c704788f5011/users/8e8df321ffd8407aac59c3c2be39f373/roles/e3965bd0d5f1427a86a313c0c90bfef3` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:21:11.565505 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4250f42-96e7-4a67-bf7e-d7c553c7cd29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6776168c0e64a9d9976c704788f5011, user_id=8e8df321ffd8407aac59c3c2be39f373, role_id=e3965bd0d5f1427a86a313c0c90bfef3)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:21:11.568282 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4250f42-96e7-4a67-bf7e-d7c553c7cd29 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:21:11.580786 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1444/2905] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 14 10:21:11 2022] PUT /identity/v3/projects/b6776168c0e64a9d9976c704788f5011/users/8e8df321ffd8407aac59c3c2be39f373/roles/e3965bd0d5f1427a86a313c0c90bfef3 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:21:11.585228 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add3679a-de39-40ae-87a7-84d0a08fef4b admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:21:11.595079 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add3679a-de39-40ae-87a7-84d0a08fef4b admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:21:11.652050 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eade24d3-0b2c-4233-bc60-7d2ab36db9db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:21:11.652708 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eade24d3-0b2c-4233-bc60-7d2ab36db9db admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:21:11.652996 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eade24d3-0b2c-4233-bc60-7d2ab36db9db admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:21:11.653277 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eade24d3-0b2c-4233-bc60-7d2ab36db9db admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:21:11.653997 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eade24d3-0b2c-4233-bc60-7d2ab36db9db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:21:11.655622 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eade24d3-0b2c-4233-bc60-7d2ab36db9db admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:21:11.665803 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1462/2906] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 10:21:11 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:21:11.670016 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4250f42-96e7-4a67-bf7e-d7c553c7cd29 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:21:11.680282 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4250f42-96e7-4a67-bf7e-d7c553c7cd29 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:21:11.684877 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d9136f-3426-4645-a90f-a7300c53206d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:21:11.685756 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d9136f-3426-4645-a90f-a7300c53206d admin admin] REQUEST_METHOD: `PUT` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:21:11.686043 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d9136f-3426-4645-a90f-a7300c53206d admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:21:11.686358 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d9136f-3426-4645-a90f-a7300c53206d admin admin] PATH_INFO: `/v3/projects/b6776168c0e64a9d9976c704788f5011/users/8e8df321ffd8407aac59c3c2be39f373/roles/e3965bd0d5f1427a86a313c0c90bfef3` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:21:11.688335 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d9136f-3426-4645-a90f-a7300c53206d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6776168c0e64a9d9976c704788f5011, user_id=8e8df321ffd8407aac59c3c2be39f373, role_id=e3965bd0d5f1427a86a313c0c90bfef3)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:21:11.691118 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d9136f-3426-4645-a90f-a7300c53206d admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:21:11.701505 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1445/2907] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 14 10:21:11 2022] PUT /identity/v3/projects/b6776168c0e64a9d9976c704788f5011/users/8e8df321ffd8407aac59c3c2be39f373/roles/e3965bd0d5f1427a86a313c0c90bfef3 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:21:11.711999 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546fa84b-119f-444b-a380-96cfc9c4edd7 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:21:11.712302 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546fa84b-119f-444b-a380-96cfc9c4edd7 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:21:11.712568 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546fa84b-119f-444b-a380-96cfc9c4edd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:21:11.719269 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:21:11.740699 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-546fa84b-119f-444b-a380-96cfc9c4edd7 None None] MFA Rules not processed for user `8e8df321ffd8407aac59c3c2be39f373`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:21:11.741892 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-546fa84b-119f-444b-a380-96cfc9c4edd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:21:11.807054 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1463/2908] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 10:21:11 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 10:21:11.818029 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d9136f-3426-4645-a90f-a7300c53206d admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:21:11.820679 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-07d9136f-3426-4645-a90f-a7300c53206d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:21:11.877292 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d9136f-3426-4645-a90f-a7300c53206d admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:21:11.881471 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9165315-d94f-445c-aaf1-bf54a683ea28 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25048b29787d482783ebc944f1a7df65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:21:11.882112 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9165315-d94f-445c-aaf1-bf54a683ea28 service cinder] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:21:11.882421 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9165315-d94f-445c-aaf1-bf54a683ea28 service cinder] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:21:11.882700 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9165315-d94f-445c-aaf1-bf54a683ea28 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:21:11.937505 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9165315-d94f-445c-aaf1-bf54a683ea28 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:21:11.938980 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9165315-d94f-445c-aaf1-bf54a683ea28 service cinder] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:21:11.948615 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1446/2909] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 10:21:11 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:21:13.418815 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546fa84b-119f-444b-a380-96cfc9c4edd7 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:21:13.420285 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-546fa84b-119f-444b-a380-96cfc9c4edd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:21:13.432361 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546fa84b-119f-444b-a380-96cfc9c4edd7 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:21:13.435934 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5ac1e3-9004-4adf-974d-a595e965f10d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25048b29787d482783ebc944f1a7df65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:21:13.436580 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5ac1e3-9004-4adf-974d-a595e965f10d service cinder] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:21:13.436868 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5ac1e3-9004-4adf-974d-a595e965f10d service cinder] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:21:13.437204 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5ac1e3-9004-4adf-974d-a595e965f10d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:21:13.494442 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5ac1e3-9004-4adf-974d-a595e965f10d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:21:13.495835 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5ac1e3-9004-4adf-974d-a595e965f10d service cinder] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:21:13.504685 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1464/2910] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 10:21:13 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:21:14.011162 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9165315-d94f-445c-aaf1-bf54a683ea28 service cinder] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:21:14.019763 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9165315-d94f-445c-aaf1-bf54a683ea28 service cinder] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:21:14.023522 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7161499b-d6ce-421a-b6b4-9cd40b813b72 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25048b29787d482783ebc944f1a7df65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:21:14.024245 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7161499b-d6ce-421a-b6b4-9cd40b813b72 service cinder] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:21:14.024477 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7161499b-d6ce-421a-b6b4-9cd40b813b72 service cinder] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:21:14.024725 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7161499b-d6ce-421a-b6b4-9cd40b813b72 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:21:14.035382 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7161499b-d6ce-421a-b6b4-9cd40b813b72 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:21:14.036832 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7161499b-d6ce-421a-b6b4-9cd40b813b72 service cinder] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:21:14.046954 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1447/2911] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 10:21:14 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:21:17.858596 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5ac1e3-9004-4adf-974d-a595e965f10d service cinder] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:21:17.919066 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5ac1e3-9004-4adf-974d-a595e965f10d service cinder] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:21:17.923566 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3906dafc-4d61-49e8-85ea-1f2ca6e50b5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:21:17.924441 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3906dafc-4d61-49e8-85ea-1f2ca6e50b5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:21:17.924724 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3906dafc-4d61-49e8-85ea-1f2ca6e50b5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:21:17.925004 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3906dafc-4d61-49e8-85ea-1f2ca6e50b5e admin admin] PATH_INFO: `/v3/users/0868161690204443be7ed1adf302d50b` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:21:17.926215 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3906dafc-4d61-49e8-85ea-1f2ca6e50b5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=0868161690204443be7ed1adf302d50b)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:21:17.928133 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3906dafc-4d61-49e8-85ea-1f2ca6e50b5e admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:21:17.962280 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:21:17.974075 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-3906dafc-4d61-49e8-85ea-1f2ca6e50b5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0868161690204443be7ed1adf302d50b'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:21:17.986444 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-3906dafc-4d61-49e8-85ea-1f2ca6e50b5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0868161690204443be7ed1adf302d50b'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:21:17.987110 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-3906dafc-4d61-49e8-85ea-1f2ca6e50b5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0868161690204443be7ed1adf302d50b'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:21:17.994819 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-3906dafc-4d61-49e8-85ea-1f2ca6e50b5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0868161690204443be7ed1adf302d50b'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:21:18.001758 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-3906dafc-4d61-49e8-85ea-1f2ca6e50b5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0868161690204443be7ed1adf302d50b'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:21:18.007659 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1465/2912] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 14 10:21:17 2022] DELETE /identity/v3/users/0868161690204443be7ed1adf302d50b => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:21:18.012131 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1113b02-0747-4cec-99b4-a22844266a00 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:21:18.012574 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1113b02-0747-4cec-99b4-a22844266a00 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:21:18.012685 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1113b02-0747-4cec-99b4-a22844266a00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:21:18.029288 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-a1113b02-0747-4cec-99b4-a22844266a00 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:21:18.030525 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-a1113b02-0747-4cec-99b4-a22844266a00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:21:18.060972 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:21:18.090832 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1448/2913] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 10:21:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 10:21:18.100270 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3906dafc-4d61-49e8-85ea-1f2ca6e50b5e admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:21:18.102257 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-3906dafc-4d61-49e8-85ea-1f2ca6e50b5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:21:18.157523 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3906dafc-4d61-49e8-85ea-1f2ca6e50b5e admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:21:18.161083 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da5ae28-e1eb-4b9f-b69a-e2194b1373f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e4a5a8965e4802a9055d332179b7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:21:18.161721 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da5ae28-e1eb-4b9f-b69a-e2194b1373f6 service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:21:18.162002 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da5ae28-e1eb-4b9f-b69a-e2194b1373f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:21:18.162327 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da5ae28-e1eb-4b9f-b69a-e2194b1373f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:21:18.172230 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da5ae28-e1eb-4b9f-b69a-e2194b1373f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:21:18.173668 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da5ae28-e1eb-4b9f-b69a-e2194b1373f6 service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:21:18.183062 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1466/2914] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 10:21:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:21:18.447210 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1113b02-0747-4cec-99b4-a22844266a00 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:21:18.448631 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-a1113b02-0747-4cec-99b4-a22844266a00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:21:18.461815 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1113b02-0747-4cec-99b4-a22844266a00 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:21:18.466564 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a24bc87-a945-4249-994c-7a723e8125c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:21:18.467614 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a24bc87-a945-4249-994c-7a723e8125c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:21:18.467895 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a24bc87-a945-4249-994c-7a723e8125c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:21:18.468176 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a24bc87-a945-4249-994c-7a723e8125c4 admin admin] PATH_INFO: `/v3/projects/b7bfcd3410a744cb950bb28c3f84e9bb` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:21:18.469383 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a24bc87-a945-4249-994c-7a723e8125c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7bfcd3410a744cb950bb28c3f84e9bb)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:21:18.471329 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a24bc87-a945-4249-994c-7a723e8125c4 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:21:18.519213 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-2a24bc87-a945-4249-994c-7a723e8125c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7bfcd3410a744cb950bb28c3f84e9bb', 'request_id': 'req-2a24bc87-a945-4249-994c-7a723e8125c4'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:21:18.527399 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-2a24bc87-a945-4249-994c-7a723e8125c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7bfcd3410a744cb950bb28c3f84e9bb', 'request_id': 'req-2a24bc87-a945-4249-994c-7a723e8125c4'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:21:18.533421 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-2a24bc87-a945-4249-994c-7a723e8125c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7bfcd3410a744cb950bb28c3f84e9bb', 'request_id': 'req-2a24bc87-a945-4249-994c-7a723e8125c4'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:21:18.544607 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-2a24bc87-a945-4249-994c-7a723e8125c4 admin admin] The token cache is being invalidate because project b7bfcd3410a744cb950bb28c3f84e9bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:21:18.544898 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-2a24bc87-a945-4249-994c-7a723e8125c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:21:18.545537 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-2a24bc87-a945-4249-994c-7a723e8125c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:21:18.547101 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1449/2915] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 14 10:21:18 2022] DELETE /identity/v3/projects/b7bfcd3410a744cb950bb28c3f84e9bb => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:21:18.551004 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da5ae28-e1eb-4b9f-b69a-e2194b1373f6 service neutron] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:21:18.560594 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da5ae28-e1eb-4b9f-b69a-e2194b1373f6 service neutron] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:21:18.616109 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb59d7a-d4a9-42ef-9716-a016027ea3ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:21:18.616922 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb59d7a-d4a9-42ef-9716-a016027ea3ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:21:18.617216 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb59d7a-d4a9-42ef-9716-a016027ea3ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:21:18.617499 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb59d7a-d4a9-42ef-9716-a016027ea3ba admin admin] PATH_INFO: `/v3/users/64464db902204e9ea70e1a4968800485` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:21:18.618733 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb59d7a-d4a9-42ef-9716-a016027ea3ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=64464db902204e9ea70e1a4968800485)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:21:18.620657 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb59d7a-d4a9-42ef-9716-a016027ea3ba admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:21:18.665425 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-6eb59d7a-d4a9-42ef-9716-a016027ea3ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64464db902204e9ea70e1a4968800485'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:21:18.669933 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:21:18.679954 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-6eb59d7a-d4a9-42ef-9716-a016027ea3ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64464db902204e9ea70e1a4968800485'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:21:18.680665 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-6eb59d7a-d4a9-42ef-9716-a016027ea3ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64464db902204e9ea70e1a4968800485'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:21:18.687988 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-6eb59d7a-d4a9-42ef-9716-a016027ea3ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64464db902204e9ea70e1a4968800485'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:21:18.695450 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-6eb59d7a-d4a9-42ef-9716-a016027ea3ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64464db902204e9ea70e1a4968800485'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:21:18.701317 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1467/2916] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 14 10:21:18 2022] DELETE /identity/v3/users/64464db902204e9ea70e1a4968800485 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:21:18.971459 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a24bc87-a945-4249-994c-7a723e8125c4 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:21:18.972900 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-2a24bc87-a945-4249-994c-7a723e8125c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:21:18.986831 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a24bc87-a945-4249-994c-7a723e8125c4 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:21:19.042769 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515ea359-1640-426a-804a-a8b44f42188d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:21:19.043631 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515ea359-1640-426a-804a-a8b44f42188d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:21:19.043916 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515ea359-1640-426a-804a-a8b44f42188d admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:21:19.044192 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515ea359-1640-426a-804a-a8b44f42188d admin admin] PATH_INFO: `/v3/projects/aa4d0e34488444709a4d2811fe253dee` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:21:19.045373 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515ea359-1640-426a-804a-a8b44f42188d admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa4d0e34488444709a4d2811fe253dee)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:21:19.047321 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515ea359-1640-426a-804a-a8b44f42188d admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:21:19.093240 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-515ea359-1640-426a-804a-a8b44f42188d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa4d0e34488444709a4d2811fe253dee', 'request_id': 'req-515ea359-1640-426a-804a-a8b44f42188d'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:21:19.099640 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-515ea359-1640-426a-804a-a8b44f42188d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa4d0e34488444709a4d2811fe253dee', 'request_id': 'req-515ea359-1640-426a-804a-a8b44f42188d'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:21:19.103412 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:21:19.105740 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-515ea359-1640-426a-804a-a8b44f42188d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa4d0e34488444709a4d2811fe253dee', 'request_id': 'req-515ea359-1640-426a-804a-a8b44f42188d'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:21:19.118465 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-515ea359-1640-426a-804a-a8b44f42188d admin admin] The token cache is being invalidate because project aa4d0e34488444709a4d2811fe253dee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:21:19.118753 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-515ea359-1640-426a-804a-a8b44f42188d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:21:19.119380 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-515ea359-1640-426a-804a-a8b44f42188d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:21:19.120893 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1450/2917] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 14 10:21:18 2022] DELETE /identity/v3/projects/aa4d0e34488444709a4d2811fe253dee => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:21:19.124789 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb59d7a-d4a9-42ef-9716-a016027ea3ba admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:21:19.126172 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-6eb59d7a-d4a9-42ef-9716-a016027ea3ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:21:19.139135 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb59d7a-d4a9-42ef-9716-a016027ea3ba admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:21:19.195052 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819b0b57-f4a4-41fc-a96a-81f80cfc9213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:21:19.195942 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819b0b57-f4a4-41fc-a96a-81f80cfc9213 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:21:19.196226 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819b0b57-f4a4-41fc-a96a-81f80cfc9213 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:21:19.196505 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819b0b57-f4a4-41fc-a96a-81f80cfc9213 admin admin] PATH_INFO: `/v3/users/8e8df321ffd8407aac59c3c2be39f373` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:21:19.197694 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819b0b57-f4a4-41fc-a96a-81f80cfc9213 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e8df321ffd8407aac59c3c2be39f373)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:21:19.199633 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819b0b57-f4a4-41fc-a96a-81f80cfc9213 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:21:19.244520 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-819b0b57-f4a4-41fc-a96a-81f80cfc9213 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e8df321ffd8407aac59c3c2be39f373'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:21:19.256164 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-819b0b57-f4a4-41fc-a96a-81f80cfc9213 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e8df321ffd8407aac59c3c2be39f373'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:21:19.256817 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-819b0b57-f4a4-41fc-a96a-81f80cfc9213 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e8df321ffd8407aac59c3c2be39f373'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:21:19.265028 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-819b0b57-f4a4-41fc-a96a-81f80cfc9213 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e8df321ffd8407aac59c3c2be39f373'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:21:19.271816 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-819b0b57-f4a4-41fc-a96a-81f80cfc9213 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e8df321ffd8407aac59c3c2be39f373'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:21:19.277763 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1468/2918] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 14 10:21:19 2022] DELETE /identity/v3/users/8e8df321ffd8407aac59c3c2be39f373 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:21:19.563619 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515ea359-1640-426a-804a-a8b44f42188d admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:21:19.565167 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-515ea359-1640-426a-804a-a8b44f42188d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:21:19.582818 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515ea359-1640-426a-804a-a8b44f42188d admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:21:19.646937 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb732c32-946f-4920-8e87-681aac900232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:21:19.648351 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb732c32-946f-4920-8e87-681aac900232 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:21:19.648638 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb732c32-946f-4920-8e87-681aac900232 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:21:19.648918 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb732c32-946f-4920-8e87-681aac900232 admin admin] PATH_INFO: `/v3/projects/b6776168c0e64a9d9976c704788f5011` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:21:19.650129 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb732c32-946f-4920-8e87-681aac900232 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6776168c0e64a9d9976c704788f5011)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:21:19.652069 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb732c32-946f-4920-8e87-681aac900232 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:21:19.703382 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-eb732c32-946f-4920-8e87-681aac900232 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6776168c0e64a9d9976c704788f5011', 'request_id': 'req-eb732c32-946f-4920-8e87-681aac900232'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:21:19.711253 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-eb732c32-946f-4920-8e87-681aac900232 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6776168c0e64a9d9976c704788f5011', 'request_id': 'req-eb732c32-946f-4920-8e87-681aac900232'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:21:19.716858 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-eb732c32-946f-4920-8e87-681aac900232 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6776168c0e64a9d9976c704788f5011', 'request_id': 'req-eb732c32-946f-4920-8e87-681aac900232'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:21:19.728895 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-eb732c32-946f-4920-8e87-681aac900232 admin admin] The token cache is being invalidate because project b6776168c0e64a9d9976c704788f5011 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:21:19.729208 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-eb732c32-946f-4920-8e87-681aac900232 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:21:19.729860 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-eb732c32-946f-4920-8e87-681aac900232 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:21:19.731486 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1451/2919] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 14 10:21:19 2022] DELETE /identity/v3/projects/b6776168c0e64a9d9976c704788f5011 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:21:19.736295 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205c092d-517a-4328-88c8-a68306db26da None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:21:19.736665 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205c092d-517a-4328-88c8-a68306db26da None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:21:19.736968 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205c092d-517a-4328-88c8-a68306db26da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:21:19.756941 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-205c092d-517a-4328-88c8-a68306db26da None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:21:19.758138 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-205c092d-517a-4328-88c8-a68306db26da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:21:19.806379 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:21:19.827301 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1469/2920] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 10:21:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:21:19.834993 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6758a1-6026-4ed6-9edd-f4abf5a703a1 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:21:19.835799 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6758a1-6026-4ed6-9edd-f4abf5a703a1 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:21:19.836081 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6758a1-6026-4ed6-9edd-f4abf5a703a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:21:19.856129 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-ff6758a1-6026-4ed6-9edd-f4abf5a703a1 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:21:19.857707 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-ff6758a1-6026-4ed6-9edd-f4abf5a703a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:21:19.867116 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1452/2921] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 10:21:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:21:19.871580 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205c092d-517a-4328-88c8-a68306db26da None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:21:19.882136 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205c092d-517a-4328-88c8-a68306db26da None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:21:19.887185 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9dc528-3c33-4efa-b233-35a4639a04c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:21:19.887858 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9dc528-3c33-4efa-b233-35a4639a04c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:21:19.888144 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9dc528-3c33-4efa-b233-35a4639a04c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:21:19.888471 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9dc528-3c33-4efa-b233-35a4639a04c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:21:19.889204 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9dc528-3c33-4efa-b233-35a4639a04c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:21:19.889515 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9dc528-3c33-4efa-b233-35a4639a04c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:21:19.891163 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9dc528-3c33-4efa-b233-35a4639a04c6 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:21:19.903793 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1470/2922] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jul 14 10:21:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:21:19.907957 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6758a1-6026-4ed6-9edd-f4abf5a703a1 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:21:19.918035 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6758a1-6026-4ed6-9edd-f4abf5a703a1 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:21:19.922714 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308857f8-d1fe-4b32-bea9-698a899ce269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:21:19.923372 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308857f8-d1fe-4b32-bea9-698a899ce269 admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:21:19.923656 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308857f8-d1fe-4b32-bea9-698a899ce269 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:21:19.923934 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308857f8-d1fe-4b32-bea9-698a899ce269 admin admin] PATH_INFO: `/v3/projects` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:21:19.924631 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308857f8-d1fe-4b32-bea9-698a899ce269 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:21:19.926810 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308857f8-d1fe-4b32-bea9-698a899ce269 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:21:19.953977 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1453/2923] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 14 10:21:19 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:21:19.958292 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9dc528-3c33-4efa-b233-35a4639a04c6 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:21:19.968684 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9dc528-3c33-4efa-b233-35a4639a04c6 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:21:20.028485 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18c0403-2b05-4837-84aa-071716ca3873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:21:20.029084 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18c0403-2b05-4837-84aa-071716ca3873 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:21:20.029369 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18c0403-2b05-4837-84aa-071716ca3873 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:21:20.029650 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18c0403-2b05-4837-84aa-071716ca3873 admin admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:21:20.030522 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18c0403-2b05-4837-84aa-071716ca3873 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:21:20.032442 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18c0403-2b05-4837-84aa-071716ca3873 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:21:20.055827 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1471/2924] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 14 10:21:19 2022] POST /identity/v3/users => generated 293 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:21:20.060053 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308857f8-d1fe-4b32-bea9-698a899ce269 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:21:20.070847 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308857f8-d1fe-4b32-bea9-698a899ce269 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:21:20.076889 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3699480-820d-4cf3-91c5-5b23847dcb72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:21:20.078064 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3699480-820d-4cf3-91c5-5b23847dcb72 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:21:20.078398 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3699480-820d-4cf3-91c5-5b23847dcb72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:21:20.078685 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3699480-820d-4cf3-91c5-5b23847dcb72 admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:21:20.079750 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3699480-820d-4cf3-91c5-5b23847dcb72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:21:20.081370 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3699480-820d-4cf3-91c5-5b23847dcb72 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:21:20.093356 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1454/2925] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 10:21:20 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:21:20.097413 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18c0403-2b05-4837-84aa-071716ca3873 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:21:20.108183 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18c0403-2b05-4837-84aa-071716ca3873 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:21:20.112838 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b4fde1-9d7e-4e39-9e2a-335dd22a8788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:21:20.113510 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b4fde1-9d7e-4e39-9e2a-335dd22a8788 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:21:20.113798 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b4fde1-9d7e-4e39-9e2a-335dd22a8788 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:21:20.114101 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b4fde1-9d7e-4e39-9e2a-335dd22a8788 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:21:20.114895 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b4fde1-9d7e-4e39-9e2a-335dd22a8788 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:21:20.117094 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b4fde1-9d7e-4e39-9e2a-335dd22a8788 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:21:20.127357 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1472/2926] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 10:21:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:21:20.133467 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3699480-820d-4cf3-91c5-5b23847dcb72 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:21:20.143825 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3699480-820d-4cf3-91c5-5b23847dcb72 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:21:20.148795 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199ee72e-472c-4f6e-9b41-4031cca90815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:21:20.149722 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199ee72e-472c-4f6e-9b41-4031cca90815 admin admin] REQUEST_METHOD: `PUT` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:21:20.150009 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199ee72e-472c-4f6e-9b41-4031cca90815 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:21:20.150340 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199ee72e-472c-4f6e-9b41-4031cca90815 admin admin] PATH_INFO: `/v3/projects/cda2b9b71803463bb447320c78069230/users/6947eec459f2416dbebb636662677a37/roles/17dfac38a2e540fea229af7de99911bb` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:21:20.165610 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199ee72e-472c-4f6e-9b41-4031cca90815 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cda2b9b71803463bb447320c78069230, user_id=6947eec459f2416dbebb636662677a37, role_id=17dfac38a2e540fea229af7de99911bb)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:21:20.168353 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199ee72e-472c-4f6e-9b41-4031cca90815 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:21:20.182767 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1455/2927] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 14 10:21:20 2022] PUT /identity/v3/projects/cda2b9b71803463bb447320c78069230/users/6947eec459f2416dbebb636662677a37/roles/17dfac38a2e540fea229af7de99911bb => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:21:20.194428 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f35f410-9e67-4822-8132-f8d0a5e1e497 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:21:20.194987 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f35f410-9e67-4822-8132-f8d0a5e1e497 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:21:20.195277 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f35f410-9e67-4822-8132-f8d0a5e1e497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:21:20.224355 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-4f35f410-9e67-4822-8132-f8d0a5e1e497 None None] MFA Rules not processed for user `6947eec459f2416dbebb636662677a37`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:21:20.225578 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-4f35f410-9e67-4822-8132-f8d0a5e1e497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:21:20.291854 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1473/2928] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 10:21:20 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:21:20.296662 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199ee72e-472c-4f6e-9b41-4031cca90815 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:21:20.314551 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:DELETE=8,keystone:SELECT=89,keystone:INSERT=3 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:21:20.360857 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199ee72e-472c-4f6e-9b41-4031cca90815 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:21:20.365642 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7a5f6e-5719-4b34-b5cc-9a0d641fbc22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:21:20.366958 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7a5f6e-5719-4b34-b5cc-9a0d641fbc22 admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:21:20.367253 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7a5f6e-5719-4b34-b5cc-9a0d641fbc22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:21:20.367534 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7a5f6e-5719-4b34-b5cc-9a0d641fbc22 admin admin] PATH_INFO: `/v3/projects` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:21:20.368227 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7a5f6e-5719-4b34-b5cc-9a0d641fbc22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:21:20.370215 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7a5f6e-5719-4b34-b5cc-9a0d641fbc22 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:21:20.394283 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1456/2929] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 14 10:21:20 2022] POST /identity/v3/projects => generated 385 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:21:20.399026 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f35f410-9e67-4822-8132-f8d0a5e1e497 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:21:20.409550 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f35f410-9e67-4822-8132-f8d0a5e1e497 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:21:20.450717 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:21:20.468034 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7068857-d1e2-471e-b54e-743f8c04b9da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:21:20.468703 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7068857-d1e2-471e-b54e-743f8c04b9da admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:21:20.469177 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7068857-d1e2-471e-b54e-743f8c04b9da admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:21:20.469610 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7068857-d1e2-471e-b54e-743f8c04b9da admin admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:21:20.470372 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7068857-d1e2-471e-b54e-743f8c04b9da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:21:20.472527 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7068857-d1e2-471e-b54e-743f8c04b9da admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:21:20.497083 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1474/2930] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 14 10:21:20 2022] POST /identity/v3/users => generated 293 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 10:21:20.498301 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7a5f6e-5719-4b34-b5cc-9a0d641fbc22 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:21:20.508682 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7a5f6e-5719-4b34-b5cc-9a0d641fbc22 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:21:20.513274 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42824787-e53f-4b31-8ae6-529f7a3ee379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:21:20.513926 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42824787-e53f-4b31-8ae6-529f7a3ee379 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:21:20.514231 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42824787-e53f-4b31-8ae6-529f7a3ee379 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:21:20.514511 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42824787-e53f-4b31-8ae6-529f7a3ee379 admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:21:20.515239 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42824787-e53f-4b31-8ae6-529f7a3ee379 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:21:20.516810 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42824787-e53f-4b31-8ae6-529f7a3ee379 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:21:20.528021 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1457/2931] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 10:21:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:21:20.531637 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7068857-d1e2-471e-b54e-743f8c04b9da admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:21:20.542386 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7068857-d1e2-471e-b54e-743f8c04b9da admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:21:20.546878 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef99e37a-253e-4d42-b337-73ad114c9183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:21:20.547529 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef99e37a-253e-4d42-b337-73ad114c9183 admin admin] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:21:20.547811 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef99e37a-253e-4d42-b337-73ad114c9183 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:21:20.548086 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef99e37a-253e-4d42-b337-73ad114c9183 admin admin] PATH_INFO: `/v3/roles` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:21:20.548807 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef99e37a-253e-4d42-b337-73ad114c9183 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:21:20.550463 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef99e37a-253e-4d42-b337-73ad114c9183 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:21:20.560994 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1475/2932] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 10:21:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:21:20.565257 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42824787-e53f-4b31-8ae6-529f7a3ee379 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:21:20.575564 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42824787-e53f-4b31-8ae6-529f7a3ee379 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:21:20.580291 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede410b9-263f-4db8-8d88-3c964d2235ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:21:20.581207 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede410b9-263f-4db8-8d88-3c964d2235ef admin admin] REQUEST_METHOD: `PUT` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:21:20.581508 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede410b9-263f-4db8-8d88-3c964d2235ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:21:20.581777 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede410b9-263f-4db8-8d88-3c964d2235ef admin admin] PATH_INFO: `/v3/projects/8f53498bea0f41f8b609a411e8fd2b98/users/a51d1a6a5aa2422dad1071bdf29671d4/roles/17dfac38a2e540fea229af7de99911bb` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:21:20.596773 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede410b9-263f-4db8-8d88-3c964d2235ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f53498bea0f41f8b609a411e8fd2b98, user_id=a51d1a6a5aa2422dad1071bdf29671d4, role_id=17dfac38a2e540fea229af7de99911bb)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:21:20.599494 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede410b9-263f-4db8-8d88-3c964d2235ef admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:21:20.612987 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1458/2933] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 14 10:21:20 2022] PUT /identity/v3/projects/8f53498bea0f41f8b609a411e8fd2b98/users/a51d1a6a5aa2422dad1071bdf29671d4/roles/17dfac38a2e540fea229af7de99911bb => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:21:20.623347 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f1c8f6-aa82-4b28-92f7-b73cdf6d6e8b None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:21:20.623627 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f1c8f6-aa82-4b28-92f7-b73cdf6d6e8b None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:21:20.623908 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f1c8f6-aa82-4b28-92f7-b73cdf6d6e8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:21:20.649849 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-53f1c8f6-aa82-4b28-92f7-b73cdf6d6e8b None None] MFA Rules not processed for user `a51d1a6a5aa2422dad1071bdf29671d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:21:20.651122 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-53f1c8f6-aa82-4b28-92f7-b73cdf6d6e8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:21:20.713701 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1476/2934] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 10:21:20 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:21:20.718099 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede410b9-263f-4db8-8d88-3c964d2235ef admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:21:20.779504 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede410b9-263f-4db8-8d88-3c964d2235ef admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:21:20.784155 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd6b761-d968-4bc5-90e6-334a8524388d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:21:20.784814 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd6b761-d968-4bc5-90e6-334a8524388d admin admin] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:21:20.785100 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd6b761-d968-4bc5-90e6-334a8524388d admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:21:20.785378 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd6b761-d968-4bc5-90e6-334a8524388d admin admin] PATH_INFO: `/v3/projects` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:21:20.786067 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd6b761-d968-4bc5-90e6-334a8524388d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:21:20.787997 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd6b761-d968-4bc5-90e6-334a8524388d admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:21:20.812223 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1459/2935] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 14 10:21:20 2022] POST /identity/v3/projects => generated 383 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:21:20.816209 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f1c8f6-aa82-4b28-92f7-b73cdf6d6e8b None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:21:20.827286 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f1c8f6-aa82-4b28-92f7-b73cdf6d6e8b None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:21:20.881641 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8e954d-3406-460f-8967-1ee2d67fefd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:21:20.882937 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8e954d-3406-460f-8967-1ee2d67fefd0 admin admin] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:21:20.883223 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8e954d-3406-460f-8967-1ee2d67fefd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:21:20.883499 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8e954d-3406-460f-8967-1ee2d67fefd0 admin admin] PATH_INFO: `/v3/users` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:21:20.884190 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8e954d-3406-460f-8967-1ee2d67fefd0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:21:20.886181 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8e954d-3406-460f-8967-1ee2d67fefd0 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:21:20.906521 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1477/2936] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 14 10:21:20 2022] POST /identity/v3/users => generated 298 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 10:21:20.910527 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd6b761-d968-4bc5-90e6-334a8524388d admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:21:20.923527 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd6b761-d968-4bc5-90e6-334a8524388d admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:21:20.928173 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860fef94-e9b0-4158-ac09-2cb945baf983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:21:20.928837 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860fef94-e9b0-4158-ac09-2cb945baf983 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:21:20.929123 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860fef94-e9b0-4158-ac09-2cb945baf983 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:21:20.929405 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860fef94-e9b0-4158-ac09-2cb945baf983 admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:21:20.930135 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860fef94-e9b0-4158-ac09-2cb945baf983 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:21:20.931754 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860fef94-e9b0-4158-ac09-2cb945baf983 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:21:20.942154 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1460/2937] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 10:21:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:21:20.946734 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8e954d-3406-460f-8967-1ee2d67fefd0 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:21:20.956532 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8e954d-3406-460f-8967-1ee2d67fefd0 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:21:20.961762 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61128e0d-45f7-4434-bb42-cc7894111be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:21:20.962673 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61128e0d-45f7-4434-bb42-cc7894111be6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:21:20.962960 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61128e0d-45f7-4434-bb42-cc7894111be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:21:20.963234 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61128e0d-45f7-4434-bb42-cc7894111be6 admin admin] PATH_INFO: `/v3/projects/7b92863e105044768c31f9c5fc307fd5/users/56f3db74b4e34ab396c7b511af8599c1/roles/e3965bd0d5f1427a86a313c0c90bfef3` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:21:20.977545 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61128e0d-45f7-4434-bb42-cc7894111be6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b92863e105044768c31f9c5fc307fd5, user_id=56f3db74b4e34ab396c7b511af8599c1, role_id=e3965bd0d5f1427a86a313c0c90bfef3)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:21:20.980615 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61128e0d-45f7-4434-bb42-cc7894111be6 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:21:20.993332 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1478/2938] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 14 10:21:20 2022] PUT /identity/v3/projects/7b92863e105044768c31f9c5fc307fd5/users/56f3db74b4e34ab396c7b511af8599c1/roles/e3965bd0d5f1427a86a313c0c90bfef3 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:21:20.997136 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860fef94-e9b0-4158-ac09-2cb945baf983 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:21:21.007585 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860fef94-e9b0-4158-ac09-2cb945baf983 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:21:21.045349 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:21:21.064601 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cb8517-eed6-4753-8d3e-458d9fa18899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:21:21.065218 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cb8517-eed6-4753-8d3e-458d9fa18899 admin admin] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:21:21.065509 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cb8517-eed6-4753-8d3e-458d9fa18899 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:21:21.065778 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cb8517-eed6-4753-8d3e-458d9fa18899 admin admin] PATH_INFO: `/v3/roles` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:21:21.066535 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cb8517-eed6-4753-8d3e-458d9fa18899 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:21:21.068123 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cb8517-eed6-4753-8d3e-458d9fa18899 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:21:21.078497 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1461/2939] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 10:21:20 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:21:21.082850 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61128e0d-45f7-4434-bb42-cc7894111be6 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:21:21.093807 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61128e0d-45f7-4434-bb42-cc7894111be6 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:21:21.098475 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ecfd89-05ee-43ec-8d4f-0d47677a8d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:21:21.099364 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ecfd89-05ee-43ec-8d4f-0d47677a8d05 admin admin] REQUEST_METHOD: `PUT` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:21:21.099651 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ecfd89-05ee-43ec-8d4f-0d47677a8d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:21:21.099929 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ecfd89-05ee-43ec-8d4f-0d47677a8d05 admin admin] PATH_INFO: `/v3/projects/7b92863e105044768c31f9c5fc307fd5/users/56f3db74b4e34ab396c7b511af8599c1/roles/e3965bd0d5f1427a86a313c0c90bfef3` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:21:21.101906 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ecfd89-05ee-43ec-8d4f-0d47677a8d05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b92863e105044768c31f9c5fc307fd5, user_id=56f3db74b4e34ab396c7b511af8599c1, role_id=e3965bd0d5f1427a86a313c0c90bfef3)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:21:21.104566 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ecfd89-05ee-43ec-8d4f-0d47677a8d05 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:21:21.115028 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1479/2940] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 14 10:21:21 2022] PUT /identity/v3/projects/7b92863e105044768c31f9c5fc307fd5/users/56f3db74b4e34ab396c7b511af8599c1/roles/e3965bd0d5f1427a86a313c0c90bfef3 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:21:21.126061 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dd4051-967c-4156-8c81-3f4bc4569698 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:21:21.126389 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dd4051-967c-4156-8c81-3f4bc4569698 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:21:21.126672 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dd4051-967c-4156-8c81-3f4bc4569698 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:21:21.153480 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-f4dd4051-967c-4156-8c81-3f4bc4569698 None None] MFA Rules not processed for user `56f3db74b4e34ab396c7b511af8599c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:21:21.154867 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-f4dd4051-967c-4156-8c81-3f4bc4569698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:21:21.222520 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1462/2941] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 10:21:21 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:21:21.233687 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ecfd89-05ee-43ec-8d4f-0d47677a8d05 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:21:21.235473 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-59ecfd89-05ee-43ec-8d4f-0d47677a8d05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:21:21.242473 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:21:21.293844 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ecfd89-05ee-43ec-8d4f-0d47677a8d05 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:21:21.297407 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6ff4c8-842f-46db-b762-6d1b2508c934 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25048b29787d482783ebc944f1a7df65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:21:21.298047 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6ff4c8-842f-46db-b762-6d1b2508c934 service cinder] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:21:21.298361 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6ff4c8-842f-46db-b762-6d1b2508c934 service cinder] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:21:21.298640 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6ff4c8-842f-46db-b762-6d1b2508c934 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:21:21.352796 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6ff4c8-842f-46db-b762-6d1b2508c934 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:21:21.354153 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6ff4c8-842f-46db-b762-6d1b2508c934 service cinder] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:21:21.363123 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1480/2942] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 10:21:21 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:21:23.001544 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dd4051-967c-4156-8c81-3f4bc4569698 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:21:23.002985 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-f4dd4051-967c-4156-8c81-3f4bc4569698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:21:23.015222 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dd4051-967c-4156-8c81-3f4bc4569698 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:21:23.018724 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fce6e4-b1c3-4d6d-a40b-c50487040c39 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25048b29787d482783ebc944f1a7df65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:21:23.019365 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fce6e4-b1c3-4d6d-a40b-c50487040c39 service cinder] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:21:23.019647 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fce6e4-b1c3-4d6d-a40b-c50487040c39 service cinder] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:21:23.019923 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fce6e4-b1c3-4d6d-a40b-c50487040c39 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:21:23.078550 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fce6e4-b1c3-4d6d-a40b-c50487040c39 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:21:23.080009 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fce6e4-b1c3-4d6d-a40b-c50487040c39 service cinder] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:21:23.089042 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1463/2943] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 10:21:23 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:21:23.589129 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6ff4c8-842f-46db-b762-6d1b2508c934 service cinder] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:21:23.597610 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6ff4c8-842f-46db-b762-6d1b2508c934 service cinder] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:21:23.601874 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fe8d66-0d79-4412-a72d-c7c5f3feb899 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25048b29787d482783ebc944f1a7df65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:21:23.602545 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fe8d66-0d79-4412-a72d-c7c5f3feb899 service cinder] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:21:23.602834 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fe8d66-0d79-4412-a72d-c7c5f3feb899 service cinder] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:21:23.603115 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fe8d66-0d79-4412-a72d-c7c5f3feb899 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:21:23.611940 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fe8d66-0d79-4412-a72d-c7c5f3feb899 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:21:23.613356 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fe8d66-0d79-4412-a72d-c7c5f3feb899 service cinder] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:21:23.623394 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1481/2944] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 10:21:23 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:21:27.428327 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fce6e4-b1c3-4d6d-a40b-c50487040c39 service cinder] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:21:27.490453 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fce6e4-b1c3-4d6d-a40b-c50487040c39 service cinder] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:21:27.494978 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b9b95e-8f71-4728-897a-d10e32f733e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:21:27.495851 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b9b95e-8f71-4728-897a-d10e32f733e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:21:27.496134 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b9b95e-8f71-4728-897a-d10e32f733e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:21:27.496414 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b9b95e-8f71-4728-897a-d10e32f733e4 admin admin] PATH_INFO: `/v3/users/6947eec459f2416dbebb636662677a37` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:21:27.497600 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b9b95e-8f71-4728-897a-d10e32f733e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6947eec459f2416dbebb636662677a37)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:21:27.499545 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b9b95e-8f71-4728-897a-d10e32f733e4 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:21:27.501000 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=100 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:21:27.547169 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-f9b9b95e-8f71-4728-897a-d10e32f733e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6947eec459f2416dbebb636662677a37'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:21:27.553942 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-f9b9b95e-8f71-4728-897a-d10e32f733e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6947eec459f2416dbebb636662677a37'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:21:27.554700 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-f9b9b95e-8f71-4728-897a-d10e32f733e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6947eec459f2416dbebb636662677a37'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:21:27.563030 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-f9b9b95e-8f71-4728-897a-d10e32f733e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6947eec459f2416dbebb636662677a37'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:21:27.563659 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-f9b9b95e-8f71-4728-897a-d10e32f733e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6947eec459f2416dbebb636662677a37'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:21:27.581524 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1464/2945] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 14 10:21:27 2022] DELETE /identity/v3/users/6947eec459f2416dbebb636662677a37 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:21:27.586005 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6acdb8-d199-4d9a-a925-553f8f38ae54 None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:21:27.586729 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6acdb8-d199-4d9a-a925-553f8f38ae54 None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:21:27.586729 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6acdb8-d199-4d9a-a925-553f8f38ae54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:21:27.604566 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-3d6acdb8-d199-4d9a-a925-553f8f38ae54 None None] MFA Rules not processed for user `d3cc085bb5914250a5e384092f9f12f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:21:27.605768 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-3d6acdb8-d199-4d9a-a925-553f8f38ae54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:21:27.664092 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1482/2946] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 10:21:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:21:27.673548 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b9b95e-8f71-4728-897a-d10e32f733e4 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:21:27.675016 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-f9b9b95e-8f71-4728-897a-d10e32f733e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:21:27.731095 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b9b95e-8f71-4728-897a-d10e32f733e4 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:21:27.734772 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea162e8c-cc08-4c7c-bb81-07b5cb9f0743 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e4a5a8965e4802a9055d332179b7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:21:27.735419 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea162e8c-cc08-4c7c-bb81-07b5cb9f0743 service neutron] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:21:27.735701 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea162e8c-cc08-4c7c-bb81-07b5cb9f0743 service neutron] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:21:27.735978 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea162e8c-cc08-4c7c-bb81-07b5cb9f0743 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:21:27.744865 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea162e8c-cc08-4c7c-bb81-07b5cb9f0743 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:21:27.746360 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea162e8c-cc08-4c7c-bb81-07b5cb9f0743 service neutron] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:21:27.755664 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1465/2947] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 10:21:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:21:28.014329 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6acdb8-d199-4d9a-a925-553f8f38ae54 None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:21:28.015746 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-3d6acdb8-d199-4d9a-a925-553f8f38ae54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:21:28.027982 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6acdb8-d199-4d9a-a925-553f8f38ae54 None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:21:28.032692 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef24a20a-09a6-42d0-9791-2ea866767ce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:21:28.033685 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef24a20a-09a6-42d0-9791-2ea866767ce4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:21:28.033974 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef24a20a-09a6-42d0-9791-2ea866767ce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:21:28.034288 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef24a20a-09a6-42d0-9791-2ea866767ce4 admin admin] PATH_INFO: `/v3/projects/cda2b9b71803463bb447320c78069230` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:21:28.035490 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef24a20a-09a6-42d0-9791-2ea866767ce4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cda2b9b71803463bb447320c78069230)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:21:28.038124 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef24a20a-09a6-42d0-9791-2ea866767ce4 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:21:28.079206 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:21:28.086457 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-ef24a20a-09a6-42d0-9791-2ea866767ce4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cda2b9b71803463bb447320c78069230', 'request_id': 'req-ef24a20a-09a6-42d0-9791-2ea866767ce4'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:21:28.093158 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-ef24a20a-09a6-42d0-9791-2ea866767ce4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cda2b9b71803463bb447320c78069230', 'request_id': 'req-ef24a20a-09a6-42d0-9791-2ea866767ce4'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:21:28.098602 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-ef24a20a-09a6-42d0-9791-2ea866767ce4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cda2b9b71803463bb447320c78069230', 'request_id': 'req-ef24a20a-09a6-42d0-9791-2ea866767ce4'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:21:28.112129 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-ef24a20a-09a6-42d0-9791-2ea866767ce4 admin admin] The token cache is being invalidate because project cda2b9b71803463bb447320c78069230 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:21:28.112416 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-ef24a20a-09a6-42d0-9791-2ea866767ce4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:21:28.113033 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-ef24a20a-09a6-42d0-9791-2ea866767ce4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:21:28.114616 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1483/2948] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 14 10:21:28 2022] DELETE /identity/v3/projects/cda2b9b71803463bb447320c78069230 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:21:28.118606 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea162e8c-cc08-4c7c-bb81-07b5cb9f0743 service neutron] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:21:28.128644 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea162e8c-cc08-4c7c-bb81-07b5cb9f0743 service neutron] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:21:28.182408 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0de1a12-9b6c-47da-8e1f-2e9cd85fffd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:21:28.183803 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0de1a12-9b6c-47da-8e1f-2e9cd85fffd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:21:28.184086 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0de1a12-9b6c-47da-8e1f-2e9cd85fffd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:21:28.184361 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0de1a12-9b6c-47da-8e1f-2e9cd85fffd1 admin admin] PATH_INFO: `/v3/users/a51d1a6a5aa2422dad1071bdf29671d4` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:21:28.185552 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0de1a12-9b6c-47da-8e1f-2e9cd85fffd1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a51d1a6a5aa2422dad1071bdf29671d4)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:21:28.187510 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0de1a12-9b6c-47da-8e1f-2e9cd85fffd1 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:21:28.210354 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:21:28.234332 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-c0de1a12-9b6c-47da-8e1f-2e9cd85fffd1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a51d1a6a5aa2422dad1071bdf29671d4'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:21:28.241127 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-c0de1a12-9b6c-47da-8e1f-2e9cd85fffd1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a51d1a6a5aa2422dad1071bdf29671d4'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:21:28.241775 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-c0de1a12-9b6c-47da-8e1f-2e9cd85fffd1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a51d1a6a5aa2422dad1071bdf29671d4'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:21:28.249657 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-c0de1a12-9b6c-47da-8e1f-2e9cd85fffd1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a51d1a6a5aa2422dad1071bdf29671d4'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:21:28.250300 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-c0de1a12-9b6c-47da-8e1f-2e9cd85fffd1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a51d1a6a5aa2422dad1071bdf29671d4'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:21:28.267083 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1466/2949] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 14 10:21:28 2022] DELETE /identity/v3/users/a51d1a6a5aa2422dad1071bdf29671d4 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:21:28.541218 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef24a20a-09a6-42d0-9791-2ea866767ce4 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:21:28.543247 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-ef24a20a-09a6-42d0-9791-2ea866767ce4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:21:28.561021 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef24a20a-09a6-42d0-9791-2ea866767ce4 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:21:28.618000 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857a320a-2a3e-4eb4-971f-4a9937452caa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:21:28.618981 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857a320a-2a3e-4eb4-971f-4a9937452caa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:21:28.619268 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857a320a-2a3e-4eb4-971f-4a9937452caa admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:21:28.619548 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857a320a-2a3e-4eb4-971f-4a9937452caa admin admin] PATH_INFO: `/v3/projects/8f53498bea0f41f8b609a411e8fd2b98` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:21:28.620747 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857a320a-2a3e-4eb4-971f-4a9937452caa admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f53498bea0f41f8b609a411e8fd2b98)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:21:28.622702 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857a320a-2a3e-4eb4-971f-4a9937452caa admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:21:28.666771 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-857a320a-2a3e-4eb4-971f-4a9937452caa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f53498bea0f41f8b609a411e8fd2b98', 'request_id': 'req-857a320a-2a3e-4eb4-971f-4a9937452caa'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:21:28.673399 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-857a320a-2a3e-4eb4-971f-4a9937452caa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f53498bea0f41f8b609a411e8fd2b98', 'request_id': 'req-857a320a-2a3e-4eb4-971f-4a9937452caa'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:21:28.678907 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-857a320a-2a3e-4eb4-971f-4a9937452caa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f53498bea0f41f8b609a411e8fd2b98', 'request_id': 'req-857a320a-2a3e-4eb4-971f-4a9937452caa'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:21:28.690933 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-857a320a-2a3e-4eb4-971f-4a9937452caa admin admin] The token cache is being invalidate because project 8f53498bea0f41f8b609a411e8fd2b98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:21:28.691231 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-857a320a-2a3e-4eb4-971f-4a9937452caa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:21:28.691836 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-857a320a-2a3e-4eb4-971f-4a9937452caa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:21:28.693357 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1484/2950] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 14 10:21:28 2022] DELETE /identity/v3/projects/8f53498bea0f41f8b609a411e8fd2b98 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:21:28.697634 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0de1a12-9b6c-47da-8e1f-2e9cd85fffd1 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:21:28.699150 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-c0de1a12-9b6c-47da-8e1f-2e9cd85fffd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:21:28.712293 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0de1a12-9b6c-47da-8e1f-2e9cd85fffd1 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:21:28.769862 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdf8a3e-3ddf-48ac-abf1-34fe6132a6f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:21:28.770771 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdf8a3e-3ddf-48ac-abf1-34fe6132a6f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:21:28.771053 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdf8a3e-3ddf-48ac-abf1-34fe6132a6f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:21:28.771327 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdf8a3e-3ddf-48ac-abf1-34fe6132a6f2 admin admin] PATH_INFO: `/v3/users/56f3db74b4e34ab396c7b511af8599c1` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:21:28.772513 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdf8a3e-3ddf-48ac-abf1-34fe6132a6f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=56f3db74b4e34ab396c7b511af8599c1)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:21:28.774541 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdf8a3e-3ddf-48ac-abf1-34fe6132a6f2 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:21:28.821122 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-efdf8a3e-3ddf-48ac-abf1-34fe6132a6f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56f3db74b4e34ab396c7b511af8599c1'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:21:28.828590 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-efdf8a3e-3ddf-48ac-abf1-34fe6132a6f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56f3db74b4e34ab396c7b511af8599c1'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:21:28.829266 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-efdf8a3e-3ddf-48ac-abf1-34fe6132a6f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56f3db74b4e34ab396c7b511af8599c1'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:21:28.837472 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-efdf8a3e-3ddf-48ac-abf1-34fe6132a6f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56f3db74b4e34ab396c7b511af8599c1'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:21:28.838179 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-efdf8a3e-3ddf-48ac-abf1-34fe6132a6f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56f3db74b4e34ab396c7b511af8599c1'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:21:28.858166 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1467/2951] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 14 10:21:28 2022] DELETE /identity/v3/users/56f3db74b4e34ab396c7b511af8599c1 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:21:29.117784 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857a320a-2a3e-4eb4-971f-4a9937452caa admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:21:29.119245 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-857a320a-2a3e-4eb4-971f-4a9937452caa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:21:29.133953 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857a320a-2a3e-4eb4-971f-4a9937452caa admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:21:29.190181 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb7cecf-ef5d-4ed6-9fa2-7f0ef48e9744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:21:29.191067 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb7cecf-ef5d-4ed6-9fa2-7f0ef48e9744 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:21:29.191352 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb7cecf-ef5d-4ed6-9fa2-7f0ef48e9744 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:21:29.191626 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb7cecf-ef5d-4ed6-9fa2-7f0ef48e9744 admin admin] PATH_INFO: `/v3/projects/7b92863e105044768c31f9c5fc307fd5` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:21:29.192836 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb7cecf-ef5d-4ed6-9fa2-7f0ef48e9744 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b92863e105044768c31f9c5fc307fd5)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:21:29.194773 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb7cecf-ef5d-4ed6-9fa2-7f0ef48e9744 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:21:29.196544 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:21:29.244915 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-4fb7cecf-ef5d-4ed6-9fa2-7f0ef48e9744 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b92863e105044768c31f9c5fc307fd5', 'request_id': 'req-4fb7cecf-ef5d-4ed6-9fa2-7f0ef48e9744'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:21:29.250899 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-4fb7cecf-ef5d-4ed6-9fa2-7f0ef48e9744 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b92863e105044768c31f9c5fc307fd5', 'request_id': 'req-4fb7cecf-ef5d-4ed6-9fa2-7f0ef48e9744'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:21:29.256347 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-4fb7cecf-ef5d-4ed6-9fa2-7f0ef48e9744 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b92863e105044768c31f9c5fc307fd5', 'request_id': 'req-4fb7cecf-ef5d-4ed6-9fa2-7f0ef48e9744'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:21:29.268801 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-4fb7cecf-ef5d-4ed6-9fa2-7f0ef48e9744 admin admin] The token cache is being invalidate because project 7b92863e105044768c31f9c5fc307fd5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:21:29.269092 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-4fb7cecf-ef5d-4ed6-9fa2-7f0ef48e9744 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:21:29.269711 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-4fb7cecf-ef5d-4ed6-9fa2-7f0ef48e9744 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:21:29.271290 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1485/2952] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 14 10:21:29 2022] DELETE /identity/v3/projects/7b92863e105044768c31f9c5fc307fd5 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:21:38.853734 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=73,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:21:39.265798 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=24,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:23:02.790048 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdf8a3e-3ddf-48ac-abf1-34fe6132a6f2 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:02.791490 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-efdf8a3e-3ddf-48ac-abf1-34fe6132a6f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:02.847866 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdf8a3e-3ddf-48ac-abf1-34fe6132a6f2 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:02.894381 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91834e1-5f11-4d9a-945e-f66ccec42fdb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e4a5a8965e4802a9055d332179b7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:02.895029 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91834e1-5f11-4d9a-945e-f66ccec42fdb service neutron] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:02.895315 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91834e1-5f11-4d9a-945e-f66ccec42fdb service neutron] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:02.895593 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91834e1-5f11-4d9a-945e-f66ccec42fdb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:02.897339 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-d91834e1-5f11-4d9a-945e-f66ccec42fdb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:02.965442 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91834e1-5f11-4d9a-945e-f66ccec42fdb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:02.966900 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91834e1-5f11-4d9a-945e-f66ccec42fdb service neutron] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:02.978249 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1468/2953] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 10:23:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:23:06.427972 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed004e1-914c-4b85-9bad-69c443ca8f6a None None] REQUEST_METHOD: `POST` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:06.428452 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed004e1-914c-4b85-9bad-69c443ca8f6a None None] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:06.428542 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed004e1-914c-4b85-9bad-69c443ca8f6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:06.446819 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.auth.core [None req-bed004e1-914c-4b85-9bad-69c443ca8f6a None None] MFA Rules not processed for user `5897368539ef4287bcba0c274c458491`. Rule list: `[]` (Enabled: `True`). {{(pid=80198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:23:06.448102 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-bed004e1-914c-4b85-9bad-69c443ca8f6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:06.504706 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1486/2954] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 10:23:06 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:23:06.808250 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91834e1-5f11-4d9a-945e-f66ccec42fdb service neutron] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:06.809796 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-d91834e1-5f11-4d9a-945e-f66ccec42fdb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:06.820856 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91834e1-5f11-4d9a-945e-f66ccec42fdb service neutron] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:06.824492 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd89bdd-2570-4f86-bcf2-50f552dc8ecf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e4a5a8965e4802a9055d332179b7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:06.825139 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd89bdd-2570-4f86-bcf2-50f552dc8ecf service neutron] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:06.825428 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd89bdd-2570-4f86-bcf2-50f552dc8ecf service neutron] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:06.825711 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd89bdd-2570-4f86-bcf2-50f552dc8ecf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:06.827446 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-bcd89bdd-2570-4f86-bcf2-50f552dc8ecf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:06.836734 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd89bdd-2570-4f86-bcf2-50f552dc8ecf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:06.838161 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd89bdd-2570-4f86-bcf2-50f552dc8ecf service neutron] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:06.846233 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1469/2955] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 10:23:06 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:23:08.286069 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed004e1-914c-4b85-9bad-69c443ca8f6a None None] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:08.287529 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-bed004e1-914c-4b85-9bad-69c443ca8f6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:08.358070 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed004e1-914c-4b85-9bad-69c443ca8f6a None None] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:08.363640 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a97769c-0f02-4f7c-a876-0d0b945a9178 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc5a80144b84c609944a51a84fd5e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:08.364290 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a97769c-0f02-4f7c-a876-0d0b945a9178 service placement] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:08.364567 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a97769c-0f02-4f7c-a876-0d0b945a9178 service placement] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:08.364853 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a97769c-0f02-4f7c-a876-0d0b945a9178 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:08.366658 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-3a97769c-0f02-4f7c-a876-0d0b945a9178 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:08.378114 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a97769c-0f02-4f7c-a876-0d0b945a9178 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:08.380271 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a97769c-0f02-4f7c-a876-0d0b945a9178 service placement] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:08.390243 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1487/2956] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 10:23:08 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:23:16.842567 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=80 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:23:18.385953 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=57 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:23:22.479716 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd89bdd-2570-4f86-bcf2-50f552dc8ecf service neutron] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:22.481412 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-bcd89bdd-2570-4f86-bcf2-50f552dc8ecf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:22.500463 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd89bdd-2570-4f86-bcf2-50f552dc8ecf service neutron] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:22.506859 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ffe868-5dc8-4031-b5ed-5a8a6d6081d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f6962106dfa4c4c9af551053f8095e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:22.507517 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ffe868-5dc8-4031-b5ed-5a8a6d6081d7 service nova] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:22.507805 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ffe868-5dc8-4031-b5ed-5a8a6d6081d7 service nova] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:22.508080 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ffe868-5dc8-4031-b5ed-5a8a6d6081d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:22.509852 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-44ffe868-5dc8-4031-b5ed-5a8a6d6081d7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:22.528549 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ffe868-5dc8-4031-b5ed-5a8a6d6081d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:22.528549 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ffe868-5dc8-4031-b5ed-5a8a6d6081d7 service nova] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:22.541525 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1470/2957] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 10:23:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:23:24.091031 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a97769c-0f02-4f7c-a876-0d0b945a9178 service placement] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:23:24.101607 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a97769c-0f02-4f7c-a876-0d0b945a9178 service placement] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:23:24.106640 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1a9546-9b90-4d4f-b62b-1775edbdb259 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc5a80144b84c609944a51a84fd5e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:23:24.107280 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1a9546-9b90-4d4f-b62b-1775edbdb259 service placement] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:23:24.107565 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1a9546-9b90-4d4f-b62b-1775edbdb259 service placement] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:23:24.107845 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1a9546-9b90-4d4f-b62b-1775edbdb259 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:23:24.109631 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-4b1a9546-9b90-4d4f-b62b-1775edbdb259 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:23:24.121309 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1a9546-9b90-4d4f-b62b-1775edbdb259 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:23:24.122946 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1a9546-9b90-4d4f-b62b-1775edbdb259 service placement] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:23:24.133541 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1488/2958] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 10:23:24 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:23:32.534762 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=6 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:23:34.129077 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=6 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:24:27.399218 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ffe868-5dc8-4031-b5ed-5a8a6d6081d7 service nova] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:24:27.400683 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-44ffe868-5dc8-4031-b5ed-5a8a6d6081d7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:24:27.427289 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ffe868-5dc8-4031-b5ed-5a8a6d6081d7 service nova] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:24:27.430808 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7cd827-819a-4ff9-b57a-8a27b9422a9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e4a5a8965e4802a9055d332179b7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:24:27.431451 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7cd827-819a-4ff9-b57a-8a27b9422a9d service neutron] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:24:27.431894 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7cd827-819a-4ff9-b57a-8a27b9422a9d service neutron] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:24:27.432172 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7cd827-819a-4ff9-b57a-8a27b9422a9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:24:27.433904 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-2f7cd827-819a-4ff9-b57a-8a27b9422a9d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:24:27.444463 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7cd827-819a-4ff9-b57a-8a27b9422a9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:24:27.446128 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7cd827-819a-4ff9-b57a-8a27b9422a9d service neutron] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:24:27.454282 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1471/2959] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 10:24:27 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:24:37.450710 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=11 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:25:17.754892 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1a9546-9b90-4d4f-b62b-1775edbdb259 service placement] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:25:17.756293 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-4b1a9546-9b90-4d4f-b62b-1775edbdb259 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:25:17.840988 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1a9546-9b90-4d4f-b62b-1775edbdb259 service placement] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:25:17.844534 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898e366d-c868-4dcf-8d90-b9037751b159 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25048b29787d482783ebc944f1a7df65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:25:17.845185 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898e366d-c868-4dcf-8d90-b9037751b159 service cinder] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:25:17.845474 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898e366d-c868-4dcf-8d90-b9037751b159 service cinder] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:25:17.845768 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898e366d-c868-4dcf-8d90-b9037751b159 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:25:17.848280 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-898e366d-c868-4dcf-8d90-b9037751b159 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:25:17.859008 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898e366d-c868-4dcf-8d90-b9037751b159 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:25:17.860499 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898e366d-c868-4dcf-8d90-b9037751b159 service cinder] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:25:17.872275 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1489/2960] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 10:25:17 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:25:27.866078 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=35 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:25:30.889000 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde7aa91-143b-4987-8c2e-e0a5bdac7c34 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:25:30.889508 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde7aa91-143b-4987-8c2e-e0a5bdac7c34 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:25:30.889605 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde7aa91-143b-4987-8c2e-e0a5bdac7c34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:25:30.907278 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-bde7aa91-143b-4987-8c2e-e0a5bdac7c34 None None] MFA Rules not processed for user `5897368539ef4287bcba0c274c458491`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:25:30.908455 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-bde7aa91-143b-4987-8c2e-e0a5bdac7c34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:25:30.915832 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1472/2961] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 10:25:30 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:25:31.227005 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898e366d-c868-4dcf-8d90-b9037751b159 service cinder] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:25:31.236247 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898e366d-c868-4dcf-8d90-b9037751b159 service cinder] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:25:31.240386 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667d8034-92c9-41a1-9418-2b01b740cef4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e4a5a8965e4802a9055d332179b7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:25:31.241020 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667d8034-92c9-41a1-9418-2b01b740cef4 service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:25:31.241300 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667d8034-92c9-41a1-9418-2b01b740cef4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:25:31.241574 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667d8034-92c9-41a1-9418-2b01b740cef4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:25:31.243369 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-667d8034-92c9-41a1-9418-2b01b740cef4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:25:31.252687 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667d8034-92c9-41a1-9418-2b01b740cef4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:25:31.254203 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667d8034-92c9-41a1-9418-2b01b740cef4 service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:25:31.262255 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1490/2962] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 10:25:31 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:25:31.720480 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde7aa91-143b-4987-8c2e-e0a5bdac7c34 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:25:31.730979 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde7aa91-143b-4987-8c2e-e0a5bdac7c34 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:25:31.734546 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8c404b-85c9-423d-a3f0-3495ed060f1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e4a5a8965e4802a9055d332179b7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:25:31.735189 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8c404b-85c9-423d-a3f0-3495ed060f1b service neutron] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:25:31.735474 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8c404b-85c9-423d-a3f0-3495ed060f1b service neutron] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:25:31.735751 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8c404b-85c9-423d-a3f0-3495ed060f1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:25:31.737555 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-fe8c404b-85c9-423d-a3f0-3495ed060f1b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:25:31.763193 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8c404b-85c9-423d-a3f0-3495ed060f1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:25:31.764681 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8c404b-85c9-423d-a3f0-3495ed060f1b service neutron] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:25:31.777008 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1473/2963] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 10:25:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:25:34.002632 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667d8034-92c9-41a1-9418-2b01b740cef4 service neutron] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:25:34.028696 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667d8034-92c9-41a1-9418-2b01b740cef4 service neutron] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:25:34.048101 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bb7de8-afbf-4286-9f20-274d3e67f9f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f6962106dfa4c4c9af551053f8095e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:25:34.048819 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bb7de8-afbf-4286-9f20-274d3e67f9f5 service nova] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:25:34.049167 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bb7de8-afbf-4286-9f20-274d3e67f9f5 service nova] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:25:34.049455 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bb7de8-afbf-4286-9f20-274d3e67f9f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:25:34.052361 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-99bb7de8-afbf-4286-9f20-274d3e67f9f5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:25:34.071783 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bb7de8-afbf-4286-9f20-274d3e67f9f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:25:34.073662 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bb7de8-afbf-4286-9f20-274d3e67f9f5 service nova] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:25:34.087337 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1491/2964] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 10:25:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:25:41.771511 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=14 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:25:44.082271 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=12 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:25:49.706777 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8c404b-85c9-423d-a3f0-3495ed060f1b service neutron] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:25:49.715412 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8c404b-85c9-423d-a3f0-3495ed060f1b service neutron] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:25:49.718988 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0d30b2-173e-4ecd-89d7-b347f238942b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e4a5a8965e4802a9055d332179b7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:25:49.719629 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0d30b2-173e-4ecd-89d7-b347f238942b service neutron] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:25:49.719916 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0d30b2-173e-4ecd-89d7-b347f238942b service neutron] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:25:49.720195 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0d30b2-173e-4ecd-89d7-b347f238942b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:25:49.722547 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-9f0d30b2-173e-4ecd-89d7-b347f238942b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:25:49.785613 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0d30b2-173e-4ecd-89d7-b347f238942b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:25:49.787063 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0d30b2-173e-4ecd-89d7-b347f238942b service neutron] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:25:49.798840 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1474/2965] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 10:25:49 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:25:51.362039 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bb7de8-afbf-4286-9f20-274d3e67f9f5 service nova] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:25:51.378347 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bb7de8-afbf-4286-9f20-274d3e67f9f5 service nova] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:25:51.384076 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd5dff9-dce0-454c-aa92-8c4592b10e6e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f6962106dfa4c4c9af551053f8095e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:25:51.384796 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd5dff9-dce0-454c-aa92-8c4592b10e6e service nova] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:25:51.385148 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd5dff9-dce0-454c-aa92-8c4592b10e6e service nova] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:25:51.385491 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd5dff9-dce0-454c-aa92-8c4592b10e6e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:25:51.387361 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-cdd5dff9-dce0-454c-aa92-8c4592b10e6e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:25:51.422773 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd5dff9-dce0-454c-aa92-8c4592b10e6e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:25:51.424412 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd5dff9-dce0-454c-aa92-8c4592b10e6e service nova] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:25:51.436473 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1492/2966] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 10:25:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:25:59.793069 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=30 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:26:01.431333 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=14 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:28:09.194988 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9796af4c-0e7d-4d3b-b4dc-62bd98a33ee4 None None] REQUEST_METHOD: `POST` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:28:09.195865 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9796af4c-0e7d-4d3b-b4dc-62bd98a33ee4 None None] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:28:09.195865 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9796af4c-0e7d-4d3b-b4dc-62bd98a33ee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:28:09.266977 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.auth.core [None req-9796af4c-0e7d-4d3b-b4dc-62bd98a33ee4 None None] MFA Rules not processed for user `65e4a5a8965e4802a9055d332179b7a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:28:09.268237 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-9796af4c-0e7d-4d3b-b4dc-62bd98a33ee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:28:09.275641 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1475/2967] 10.222.0.40 () {58 vars in 1061 bytes} [Thu Jul 14 10:28:09 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:28:09.281498 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd5dff9-dce0-454c-aa92-8c4592b10e6e service nova] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:28:09.291049 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd5dff9-dce0-454c-aa92-8c4592b10e6e service nova] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:28:09.295503 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8f9490-4d36-4b1b-a76f-9c41a590a75c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e4a5a8965e4802a9055d332179b7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:28:09.296168 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8f9490-4d36-4b1b-a76f-9c41a590a75c service neutron] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:28:09.296456 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8f9490-4d36-4b1b-a76f-9c41a590a75c service neutron] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:28:09.296734 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8f9490-4d36-4b1b-a76f-9c41a590a75c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:28:09.320942 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8f9490-4d36-4b1b-a76f-9c41a590a75c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:28:09.323487 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8f9490-4d36-4b1b-a76f-9c41a590a75c service neutron] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:28:09.355612 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1493/2968] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 10:28:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:28:19.263847 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=17 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:28:19.351661 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=13 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:28:21.640005 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9796af4c-0e7d-4d3b-b4dc-62bd98a33ee4 None None] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:28:21.648040 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9796af4c-0e7d-4d3b-b4dc-62bd98a33ee4 None None] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:28:21.651693 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bec1b6-dc03-4412-8d0a-d7c35a964cdf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e4a5a8965e4802a9055d332179b7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:28:21.652337 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bec1b6-dc03-4412-8d0a-d7c35a964cdf service neutron] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:28:21.652622 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bec1b6-dc03-4412-8d0a-d7c35a964cdf service neutron] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:28:21.652902 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bec1b6-dc03-4412-8d0a-d7c35a964cdf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:28:21.654699 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-28bec1b6-dc03-4412-8d0a-d7c35a964cdf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:28:21.738461 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bec1b6-dc03-4412-8d0a-d7c35a964cdf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:28:21.740319 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bec1b6-dc03-4412-8d0a-d7c35a964cdf service neutron] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:28:21.759847 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1476/2969] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 10:28:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:28:24.535293 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8f9490-4d36-4b1b-a76f-9c41a590a75c service neutron] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:28:24.569975 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8f9490-4d36-4b1b-a76f-9c41a590a75c service neutron] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:28:24.575793 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d65d599-0083-45e4-830d-e7d9699da1ef service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc5a80144b84c609944a51a84fd5e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:28:24.576668 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d65d599-0083-45e4-830d-e7d9699da1ef service placement] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:28:24.577278 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d65d599-0083-45e4-830d-e7d9699da1ef service placement] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:28:24.577709 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d65d599-0083-45e4-830d-e7d9699da1ef service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:28:24.583981 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-7d65d599-0083-45e4-830d-e7d9699da1ef service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:28:24.632720 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d65d599-0083-45e4-830d-e7d9699da1ef service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:28:24.634437 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d65d599-0083-45e4-830d-e7d9699da1ef service placement] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:28:24.647772 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1494/2970] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 10:28:24 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:28:27.936563 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bec1b6-dc03-4412-8d0a-d7c35a964cdf service neutron] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:28:27.966881 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bec1b6-dc03-4412-8d0a-d7c35a964cdf service neutron] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:28:27.985872 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f500c75a-d350-499d-99b5-2f6ffa4fd0c1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc5a80144b84c609944a51a84fd5e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:28:27.986687 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f500c75a-d350-499d-99b5-2f6ffa4fd0c1 service placement] REQUEST_METHOD: `GET` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:28:27.987071 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f500c75a-d350-499d-99b5-2f6ffa4fd0c1 service placement] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:28:27.987416 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f500c75a-d350-499d-99b5-2f6ffa4fd0c1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:28:27.992431 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-f500c75a-d350-499d-99b5-2f6ffa4fd0c1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:28:28.007853 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f500c75a-d350-499d-99b5-2f6ffa4fd0c1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:28:28.011038 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d65d599-0083-45e4-830d-e7d9699da1ef service placement] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:28:28.011529 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f500c75a-d350-499d-99b5-2f6ffa4fd0c1 service placement] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:28:28.013551 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-7d65d599-0083-45e4-830d-e7d9699da1ef service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:28:28.022567 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1477/2971] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 10:28:27 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:28:28.039389 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d65d599-0083-45e4-830d-e7d9699da1ef service placement] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:28:28.044629 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abb8c31-5b1a-4725-a0a1-8bc39275a96e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:28:28.045773 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abb8c31-5b1a-4725-a0a1-8bc39275a96e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:28:28.046270 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abb8c31-5b1a-4725-a0a1-8bc39275a96e admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:28:28.046711 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abb8c31-5b1a-4725-a0a1-8bc39275a96e admin admin] PATH_INFO: `/v3/users/5897368539ef4287bcba0c274c458491` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:28:28.048038 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abb8c31-5b1a-4725-a0a1-8bc39275a96e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5897368539ef4287bcba0c274c458491)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:28:28.050151 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abb8c31-5b1a-4725-a0a1-8bc39275a96e admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:28:28.102997 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-0abb8c31-5b1a-4725-a0a1-8bc39275a96e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5897368539ef4287bcba0c274c458491'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:28:28.115786 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-0abb8c31-5b1a-4725-a0a1-8bc39275a96e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5897368539ef4287bcba0c274c458491'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:28:28.116491 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-0abb8c31-5b1a-4725-a0a1-8bc39275a96e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5897368539ef4287bcba0c274c458491'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:28:28.124343 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-0abb8c31-5b1a-4725-a0a1-8bc39275a96e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5897368539ef4287bcba0c274c458491'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:28:28.133760 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-0abb8c31-5b1a-4725-a0a1-8bc39275a96e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5897368539ef4287bcba0c274c458491'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:28:28.140887 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1495/2972] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 14 10:28:28 2022] DELETE /identity/v3/users/5897368539ef4287bcba0c274c458491 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:28:28.317893 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f500c75a-d350-499d-99b5-2f6ffa4fd0c1 service placement] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:28:28.328833 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f500c75a-d350-499d-99b5-2f6ffa4fd0c1 service placement] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:28:28.390455 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d1b3c2-1433-4689-a248-f0e36e82c396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:28:28.391349 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d1b3c2-1433-4689-a248-f0e36e82c396 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:28:28.391641 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d1b3c2-1433-4689-a248-f0e36e82c396 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:28:28.391926 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d1b3c2-1433-4689-a248-f0e36e82c396 admin admin] PATH_INFO: `/v3/projects/c5f8922bb91240a2b1f63f306c6d09d1` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:28:28.393143 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d1b3c2-1433-4689-a248-f0e36e82c396 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5f8922bb91240a2b1f63f306c6d09d1)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:28:28.395165 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d1b3c2-1433-4689-a248-f0e36e82c396 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:28:28.440056 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:28:28.441598 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-f8d1b3c2-1433-4689-a248-f0e36e82c396 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5f8922bb91240a2b1f63f306c6d09d1', 'request_id': 'req-f8d1b3c2-1433-4689-a248-f0e36e82c396'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:28:28.450474 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-f8d1b3c2-1433-4689-a248-f0e36e82c396 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5f8922bb91240a2b1f63f306c6d09d1', 'request_id': 'req-f8d1b3c2-1433-4689-a248-f0e36e82c396'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:28:28.456089 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-f8d1b3c2-1433-4689-a248-f0e36e82c396 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5f8922bb91240a2b1f63f306c6d09d1', 'request_id': 'req-f8d1b3c2-1433-4689-a248-f0e36e82c396'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:28:28.467442 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-f8d1b3c2-1433-4689-a248-f0e36e82c396 admin admin] The token cache is being invalidate because project c5f8922bb91240a2b1f63f306c6d09d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:28:28.467737 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-f8d1b3c2-1433-4689-a248-f0e36e82c396 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:28:28.468378 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-f8d1b3c2-1433-4689-a248-f0e36e82c396 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:28:28.469913 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1478/2973] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 14 10:28:28 2022] DELETE /identity/v3/projects/c5f8922bb91240a2b1f63f306c6d09d1 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:28:28.475091 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abb8c31-5b1a-4725-a0a1-8bc39275a96e admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:28:28.476915 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-0abb8c31-5b1a-4725-a0a1-8bc39275a96e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:28:28.491626 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abb8c31-5b1a-4725-a0a1-8bc39275a96e admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:28:28.548296 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e53e6f6-9fde-4044-9d24-3b8e49895262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:28:28.549188 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e53e6f6-9fde-4044-9d24-3b8e49895262 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:28:28.549473 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e53e6f6-9fde-4044-9d24-3b8e49895262 admin admin] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:28:28.549751 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e53e6f6-9fde-4044-9d24-3b8e49895262 admin admin] PATH_INFO: `/v3/users/929deac4154e45dea929ffb9d4ddbee5` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:28:28.551004 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e53e6f6-9fde-4044-9d24-3b8e49895262 admin admin] RBAC: Authorizing `identity:delete_user(user_id=929deac4154e45dea929ffb9d4ddbee5)` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:28:28.553537 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e53e6f6-9fde-4044-9d24-3b8e49895262 admin admin] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:28:28.591147 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:28:28.601551 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-4e53e6f6-9fde-4044-9d24-3b8e49895262 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '929deac4154e45dea929ffb9d4ddbee5'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:28:28.613343 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-4e53e6f6-9fde-4044-9d24-3b8e49895262 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '929deac4154e45dea929ffb9d4ddbee5'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:28:28.614571 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-4e53e6f6-9fde-4044-9d24-3b8e49895262 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '929deac4154e45dea929ffb9d4ddbee5'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:28:28.622215 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-4e53e6f6-9fde-4044-9d24-3b8e49895262 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '929deac4154e45dea929ffb9d4ddbee5'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:28:28.629152 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.notifications [None req-4e53e6f6-9fde-4044-9d24-3b8e49895262 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '929deac4154e45dea929ffb9d4ddbee5'} {{(pid=80198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:28:28.635621 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1496/2974] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 14 10:28:28 2022] DELETE /identity/v3/users/929deac4154e45dea929ffb9d4ddbee5 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:28:28.817878 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d1b3c2-1433-4689-a248-f0e36e82c396 admin admin] Authenticating user token {{(pid=80197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:28:28.819421 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.fernet_utils [None req-f8d1b3c2-1433-4689-a248-f0e36e82c396 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:28:28.844222 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d1b3c2-1433-4689-a248-f0e36e82c396 admin admin] Validating token access rules against request {{(pid=80197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:28:28.901288 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e82dc0-a052-4bbd-b561-9c5d1b5f2e08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3cc085bb5914250a5e384092f9f12f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc045bacae334916a4c6d8daadbcb707', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:28:28.902162 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e82dc0-a052-4bbd-b561-9c5d1b5f2e08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:28:28.902474 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e82dc0-a052-4bbd-b561-9c5d1b5f2e08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:28:28.902758 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e82dc0-a052-4bbd-b561-9c5d1b5f2e08 admin admin] PATH_INFO: `/v3/projects/4ef18c44281e49c9b209c26613da24c7` {{(pid=80197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:28:28.903944 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e82dc0-a052-4bbd-b561-9c5d1b5f2e08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ef18c44281e49c9b209c26613da24c7)` {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:28:28.905848 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e82dc0-a052-4bbd-b561-9c5d1b5f2e08 admin admin] RBAC: Authorization granted {{(pid=80197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:28:28.951625 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-00e82dc0-a052-4bbd-b561-9c5d1b5f2e08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ef18c44281e49c9b209c26613da24c7', 'request_id': 'req-00e82dc0-a052-4bbd-b561-9c5d1b5f2e08'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:28:28.958249 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-00e82dc0-a052-4bbd-b561-9c5d1b5f2e08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ef18c44281e49c9b209c26613da24c7', 'request_id': 'req-00e82dc0-a052-4bbd-b561-9c5d1b5f2e08'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:28:28.966974 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-00e82dc0-a052-4bbd-b561-9c5d1b5f2e08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ef18c44281e49c9b209c26613da24c7', 'request_id': 'req-00e82dc0-a052-4bbd-b561-9c5d1b5f2e08'} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:28:28.980499 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-00e82dc0-a052-4bbd-b561-9c5d1b5f2e08 admin admin] The token cache is being invalidate because project 4ef18c44281e49c9b209c26613da24c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:28:28.980799 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-00e82dc0-a052-4bbd-b561-9c5d1b5f2e08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:28:28.981445 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG keystone.notifications [None req-00e82dc0-a052-4bbd-b561-9c5d1b5f2e08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:28:28.983214 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: [pid: 80197|app: 0|req: 1479/2975] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 14 10:28:28 2022] DELETE /identity/v3/projects/4ef18c44281e49c9b209c26613da24c7 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:28:38.632163 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=16,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:28:38.977376 dv-cinder-825492-26-iscsi devstack@keystone.service[80197]: DEBUG dbcounter [-] [80197] Writing DB stats keystone:SELECT=58,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:29:24.066777 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e53e6f6-9fde-4044-9d24-3b8e49895262 admin admin] Authenticating user token {{(pid=80198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:29:24.068171 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-4e53e6f6-9fde-4044-9d24-3b8e49895262 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:29:24.151087 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e53e6f6-9fde-4044-9d24-3b8e49895262 admin admin] Validating token access rules against request {{(pid=80198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:29:24.208922 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e4b503-bd7c-4346-8570-6b4c6112c1ef service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc5a80144b84c609944a51a84fd5e6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a478e76f04dd413f89ddfba7b0cdc9cc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:29:24.209580 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e4b503-bd7c-4346-8570-6b4c6112c1ef service placement] REQUEST_METHOD: `GET` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:29:24.209872 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e4b503-bd7c-4346-8570-6b4c6112c1ef service placement] SCRIPT_NAME: `/identity` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:29:24.210159 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e4b503-bd7c-4346-8570-6b4c6112c1ef service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:29:24.212605 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.fernet_utils [None req-92e4b503-bd7c-4346-8570-6b4c6112c1ef service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:29:24.224076 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e4b503-bd7c-4346-8570-6b4c6112c1ef service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:29:24.225654 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e4b503-bd7c-4346-8570-6b4c6112c1ef service placement] RBAC: Authorization granted {{(pid=80198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:29:24.235739 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: [pid: 80198|app: 0|req: 1497/2976] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 10:29:24 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:29:34.231286 dv-cinder-825492-26-iscsi devstack@keystone.service[80198]: DEBUG dbcounter [-] [80198] Writing DB stats keystone:SELECT=64 {{(pid=80198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}